Aug 01 18:17:18 user nova-compute[72150]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 01 18:17:21 user nova-compute[72150]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72150) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 18:17:21 user nova-compute[72150]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72150) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 18:17:21 user nova-compute[72150]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72150) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 18:17:21 user nova-compute[72150]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 01 18:17:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:17:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:17:21 user nova-compute[72150]: INFO nova.virt.driver [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 01 18:17:22 user nova-compute[72150]: INFO nova.compute.provider_config [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] Acquiring lock "singleton_lock" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] Acquired lock "singleton_lock" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] Releasing lock "singleton_lock" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] Full set of CONF: {{(pid=72150) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ******************************************************************************** {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] Configuration options gathered from: {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ================================================================================ {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] allow_resize_to_same_host      = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] arq_binding_timeout            = 300 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] backdoor_port                  = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] backdoor_socket                = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] block_device_allocate_retries  = 300 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] block_device_allocate_retries_interval = 5 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cert                           = self.pem {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] compute_monitors               = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] config_dir                     = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] config_drive_format            = iso9660 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] config_source                  = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] console_host                   = user {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] control_exchange               = nova {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cpu_allocation_ratio           = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] daemon                         = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] debug                          = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] default_access_ip_network_name = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] default_availability_zone      = nova {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] default_ephemeral_format       = ext4 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] default_schedule_zone          = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] disk_allocation_ratio          = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] enable_new_services            = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] enabled_apis                   = ['osapi_compute'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] enabled_ssl_apis               = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] flat_injected                  = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] force_config_drive             = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] force_raw_images               = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] graceful_shutdown_timeout      = 5 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] heal_instance_info_cache_interval = 60 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] host                           = user {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] instance_build_timeout         = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] instance_delete_interval       = 300 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] instance_format                = [instance: %(uuid)s]  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] instance_name_template         = instance-%08x {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] instance_usage_audit           = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] instance_usage_audit_period    = month {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] internal_service_availability_zone = internal {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] key                            = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] live_migration_retry_count     = 30 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] log_config_append              = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] log_dir                        = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] log_file                       = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] log_options                    = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] log_rotate_interval            = 1 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] log_rotate_interval_type       = days {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] log_rotation_type              = none {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] long_rpc_timeout               = 1800 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] max_concurrent_builds          = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] max_concurrent_live_migrations = 1 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] max_concurrent_snapshots       = 5 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] max_local_block_devices        = 3 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] max_logfile_count              = 30 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] max_logfile_size_mb            = 200 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] maximum_instance_delete_attempts = 5 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] metadata_listen                = 0.0.0.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] metadata_listen_port           = 8775 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] metadata_workers               = 3 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] migrate_max_retries            = -1 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] mkisofs_cmd                    = genisoimage {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] my_ip                          = 10.0.0.210 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] network_allocate_retries       = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] osapi_compute_listen_port      = 8774 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] osapi_compute_unique_server_name_scope =  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] osapi_compute_workers          = 3 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] password_length                = 12 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] periodic_enable                = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] periodic_fuzzy_delay           = 60 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] pointer_model                  = ps2mouse {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] preallocate_images             = none {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] publish_errors                 = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] pybasedir                      = /opt/stack/nova {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ram_allocation_ratio           = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] rate_limit_burst               = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] rate_limit_except_level        = CRITICAL {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] rate_limit_interval            = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] reboot_timeout                 = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] reclaim_instance_interval      = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] record                         = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] reimage_timeout_per_gb         = 60 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] report_interval                = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] rescue_timeout                 = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] reserved_host_cpus             = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] reserved_host_disk_mb          = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] reserved_host_memory_mb        = 512 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] reserved_huge_pages            = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] resize_confirm_window          = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] resize_fs_using_block_device   = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] resume_guests_state_on_host_boot = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] rpc_response_timeout           = 60 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] run_external_periodic_tasks    = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] running_deleted_instance_action = reap {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] running_deleted_instance_poll_interval = 1800 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] running_deleted_instance_timeout = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] scheduler_instance_sync_interval = 120 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] service_down_time              = 60 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] servicegroup_driver            = db {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] shelved_offload_time           = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] shelved_poll_interval          = 3600 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] shutdown_timeout               = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] source_is_ipv6                 = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ssl_only                       = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] state_path                     = /opt/stack/data/nova {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] sync_power_state_interval      = 600 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] sync_power_state_pool_size     = 1000 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] syslog_log_facility            = LOG_USER {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] tempdir                        = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] timeout_nbd                    = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] transport_url                  = **** {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] update_resources_interval      = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] use_cow_images                 = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] use_eventlog                   = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] use_journal                    = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] use_json                       = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] use_rootwrap_daemon            = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] use_stderr                     = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] use_syslog                     = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vcpu_pin_set                   = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vif_plugging_is_fatal          = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vif_plugging_timeout           = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] virt_mkfs                      = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] volume_usage_poll_interval     = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] watch_log_file                 = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] web                            = /usr/share/spice-html5 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_concurrency.disable_process_locking = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.auth_strategy              = keystone {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.compute_link_prefix        = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.dhcp_domain                = novalocal {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.enable_instance_password   = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.glance_link_prefix         = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.instance_list_per_project_cells = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.list_records_by_skipping_down_cells = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.local_metadata_per_cell    = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.max_limit                  = 1000 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.metadata_cache_expiration  = 15 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.neutron_default_tenant_id  = default {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.use_forwarded_for          = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.use_neutron_default_nets   = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.vendordata_dynamic_targets = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.vendordata_jsonfile_path   = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.backend                  = dogpile.cache.memcached {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.backend_argument         = **** {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.config_prefix            = cache.oslo {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.dead_timeout             = 60.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.debug_cache_backend      = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.enable_retry_client      = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.enable_socket_keepalive  = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.enabled                  = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.expiration_time          = 600 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.hashclient_retry_attempts = 2 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.memcache_dead_retry      = 300 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.memcache_password        =  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.memcache_pool_maxsize    = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.memcache_sasl_enabled    = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.memcache_username        =  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.proxies                  = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.retry_attempts           = 2 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.retry_delay              = 0.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.socket_keepalive_count   = 1 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.socket_keepalive_idle    = 1 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.socket_keepalive_interval = 1 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.tls_allowed_ciphers      = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.tls_cafile               = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.tls_certfile             = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.tls_enabled              = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cache.tls_keyfile              = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cinder.auth_section            = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cinder.auth_type               = password {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cinder.cafile                  = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cinder.certfile                = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cinder.collect_timing          = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cinder.cross_az_attach         = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cinder.debug                   = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cinder.endpoint_template       = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cinder.http_retries            = 3 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cinder.insecure                = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cinder.keyfile                 = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cinder.os_region_name          = RegionOne {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cinder.split_loggers           = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cinder.timeout                 = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] compute.cpu_dedicated_set      = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] compute.cpu_shared_set         = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] compute.image_type_exclude_list = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] compute.max_concurrent_disk_ops = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] compute.max_disk_devices_to_attach = -1 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] compute.resource_provider_association_refresh = 300 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] compute.shutdown_retry_interval = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] conductor.workers              = 3 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] console.allowed_origins        = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] console.ssl_ciphers            = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] console.ssl_minimum_version    = default {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] consoleauth.token_ttl          = 600 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cyborg.cafile                  = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cyborg.certfile                = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cyborg.collect_timing          = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cyborg.connect_retries         = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cyborg.connect_retry_delay     = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cyborg.endpoint_override       = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cyborg.insecure                = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cyborg.keyfile                 = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cyborg.max_version             = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cyborg.min_version             = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cyborg.region_name             = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cyborg.service_name            = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cyborg.service_type            = accelerator {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cyborg.split_loggers           = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cyborg.status_code_retries     = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cyborg.status_code_retry_delay = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cyborg.timeout                 = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] cyborg.version                 = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] database.backend               = sqlalchemy {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] database.connection            = **** {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] database.connection_debug      = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] database.connection_parameters =  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] database.connection_recycle_time = 3600 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] database.connection_trace      = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] database.db_inc_retry_interval = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] database.db_max_retries        = 20 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] database.db_max_retry_interval = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] database.db_retry_interval     = 1 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] database.max_overflow          = 50 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] database.max_pool_size         = 5 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] database.max_retries           = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] database.mysql_enable_ndb      = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] database.mysql_wsrep_sync_wait = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] database.pool_timeout          = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] database.retry_interval        = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] database.slave_connection      = **** {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] database.sqlite_synchronous    = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api_database.backend           = sqlalchemy {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api_database.connection        = **** {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api_database.connection_debug  = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api_database.connection_parameters =  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api_database.connection_recycle_time = 3600 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api_database.connection_trace  = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api_database.db_inc_retry_interval = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api_database.db_max_retries    = 20 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api_database.db_max_retry_interval = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api_database.db_retry_interval = 1 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api_database.max_overflow      = 50 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api_database.max_pool_size     = 5 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api_database.max_retries       = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api_database.mysql_enable_ndb  = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api_database.pool_timeout      = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api_database.retry_interval    = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api_database.slave_connection  = **** {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] api_database.sqlite_synchronous = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] devices.enabled_mdev_types     = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ephemeral_storage_encryption.enabled = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.api_servers             = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.cafile                  = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.certfile                = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.collect_timing          = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.connect_retries         = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.connect_retry_delay     = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.debug                   = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.default_trusted_certificate_ids = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.enable_certificate_validation = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.enable_rbd_download     = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.endpoint_override       = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.insecure                = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.keyfile                 = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.max_version             = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.min_version             = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.num_retries             = 3 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.rbd_ceph_conf           =  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.rbd_connect_timeout     = 5 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.rbd_pool                =  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.rbd_user                =  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.region_name             = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.service_name            = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.service_type            = image {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.split_loggers           = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.status_code_retries     = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.status_code_retry_delay = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.timeout                 = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.verify_glance_signatures = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] glance.version                 = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] guestfs.debug                  = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] hyperv.config_drive_cdrom      = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] hyperv.config_drive_inject_password = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] hyperv.enable_instance_metrics_collection = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] hyperv.enable_remotefx         = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] hyperv.instances_path_share    =  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] hyperv.iscsi_initiator_list    = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] hyperv.limit_cpu_features      = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] hyperv.power_state_check_timeframe = 60 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] hyperv.use_multipath_io        = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] hyperv.volume_attach_retry_count = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] hyperv.vswitch_name            = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] mks.enabled                    = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] image_cache.manager_interval   = 2400 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] image_cache.precache_concurrency = 1 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] image_cache.remove_unused_base_images = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] image_cache.subdirectory_name  = _base {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.api_max_retries         = 60 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.api_retry_interval      = 2 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.auth_section            = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.auth_type               = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.cafile                  = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.certfile                = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.collect_timing          = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.connect_retries         = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.connect_retry_delay     = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.endpoint_override       = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.insecure                = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.keyfile                 = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.max_version             = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.min_version             = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.partition_key           = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.peer_list               = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.region_name             = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.serial_console_state_timeout = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.service_name            = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.service_type            = baremetal {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.split_loggers           = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.status_code_retries     = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.status_code_retry_delay = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.timeout                 = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ironic.version                 = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] key_manager.fixed_key          = **** {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican.barbican_api_version  = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican.barbican_endpoint     = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican.barbican_endpoint_type = public {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican.barbican_region_name  = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican.cafile                = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican.certfile              = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican.collect_timing        = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican.insecure              = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican.keyfile               = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican.number_of_retries     = 60 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican.retry_delay           = 1 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican.send_service_user_token = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican.split_loggers         = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican.timeout               = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican.verify_ssl            = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican.verify_ssl_path       = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican_service_user.auth_section = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican_service_user.auth_type = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican_service_user.cafile   = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican_service_user.certfile = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican_service_user.collect_timing = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican_service_user.insecure = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican_service_user.keyfile  = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican_service_user.split_loggers = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] barbican_service_user.timeout  = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vault.approle_role_id          = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vault.approle_secret_id        = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vault.cafile                   = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vault.certfile                 = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vault.collect_timing           = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vault.insecure                 = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vault.keyfile                  = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vault.kv_mountpoint            = secret {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vault.kv_version               = 2 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vault.namespace                = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vault.root_token_id            = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vault.split_loggers            = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vault.ssl_ca_crt_file          = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vault.timeout                  = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vault.use_ssl                  = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] keystone.cafile                = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] keystone.certfile              = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] keystone.collect_timing        = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] keystone.connect_retries       = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] keystone.connect_retry_delay   = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] keystone.endpoint_override     = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] keystone.insecure              = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] keystone.keyfile               = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] keystone.max_version           = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] keystone.min_version           = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] keystone.region_name           = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] keystone.service_name          = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] keystone.service_type          = identity {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] keystone.split_loggers         = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] keystone.status_code_retries   = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] keystone.status_code_retry_delay = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] keystone.timeout               = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] keystone.version               = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.connection_uri         =  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.cpu_mode               = custom {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: WARNING oslo_config.cfg [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.cpu_power_governor_high = performance {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.cpu_power_governor_low = powersave {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.cpu_power_management   = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.device_detach_attempts = 8 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.device_detach_timeout  = 20 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.disk_cachemodes        = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.disk_prefix            = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.enabled_perf_events    = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.file_backed_memory     = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.gid_maps               = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.hw_disk_discard        = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.hw_machine_type        = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.images_rbd_glance_store_name =  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.images_rbd_pool        = rbd {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.images_type            = default {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.images_volume_group    = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.inject_key             = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.inject_partition       = -2 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.inject_password        = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.iscsi_iface            = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.iser_use_multipath     = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.live_migration_bandwidth = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.live_migration_downtime = 500 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.live_migration_inbound_addr = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.live_migration_permit_post_copy = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.live_migration_scheme  = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.live_migration_timeout_action = abort {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.live_migration_tunnelled = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: WARNING oslo_config.cfg [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 01 18:17:22 user nova-compute[72150]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 01 18:17:22 user nova-compute[72150]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 01 18:17:22 user nova-compute[72150]: and ``live_migration_inbound_addr`` respectively.
Aug 01 18:17:22 user nova-compute[72150]: ).  Its value may be silently ignored in the future.
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.live_migration_with_native_tls = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.max_queues             = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.nfs_mount_options      = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.num_memory_encrypted_guests = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.num_pcie_ports         = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.pmem_namespaces        = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.quobyte_client_cfg     = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.rbd_secret_uuid        = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.rbd_user               = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.remote_filesystem_transport = ssh {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.rescue_image_id        = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.rescue_kernel_id       = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.rescue_ramdisk_id      = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.rx_queue_size          = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.smbfs_mount_options    =  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.snapshot_compression   = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.snapshot_image_format  = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.sparse_logical_volumes = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.swtpm_enabled          = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.swtpm_group            = tss {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.swtpm_user             = tss {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.sysinfo_serial         = unique {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.tb_cache_size          = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.tx_queue_size          = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.uid_maps               = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.use_virtio_for_bridges = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.virt_type              = kvm {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.volume_clear           = zero {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.volume_clear_size      = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.volume_use_multipath   = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.vzstorage_cache_path   = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.vzstorage_mount_user   = stack {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.auth_section           = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.auth_type              = password {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.cafile                 = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.certfile               = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.collect_timing         = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.connect_retries        = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.connect_retry_delay    = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.default_floating_pool  = public {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.endpoint_override      = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.extension_sync_interval = 600 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.http_retries           = 3 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.insecure               = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.keyfile                = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.max_version            = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.min_version            = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.ovs_bridge             = br-int {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.physnets               = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.region_name            = RegionOne {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.service_metadata_proxy = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.service_name           = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.service_type           = network {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.split_loggers          = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.status_code_retries    = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.status_code_retry_delay = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.timeout                = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] neutron.version                = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] notifications.bdms_in_notifications = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] notifications.default_level    = INFO {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] notifications.notification_format = unversioned {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] notifications.notify_on_state_change = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] pci.alias                      = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] pci.device_spec                = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] pci.report_in_placement        = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.auth_section         = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.auth_type            = password {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.cafile               = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.certfile             = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.collect_timing       = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.connect_retries      = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.connect_retry_delay  = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.default_domain_id    = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.default_domain_name  = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.domain_id            = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.domain_name          = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.endpoint_override    = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.insecure             = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.keyfile              = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.max_version          = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.min_version          = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.password             = **** {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.project_domain_id    = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.project_domain_name  = Default {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.project_id           = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.project_name         = service {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.region_name          = RegionOne {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.service_name         = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.service_type         = placement {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.split_loggers        = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.status_code_retries  = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.status_code_retry_delay = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.system_scope         = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.timeout              = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.trust_id             = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.user_domain_id       = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.user_domain_name     = Default {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.user_id              = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.username             = placement {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] placement.version              = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] quota.cores                    = 20 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] quota.count_usage_from_placement = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] quota.injected_file_content_bytes = 10240 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] quota.injected_file_path_length = 255 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] quota.injected_files           = 5 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] quota.instances                = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] quota.key_pairs                = 100 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] quota.metadata_items           = 128 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] quota.ram                      = 51200 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] quota.recheck_quota            = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] quota.server_group_members     = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] quota.server_groups            = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] rdp.enabled                    = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] scheduler.image_metadata_prefilter = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] scheduler.max_attempts         = 3 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] scheduler.max_placement_results = 1000 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] scheduler.query_placement_for_availability_zone = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] scheduler.query_placement_for_image_type_support = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] scheduler.workers              = 3 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.host_subset_size = 1 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.isolated_hosts = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.isolated_images = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.pci_in_placement = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.track_instance_changes = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] metrics.required               = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] metrics.weight_multiplier      = 1.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] metrics.weight_setting         = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] serial_console.enabled         = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] serial_console.port_range      = 10000:20000 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] serial_console.serialproxy_port = 6083 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] service_user.auth_section      = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] service_user.auth_type         = password {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] service_user.cafile            = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] service_user.certfile          = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] service_user.collect_timing    = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] service_user.insecure          = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] service_user.keyfile           = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] service_user.send_service_user_token = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] service_user.split_loggers     = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] service_user.timeout           = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] spice.agent_enabled            = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] spice.enabled                  = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] spice.html5proxy_port          = 6082 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] spice.image_compression        = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] spice.jpeg_compression         = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] spice.playback_compression     = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] spice.server_listen            = 127.0.0.1 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] spice.streaming_mode           = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] spice.zlib_compression         = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] upgrade_levels.baseapi         = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] upgrade_levels.cert            = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] upgrade_levels.compute         = auto {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] upgrade_levels.conductor       = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] upgrade_levels.scheduler       = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vendordata_dynamic_auth.auth_section = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vendordata_dynamic_auth.auth_type = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vendordata_dynamic_auth.cafile = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vendordata_dynamic_auth.certfile = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vendordata_dynamic_auth.insecure = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vendordata_dynamic_auth.keyfile = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vendordata_dynamic_auth.timeout = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.api_retry_count         = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.ca_file                 = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.cache_prefix            = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.cluster_name            = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.connection_pool_size    = 10 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.console_delay_seconds   = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.datastore_regex         = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.host_ip                 = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.host_password           = **** {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.host_port               = 443 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.host_username           = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.insecure                = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.integration_bridge      = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.maximum_objects         = 100 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.pbm_default_policy      = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.pbm_enabled             = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.pbm_wsdl_location       = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.serial_port_proxy_uri   = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.serial_port_service_uri = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.task_poll_interval      = 0.5 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.use_linked_clone        = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.vnc_keymap              = en-us {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.vnc_port                = 5900 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vmware.vnc_port_total          = 10000 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vnc.auth_schemes               = ['none'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vnc.enabled                    = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vnc.novncproxy_port            = 6080 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vnc.server_listen              = 0.0.0.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vnc.vencrypt_ca_certs          = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vnc.vencrypt_client_cert       = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vnc.vencrypt_client_key        = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] workarounds.disable_rootwrap   = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] workarounds.enable_numa_live_migration = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] workarounds.libvirt_disable_apic = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] wsgi.client_socket_timeout     = 900 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] wsgi.default_pool_size         = 1000 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] wsgi.keep_alive                = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] wsgi.max_header_line           = 16384 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] wsgi.ssl_ca_file               = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] wsgi.ssl_cert_file             = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] wsgi.ssl_key_file              = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] wsgi.tcp_keepidle              = 600 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] zvm.ca_file                    = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] zvm.cloud_connector_url        = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] zvm.reachable_timeout          = 300 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_policy.enforce_new_defaults = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_policy.enforce_scope      = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_policy.policy_default_rule = default {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_policy.policy_file        = policy.yaml {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] profiler.connection_string     = messaging:// {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] profiler.enabled               = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] profiler.es_doc_type           = notification {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] profiler.es_scroll_size        = 10000 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] profiler.es_scroll_time        = 2m {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] profiler.filter_error_trace    = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] profiler.hmac_keys             = **** {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] profiler.sentinel_service_name = mymaster {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] profiler.socket_timeout        = 0.1 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] profiler.trace_requests        = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] profiler.trace_sqlalchemy      = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] profiler_jaeger.process_tags   = {} {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] profiler_jaeger.service_name_prefix = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] profiler_otlp.service_name_prefix = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] remote_debug.host              = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] remote_debug.port              = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.ssl      = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_notifications.retry = -1 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_messaging_notifications.transport_url = **** {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_limit.auth_section        = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_limit.auth_type           = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_limit.cafile              = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_limit.certfile            = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_limit.collect_timing      = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_limit.connect_retries     = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_limit.connect_retry_delay = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_limit.endpoint_id         = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_limit.endpoint_override   = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_limit.insecure            = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_limit.keyfile             = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_limit.max_version         = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_limit.min_version         = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_limit.region_name         = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_limit.service_name        = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_limit.service_type        = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_limit.split_loggers       = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_limit.status_code_retries = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_limit.status_code_retry_delay = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_limit.timeout             = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_limit.valid_interfaces    = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_limit.version             = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_reports.file_event_handler = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] oslo_reports.log_dir           = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vif_plug_ovs_privileged.group  = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] vif_plug_ovs_privileged.user   = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] os_vif_linux_bridge.flat_interface = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] os_vif_ovs.isolate_vif         = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] os_vif_ovs.per_port_bridge     = False {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] os_brick.lock_path             = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] privsep_osbrick.capabilities   = [21] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] privsep_osbrick.group          = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] privsep_osbrick.helper_command = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] privsep_osbrick.user           = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] nova_sys_admin.group           = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] nova_sys_admin.helper_command  = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] nova_sys_admin.user            = None {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG oslo_service.service [None req-ca1cd5b8-290c-4061-a540-7b3ccf58dc6d None None] ******************************************************************************** {{(pid=72150) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Aug 01 18:17:22 user nova-compute[72150]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 01 18:17:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Starting native event thread {{(pid=72150) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Starting green dispatch thread {{(pid=72150) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Starting connection event dispatch thread {{(pid=72150) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Connecting to libvirt: qemu:///system {{(pid=72150) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f47181d8940> {{(pid=72150) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 01 18:17:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f47181d8940> {{(pid=72150) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 01 18:17:22 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Connection event '1' reason 'None'
Aug 01 18:17:22 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 01 18:17:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.mount [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Initialising _HostMountState generation 0 {{(pid=72150) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 01 18:17:29 user nova-compute[72150]: INFO nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Libvirt host capabilities <capabilities>
Aug 01 18:17:29 user nova-compute[72150]:   <host>
Aug 01 18:17:29 user nova-compute[72150]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 01 18:17:29 user nova-compute[72150]:     <cpu>
Aug 01 18:17:29 user nova-compute[72150]:       <arch>x86_64</arch>
Aug 01 18:17:29 user nova-compute[72150]:       <model>IvyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <vendor>Intel</vendor>
Aug 01 18:17:29 user nova-compute[72150]:       <microcode version='1070'/>
Aug 01 18:17:29 user nova-compute[72150]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 01 18:17:29 user nova-compute[72150]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature name='ss'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature name='vmx'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature name='pcid'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature name='osxsave'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature name='hypervisor'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature name='arat'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature name='tsc_adjust'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature name='md-clear'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature name='stibp'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature name='arch-capabilities'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature name='ssbd'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature name='invtsc'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature name='rsba'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature name='skip-l1dfl-vmentry'/>
Aug 01 18:17:29 user nova-compute[72150]:       <pages unit='KiB' size='4'/>
Aug 01 18:17:29 user nova-compute[72150]:       <pages unit='KiB' size='2048'/>
Aug 01 18:17:29 user nova-compute[72150]:     </cpu>
Aug 01 18:17:29 user nova-compute[72150]:     <power_management>
Aug 01 18:17:29 user nova-compute[72150]:       <suspend_mem/>
Aug 01 18:17:29 user nova-compute[72150]:       <suspend_disk/>
Aug 01 18:17:29 user nova-compute[72150]:       <suspend_hybrid/>
Aug 01 18:17:29 user nova-compute[72150]:     </power_management>
Aug 01 18:17:29 user nova-compute[72150]:     <iommu support='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     <migration_features>
Aug 01 18:17:29 user nova-compute[72150]:       <live/>
Aug 01 18:17:29 user nova-compute[72150]:       <uri_transports>
Aug 01 18:17:29 user nova-compute[72150]:         <uri_transport>tcp</uri_transport>
Aug 01 18:17:29 user nova-compute[72150]:         <uri_transport>rdma</uri_transport>
Aug 01 18:17:29 user nova-compute[72150]:       </uri_transports>
Aug 01 18:17:29 user nova-compute[72150]:     </migration_features>
Aug 01 18:17:29 user nova-compute[72150]:     <topology>
Aug 01 18:17:29 user nova-compute[72150]:       <cells num='2'>
Aug 01 18:17:29 user nova-compute[72150]:         <cell id='0'>
Aug 01 18:17:29 user nova-compute[72150]:           <memory unit='KiB'>8189224</memory>
Aug 01 18:17:29 user nova-compute[72150]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 01 18:17:29 user nova-compute[72150]:           <pages unit='KiB' size='2048'>0</pages>
Aug 01 18:17:29 user nova-compute[72150]:           <distances>
Aug 01 18:17:29 user nova-compute[72150]:             <sibling id='0' value='10'/>
Aug 01 18:17:29 user nova-compute[72150]:             <sibling id='1' value='20'/>
Aug 01 18:17:29 user nova-compute[72150]:           </distances>
Aug 01 18:17:29 user nova-compute[72150]:           <cpus num='6'>
Aug 01 18:17:29 user nova-compute[72150]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 01 18:17:29 user nova-compute[72150]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 01 18:17:29 user nova-compute[72150]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 01 18:17:29 user nova-compute[72150]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 01 18:17:29 user nova-compute[72150]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 01 18:17:29 user nova-compute[72150]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 01 18:17:29 user nova-compute[72150]:           </cpus>
Aug 01 18:17:29 user nova-compute[72150]:         </cell>
Aug 01 18:17:29 user nova-compute[72150]:         <cell id='1'>
Aug 01 18:17:29 user nova-compute[72150]:           <memory unit='KiB'>8206460</memory>
Aug 01 18:17:29 user nova-compute[72150]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 01 18:17:29 user nova-compute[72150]:           <pages unit='KiB' size='2048'>0</pages>
Aug 01 18:17:29 user nova-compute[72150]:           <distances>
Aug 01 18:17:29 user nova-compute[72150]:             <sibling id='0' value='20'/>
Aug 01 18:17:29 user nova-compute[72150]:             <sibling id='1' value='10'/>
Aug 01 18:17:29 user nova-compute[72150]:           </distances>
Aug 01 18:17:29 user nova-compute[72150]:           <cpus num='6'>
Aug 01 18:17:29 user nova-compute[72150]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 01 18:17:29 user nova-compute[72150]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 01 18:17:29 user nova-compute[72150]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 01 18:17:29 user nova-compute[72150]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 01 18:17:29 user nova-compute[72150]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 01 18:17:29 user nova-compute[72150]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 01 18:17:29 user nova-compute[72150]:           </cpus>
Aug 01 18:17:29 user nova-compute[72150]:         </cell>
Aug 01 18:17:29 user nova-compute[72150]:       </cells>
Aug 01 18:17:29 user nova-compute[72150]:     </topology>
Aug 01 18:17:29 user nova-compute[72150]:     <cache>
Aug 01 18:17:29 user nova-compute[72150]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 01 18:17:29 user nova-compute[72150]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 01 18:17:29 user nova-compute[72150]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 01 18:17:29 user nova-compute[72150]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 01 18:17:29 user nova-compute[72150]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 01 18:17:29 user nova-compute[72150]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 01 18:17:29 user nova-compute[72150]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 01 18:17:29 user nova-compute[72150]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 01 18:17:29 user nova-compute[72150]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 01 18:17:29 user nova-compute[72150]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 01 18:17:29 user nova-compute[72150]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 01 18:17:29 user nova-compute[72150]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 01 18:17:29 user nova-compute[72150]:     </cache>
Aug 01 18:17:29 user nova-compute[72150]:     <secmodel>
Aug 01 18:17:29 user nova-compute[72150]:       <model>apparmor</model>
Aug 01 18:17:29 user nova-compute[72150]:       <doi>0</doi>
Aug 01 18:17:29 user nova-compute[72150]:     </secmodel>
Aug 01 18:17:29 user nova-compute[72150]:     <secmodel>
Aug 01 18:17:29 user nova-compute[72150]:       <model>dac</model>
Aug 01 18:17:29 user nova-compute[72150]:       <doi>0</doi>
Aug 01 18:17:29 user nova-compute[72150]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 01 18:17:29 user nova-compute[72150]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 01 18:17:29 user nova-compute[72150]:     </secmodel>
Aug 01 18:17:29 user nova-compute[72150]:   </host>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='alpha'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>64</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>clipper</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='armv6l'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>32</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>spitz</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>nuri</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>kzm</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>sx1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>z2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>tosa</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>n810</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>n800</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>terrier</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>midway</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>microbit</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>verdex</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>highbank</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>akita</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>connex</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>collie</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='armv7l'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>32</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>spitz</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>nuri</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>kzm</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>sx1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>z2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>tosa</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>n810</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>n800</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>terrier</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>midway</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>microbit</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>verdex</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>highbank</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>akita</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>connex</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>collie</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='aarch64'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>64</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>spitz</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>nuri</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>kzm</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>sx1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>z2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>tosa</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>n810</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>n800</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>terrier</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>midway</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>microbit</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>verdex</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>raspi3b</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>highbank</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>akita</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>connex</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>collie</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <acpi default='on' toggle='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='cris'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>32</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='i686'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>32</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>x-remote</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>isapc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>microvm</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='kvm'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <pae/>
Aug 01 18:17:29 user nova-compute[72150]:       <nonpae/>
Aug 01 18:17:29 user nova-compute[72150]:       <acpi default='on' toggle='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:       <apic default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='m68k'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>32</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>an5206</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>q800</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>next-cube</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='microblaze'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>32</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='microblazeel'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>32</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='mips'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>32</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='16'>malta</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='mipsel'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>32</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='16'>malta</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='mips64'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>64</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='16'>malta</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>pica61</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>magnum</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='mips64el'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>64</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='16'>malta</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>pica61</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>magnum</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='16'>boston</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='ppc'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>32</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mac99</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>40p</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>taihu</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='ppc64'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>64</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2048'>powernv9</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>taihu</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2048'>powernv10</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>40p</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mac99</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2048'>powernv8</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='ppc64le'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>64</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2048'>powernv9</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>taihu</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2048'>powernv10</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>40p</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>mac99</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2048'>powernv8</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='riscv32'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>32</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='8'>spike</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>opentitan</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='5'>sifive_u</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>sifive_e</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='8'>virt</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='riscv64'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>64</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='8'>spike</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='5'>sifive_u</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>shakti_c</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>sifive_e</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='8'>virt</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='s390x'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>64</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='sh4'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>32</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>shix</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>r2d</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='sh4eb'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>64</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>shix</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>r2d</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='sparc'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>32</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>SS-5</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>SS-20</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>LX</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>SS-4</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>SS-10</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>Voyager</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='sparc64'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>64</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>sun4u</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>niagara</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>sun4v</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='x86_64'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>64</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>x-remote</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='1'>isapc</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>microvm</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='kvm'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <acpi default='on' toggle='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:       <apic default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='xtensa'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>32</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>sim</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='32'>kc705</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='32'>ml605</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='32'>virt</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='32'>lx200</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='32'>lx60</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]:   <guest>
Aug 01 18:17:29 user nova-compute[72150]:     <os_type>hvm</os_type>
Aug 01 18:17:29 user nova-compute[72150]:     <arch name='xtensaeb'>
Aug 01 18:17:29 user nova-compute[72150]:       <wordsize>32</wordsize>
Aug 01 18:17:29 user nova-compute[72150]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='4'>sim</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='32'>kc705</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='32'>ml605</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='32'>virt</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='32'>lx200</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='32'>lx60</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 01 18:17:29 user nova-compute[72150]:       <domain type='qemu'/>
Aug 01 18:17:29 user nova-compute[72150]:     </arch>
Aug 01 18:17:29 user nova-compute[72150]:     <features>
Aug 01 18:17:29 user nova-compute[72150]:       <cpuselection/>
Aug 01 18:17:29 user nova-compute[72150]:       <deviceboot/>
Aug 01 18:17:29 user nova-compute[72150]:       <disksnapshot default='on' toggle='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     </features>
Aug 01 18:17:29 user nova-compute[72150]:   </guest>
Aug 01 18:17:29 user nova-compute[72150]: </capabilities>
Aug 01 18:17:29 user nova-compute[72150]: 
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 01 18:17:29 user nova-compute[72150]: <domainCapabilities>
Aug 01 18:17:29 user nova-compute[72150]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 18:17:29 user nova-compute[72150]:   <domain>kvm</domain>
Aug 01 18:17:29 user nova-compute[72150]:   <machine>pc-q35-jammy</machine>
Aug 01 18:17:29 user nova-compute[72150]:   <arch>i686</arch>
Aug 01 18:17:29 user nova-compute[72150]:   <vcpu max='288'/>
Aug 01 18:17:29 user nova-compute[72150]:   <iothreads supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:   <os supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:     <enum name='firmware'/>
Aug 01 18:17:29 user nova-compute[72150]:     <loader supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='type'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>rom</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>pflash</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='readonly'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>yes</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>no</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='secure'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>no</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </loader>
Aug 01 18:17:29 user nova-compute[72150]:   </os>
Aug 01 18:17:29 user nova-compute[72150]:   <cpu>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='host-passthrough' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='hostPassthroughMigratable'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>off</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='maximum' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='maximumMigratable'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>on</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>off</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='host-model' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <vendor>Intel</vendor>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ss'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='vmx'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='pcid'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='hypervisor'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='arat'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='umip'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='md-clear'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='stibp'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ssbd'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ibpb'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ibrs'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='amd-stibp'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='disable' name='erms'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='disable' name='lm'/>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='custom' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>qemu64</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>qemu32</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>phenom</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium3</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium2</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>n270</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>kvm64</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>kvm32</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>coreduo</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>core2duo</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>athlon</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Westmere</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Snowridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>SandyBridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Penryn</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G5</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G4</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G3</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G2</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G1</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Nehalem</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>IvyBridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Icelake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-Rome</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-Milan</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Dhyana</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cooperlake</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Conroe</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>486</model>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:   </cpu>
Aug 01 18:17:29 user nova-compute[72150]:   <memoryBacking supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:     <enum name='sourceType'>
Aug 01 18:17:29 user nova-compute[72150]:       <value>file</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>anonymous</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>memfd</value>
Aug 01 18:17:29 user nova-compute[72150]:     </enum>
Aug 01 18:17:29 user nova-compute[72150]:   </memoryBacking>
Aug 01 18:17:29 user nova-compute[72150]:   <devices>
Aug 01 18:17:29 user nova-compute[72150]:     <disk supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='diskDevice'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>disk</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>cdrom</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>floppy</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>lun</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='bus'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>fdc</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>scsi</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>usb</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>sata</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-non-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </disk>
Aug 01 18:17:29 user nova-compute[72150]:     <graphics supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='type'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>sdl</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vnc</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>spice</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>egl-headless</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </graphics>
Aug 01 18:17:29 user nova-compute[72150]:     <video supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='modelType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vga</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>cirrus</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vmvga</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>qxl</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>none</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>bochs</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>ramfb</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </video>
Aug 01 18:17:29 user nova-compute[72150]:     <hostdev supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='mode'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>subsystem</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='startupPolicy'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>default</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>mandatory</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>requisite</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>optional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='subsysType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>usb</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>pci</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>scsi</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='capsType'/>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='pciBackend'/>
Aug 01 18:17:29 user nova-compute[72150]:     </hostdev>
Aug 01 18:17:29 user nova-compute[72150]:     <rng supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-non-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='backendModel'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>random</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>egd</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>builtin</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </rng>
Aug 01 18:17:29 user nova-compute[72150]:     <filesystem supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='driverType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>path</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>handle</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtiofs</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </filesystem>
Aug 01 18:17:29 user nova-compute[72150]:     <tpm supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>tpm-tis</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>tpm-crb</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='backendModel'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>passthrough</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>emulator</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </tpm>
Aug 01 18:17:29 user nova-compute[72150]:   </devices>
Aug 01 18:17:29 user nova-compute[72150]:   <features>
Aug 01 18:17:29 user nova-compute[72150]:     <gic supported='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     <vmcoreinfo supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <genid supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <backingStoreInput supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <backup supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <sev supported='no'/>
Aug 01 18:17:29 user nova-compute[72150]:   </features>
Aug 01 18:17:29 user nova-compute[72150]: </domainCapabilities>
Aug 01 18:17:29 user nova-compute[72150]:  {{(pid=72150) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 01 18:17:29 user nova-compute[72150]: <domainCapabilities>
Aug 01 18:17:29 user nova-compute[72150]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 18:17:29 user nova-compute[72150]:   <domain>kvm</domain>
Aug 01 18:17:29 user nova-compute[72150]:   <machine>pc-i440fx-6.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:   <arch>i686</arch>
Aug 01 18:17:29 user nova-compute[72150]:   <vcpu max='255'/>
Aug 01 18:17:29 user nova-compute[72150]:   <iothreads supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:   <os supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:     <enum name='firmware'/>
Aug 01 18:17:29 user nova-compute[72150]:     <loader supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='type'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>rom</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>pflash</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='readonly'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>yes</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>no</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='secure'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>no</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </loader>
Aug 01 18:17:29 user nova-compute[72150]:   </os>
Aug 01 18:17:29 user nova-compute[72150]:   <cpu>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='host-passthrough' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='hostPassthroughMigratable'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>off</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='maximum' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='maximumMigratable'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>on</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>off</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='host-model' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <vendor>Intel</vendor>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ss'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='vmx'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='pcid'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='hypervisor'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='arat'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='umip'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='md-clear'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='stibp'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ssbd'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ibpb'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ibrs'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='amd-stibp'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='disable' name='erms'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='disable' name='lm'/>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='custom' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>qemu64</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>qemu32</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>phenom</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium3</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium2</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>n270</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>kvm64</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>kvm32</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>coreduo</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>core2duo</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>athlon</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Westmere</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Snowridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>SandyBridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Penryn</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G5</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G4</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G3</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G2</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G1</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Nehalem</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>IvyBridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Icelake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-Rome</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-Milan</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Dhyana</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cooperlake</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Conroe</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>486</model>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:   </cpu>
Aug 01 18:17:29 user nova-compute[72150]:   <memoryBacking supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:     <enum name='sourceType'>
Aug 01 18:17:29 user nova-compute[72150]:       <value>file</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>anonymous</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>memfd</value>
Aug 01 18:17:29 user nova-compute[72150]:     </enum>
Aug 01 18:17:29 user nova-compute[72150]:   </memoryBacking>
Aug 01 18:17:29 user nova-compute[72150]:   <devices>
Aug 01 18:17:29 user nova-compute[72150]:     <disk supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='diskDevice'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>disk</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>cdrom</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>floppy</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>lun</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='bus'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>ide</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>fdc</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>scsi</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>usb</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>sata</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-non-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </disk>
Aug 01 18:17:29 user nova-compute[72150]:     <graphics supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='type'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>sdl</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vnc</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>spice</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>egl-headless</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </graphics>
Aug 01 18:17:29 user nova-compute[72150]:     <video supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='modelType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vga</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>cirrus</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vmvga</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>qxl</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>none</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>bochs</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>ramfb</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </video>
Aug 01 18:17:29 user nova-compute[72150]:     <hostdev supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='mode'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>subsystem</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='startupPolicy'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>default</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>mandatory</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>requisite</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>optional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='subsysType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>usb</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>pci</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>scsi</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='capsType'/>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='pciBackend'/>
Aug 01 18:17:29 user nova-compute[72150]:     </hostdev>
Aug 01 18:17:29 user nova-compute[72150]:     <rng supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-non-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='backendModel'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>random</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>egd</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>builtin</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </rng>
Aug 01 18:17:29 user nova-compute[72150]:     <filesystem supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='driverType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>path</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>handle</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtiofs</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </filesystem>
Aug 01 18:17:29 user nova-compute[72150]:     <tpm supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>tpm-tis</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>tpm-crb</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='backendModel'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>passthrough</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>emulator</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </tpm>
Aug 01 18:17:29 user nova-compute[72150]:   </devices>
Aug 01 18:17:29 user nova-compute[72150]:   <features>
Aug 01 18:17:29 user nova-compute[72150]:     <gic supported='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     <vmcoreinfo supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <genid supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <backingStoreInput supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <backup supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <sev supported='no'/>
Aug 01 18:17:29 user nova-compute[72150]:   </features>
Aug 01 18:17:29 user nova-compute[72150]: </domainCapabilities>
Aug 01 18:17:29 user nova-compute[72150]:  {{(pid=72150) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 01 18:17:29 user nova-compute[72150]: <domainCapabilities>
Aug 01 18:17:29 user nova-compute[72150]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 18:17:29 user nova-compute[72150]:   <domain>kvm</domain>
Aug 01 18:17:29 user nova-compute[72150]:   <machine>pc-q35-6.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:   <arch>i686</arch>
Aug 01 18:17:29 user nova-compute[72150]:   <vcpu max='288'/>
Aug 01 18:17:29 user nova-compute[72150]:   <iothreads supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:   <os supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:     <enum name='firmware'/>
Aug 01 18:17:29 user nova-compute[72150]:     <loader supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='type'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>rom</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>pflash</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='readonly'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>yes</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>no</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='secure'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>no</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </loader>
Aug 01 18:17:29 user nova-compute[72150]:   </os>
Aug 01 18:17:29 user nova-compute[72150]:   <cpu>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='host-passthrough' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='hostPassthroughMigratable'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>off</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='maximum' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='maximumMigratable'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>on</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>off</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='host-model' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <vendor>Intel</vendor>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ss'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='vmx'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='pcid'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='hypervisor'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='arat'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='umip'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='md-clear'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='stibp'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ssbd'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ibpb'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ibrs'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='amd-stibp'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='disable' name='erms'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='disable' name='lm'/>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='custom' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>qemu64</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>qemu32</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>phenom</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium3</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium2</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>n270</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>kvm64</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>kvm32</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>coreduo</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>core2duo</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>athlon</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Westmere</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Snowridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>SandyBridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Penryn</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G5</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G4</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G3</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G2</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G1</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Nehalem</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>IvyBridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Icelake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-Rome</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-Milan</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Dhyana</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cooperlake</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Conroe</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>486</model>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:   </cpu>
Aug 01 18:17:29 user nova-compute[72150]:   <memoryBacking supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:     <enum name='sourceType'>
Aug 01 18:17:29 user nova-compute[72150]:       <value>file</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>anonymous</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>memfd</value>
Aug 01 18:17:29 user nova-compute[72150]:     </enum>
Aug 01 18:17:29 user nova-compute[72150]:   </memoryBacking>
Aug 01 18:17:29 user nova-compute[72150]:   <devices>
Aug 01 18:17:29 user nova-compute[72150]:     <disk supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='diskDevice'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>disk</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>cdrom</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>floppy</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>lun</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='bus'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>fdc</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>scsi</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>usb</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>sata</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-non-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </disk>
Aug 01 18:17:29 user nova-compute[72150]:     <graphics supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='type'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>sdl</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vnc</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>spice</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>egl-headless</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </graphics>
Aug 01 18:17:29 user nova-compute[72150]:     <video supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='modelType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vga</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>cirrus</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vmvga</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>qxl</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>none</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>bochs</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>ramfb</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </video>
Aug 01 18:17:29 user nova-compute[72150]:     <hostdev supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='mode'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>subsystem</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='startupPolicy'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>default</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>mandatory</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>requisite</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>optional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='subsysType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>usb</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>pci</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>scsi</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='capsType'/>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='pciBackend'/>
Aug 01 18:17:29 user nova-compute[72150]:     </hostdev>
Aug 01 18:17:29 user nova-compute[72150]:     <rng supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-non-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='backendModel'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>random</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>egd</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>builtin</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </rng>
Aug 01 18:17:29 user nova-compute[72150]:     <filesystem supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='driverType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>path</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>handle</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtiofs</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </filesystem>
Aug 01 18:17:29 user nova-compute[72150]:     <tpm supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>tpm-tis</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>tpm-crb</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='backendModel'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>passthrough</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>emulator</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </tpm>
Aug 01 18:17:29 user nova-compute[72150]:   </devices>
Aug 01 18:17:29 user nova-compute[72150]:   <features>
Aug 01 18:17:29 user nova-compute[72150]:     <gic supported='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     <vmcoreinfo supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <genid supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <backingStoreInput supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <backup supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <sev supported='no'/>
Aug 01 18:17:29 user nova-compute[72150]:   </features>
Aug 01 18:17:29 user nova-compute[72150]: </domainCapabilities>
Aug 01 18:17:29 user nova-compute[72150]:  {{(pid=72150) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 01 18:17:29 user nova-compute[72150]: <domainCapabilities>
Aug 01 18:17:29 user nova-compute[72150]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 18:17:29 user nova-compute[72150]:   <domain>kvm</domain>
Aug 01 18:17:29 user nova-compute[72150]:   <machine>pc-i440fx-jammy</machine>
Aug 01 18:17:29 user nova-compute[72150]:   <arch>i686</arch>
Aug 01 18:17:29 user nova-compute[72150]:   <vcpu max='255'/>
Aug 01 18:17:29 user nova-compute[72150]:   <iothreads supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:   <os supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:     <enum name='firmware'/>
Aug 01 18:17:29 user nova-compute[72150]:     <loader supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='type'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>rom</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>pflash</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='readonly'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>yes</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>no</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='secure'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>no</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </loader>
Aug 01 18:17:29 user nova-compute[72150]:   </os>
Aug 01 18:17:29 user nova-compute[72150]:   <cpu>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='host-passthrough' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='hostPassthroughMigratable'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>off</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='maximum' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='maximumMigratable'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>on</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>off</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='host-model' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <vendor>Intel</vendor>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ss'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='vmx'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='pcid'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='hypervisor'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='arat'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='umip'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='md-clear'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='stibp'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ssbd'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ibpb'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ibrs'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='amd-stibp'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='disable' name='erms'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='disable' name='lm'/>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='custom' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>qemu64</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>qemu32</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>phenom</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium3</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium2</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>n270</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>kvm64</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>kvm32</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>coreduo</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>core2duo</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>athlon</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Westmere</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Snowridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>SandyBridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Penryn</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G5</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G4</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G3</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G2</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G1</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Nehalem</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>IvyBridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Icelake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-Rome</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-Milan</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Dhyana</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cooperlake</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Conroe</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>486</model>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:   </cpu>
Aug 01 18:17:29 user nova-compute[72150]:   <memoryBacking supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:     <enum name='sourceType'>
Aug 01 18:17:29 user nova-compute[72150]:       <value>file</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>anonymous</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>memfd</value>
Aug 01 18:17:29 user nova-compute[72150]:     </enum>
Aug 01 18:17:29 user nova-compute[72150]:   </memoryBacking>
Aug 01 18:17:29 user nova-compute[72150]:   <devices>
Aug 01 18:17:29 user nova-compute[72150]:     <disk supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='diskDevice'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>disk</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>cdrom</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>floppy</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>lun</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='bus'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>ide</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>fdc</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>scsi</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>usb</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>sata</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-non-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </disk>
Aug 01 18:17:29 user nova-compute[72150]:     <graphics supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='type'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>sdl</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vnc</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>spice</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>egl-headless</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </graphics>
Aug 01 18:17:29 user nova-compute[72150]:     <video supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='modelType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vga</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>cirrus</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vmvga</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>qxl</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>none</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>bochs</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>ramfb</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </video>
Aug 01 18:17:29 user nova-compute[72150]:     <hostdev supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='mode'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>subsystem</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='startupPolicy'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>default</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>mandatory</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>requisite</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>optional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='subsysType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>usb</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>pci</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>scsi</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='capsType'/>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='pciBackend'/>
Aug 01 18:17:29 user nova-compute[72150]:     </hostdev>
Aug 01 18:17:29 user nova-compute[72150]:     <rng supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-non-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='backendModel'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>random</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>egd</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>builtin</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </rng>
Aug 01 18:17:29 user nova-compute[72150]:     <filesystem supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='driverType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>path</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>handle</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtiofs</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </filesystem>
Aug 01 18:17:29 user nova-compute[72150]:     <tpm supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>tpm-tis</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>tpm-crb</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='backendModel'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>passthrough</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>emulator</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </tpm>
Aug 01 18:17:29 user nova-compute[72150]:   </devices>
Aug 01 18:17:29 user nova-compute[72150]:   <features>
Aug 01 18:17:29 user nova-compute[72150]:     <gic supported='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     <vmcoreinfo supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <genid supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <backingStoreInput supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <backup supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <sev supported='no'/>
Aug 01 18:17:29 user nova-compute[72150]:   </features>
Aug 01 18:17:29 user nova-compute[72150]: </domainCapabilities>
Aug 01 18:17:29 user nova-compute[72150]:  {{(pid=72150) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 01 18:17:29 user nova-compute[72150]: <domainCapabilities>
Aug 01 18:17:29 user nova-compute[72150]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 18:17:29 user nova-compute[72150]:   <domain>kvm</domain>
Aug 01 18:17:29 user nova-compute[72150]:   <machine>pc-q35-jammy</machine>
Aug 01 18:17:29 user nova-compute[72150]:   <arch>x86_64</arch>
Aug 01 18:17:29 user nova-compute[72150]:   <vcpu max='288'/>
Aug 01 18:17:29 user nova-compute[72150]:   <iothreads supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:   <os supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:     <enum name='firmware'>
Aug 01 18:17:29 user nova-compute[72150]:       <value>efi</value>
Aug 01 18:17:29 user nova-compute[72150]:     </enum>
Aug 01 18:17:29 user nova-compute[72150]:     <loader supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='type'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>rom</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>pflash</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='readonly'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>yes</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>no</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='secure'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>yes</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>no</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </loader>
Aug 01 18:17:29 user nova-compute[72150]:   </os>
Aug 01 18:17:29 user nova-compute[72150]:   <cpu>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='host-passthrough' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='hostPassthroughMigratable'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>on</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>off</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='maximum' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='maximumMigratable'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>on</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>off</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='host-model' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <vendor>Intel</vendor>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ss'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='vmx'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='pcid'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='hypervisor'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='arat'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='umip'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='md-clear'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='stibp'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ssbd'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='invtsc'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ibpb'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ibrs'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='amd-stibp'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='rsba'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='disable' name='erms'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='custom' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>qemu64</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>qemu32</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>phenom</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium3</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium2</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>n270</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>kvm64</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>kvm32</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>coreduo</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>core2duo</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>athlon</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Westmere</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Snowridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>SandyBridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Penryn</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G5</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G4</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G3</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G2</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Opteron_G1</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Nehalem</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>IvyBridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Icelake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-Rome</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-Milan</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Dhyana</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cooperlake</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Conroe</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>486</model>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:   </cpu>
Aug 01 18:17:29 user nova-compute[72150]:   <memoryBacking supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:     <enum name='sourceType'>
Aug 01 18:17:29 user nova-compute[72150]:       <value>file</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>anonymous</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>memfd</value>
Aug 01 18:17:29 user nova-compute[72150]:     </enum>
Aug 01 18:17:29 user nova-compute[72150]:   </memoryBacking>
Aug 01 18:17:29 user nova-compute[72150]:   <devices>
Aug 01 18:17:29 user nova-compute[72150]:     <disk supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='diskDevice'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>disk</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>cdrom</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>floppy</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>lun</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='bus'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>fdc</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>scsi</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>usb</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>sata</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-non-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </disk>
Aug 01 18:17:29 user nova-compute[72150]:     <graphics supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='type'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>sdl</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vnc</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>spice</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>egl-headless</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </graphics>
Aug 01 18:17:29 user nova-compute[72150]:     <video supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='modelType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vga</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>cirrus</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vmvga</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>qxl</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>none</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>bochs</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>ramfb</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </video>
Aug 01 18:17:29 user nova-compute[72150]:     <hostdev supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='mode'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>subsystem</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='startupPolicy'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>default</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>mandatory</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>requisite</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>optional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='subsysType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>usb</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>pci</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>scsi</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='capsType'/>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='pciBackend'/>
Aug 01 18:17:29 user nova-compute[72150]:     </hostdev>
Aug 01 18:17:29 user nova-compute[72150]:     <rng supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-non-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='backendModel'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>random</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>egd</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>builtin</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </rng>
Aug 01 18:17:29 user nova-compute[72150]:     <filesystem supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='driverType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>path</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>handle</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtiofs</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </filesystem>
Aug 01 18:17:29 user nova-compute[72150]:     <tpm supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>tpm-tis</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>tpm-crb</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='backendModel'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>passthrough</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>emulator</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </tpm>
Aug 01 18:17:29 user nova-compute[72150]:   </devices>
Aug 01 18:17:29 user nova-compute[72150]:   <features>
Aug 01 18:17:29 user nova-compute[72150]:     <gic supported='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     <vmcoreinfo supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <genid supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <backingStoreInput supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <backup supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <sev supported='no'/>
Aug 01 18:17:29 user nova-compute[72150]:   </features>
Aug 01 18:17:29 user nova-compute[72150]: </domainCapabilities>
Aug 01 18:17:29 user nova-compute[72150]:  {{(pid=72150) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 01 18:17:29 user nova-compute[72150]: <domainCapabilities>
Aug 01 18:17:29 user nova-compute[72150]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 18:17:29 user nova-compute[72150]:   <domain>kvm</domain>
Aug 01 18:17:29 user nova-compute[72150]:   <machine>pc-i440fx-6.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:   <arch>x86_64</arch>
Aug 01 18:17:29 user nova-compute[72150]:   <vcpu max='255'/>
Aug 01 18:17:29 user nova-compute[72150]:   <iothreads supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:   <os supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:     <enum name='firmware'>
Aug 01 18:17:29 user nova-compute[72150]:       <value>efi</value>
Aug 01 18:17:29 user nova-compute[72150]:     </enum>
Aug 01 18:17:29 user nova-compute[72150]:     <loader supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='type'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>rom</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>pflash</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='readonly'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>yes</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>no</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='secure'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>no</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </loader>
Aug 01 18:17:29 user nova-compute[72150]:   </os>
Aug 01 18:17:29 user nova-compute[72150]:   <cpu>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='host-passthrough' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='hostPassthroughMigratable'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>on</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>off</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='maximum' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='maximumMigratable'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>on</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>off</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='host-model' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <vendor>Intel</vendor>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ss'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='vmx'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='pcid'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='hypervisor'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='arat'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='umip'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='md-clear'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='stibp'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ssbd'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='invtsc'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ibpb'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ibrs'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='amd-stibp'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='rsba'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='disable' name='erms'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='custom' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>qemu64</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>qemu32</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>phenom</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium3</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium2</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>n270</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>kvm64</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>kvm32</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>coreduo</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>core2duo</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>athlon</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Westmere</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Snowridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>SandyBridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Penryn</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G5</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G4</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G3</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G2</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Opteron_G1</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Nehalem</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>IvyBridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Icelake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-Rome</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-Milan</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Dhyana</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cooperlake</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Conroe</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>486</model>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:   </cpu>
Aug 01 18:17:29 user nova-compute[72150]:   <memoryBacking supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:     <enum name='sourceType'>
Aug 01 18:17:29 user nova-compute[72150]:       <value>file</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>anonymous</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>memfd</value>
Aug 01 18:17:29 user nova-compute[72150]:     </enum>
Aug 01 18:17:29 user nova-compute[72150]:   </memoryBacking>
Aug 01 18:17:29 user nova-compute[72150]:   <devices>
Aug 01 18:17:29 user nova-compute[72150]:     <disk supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='diskDevice'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>disk</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>cdrom</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>floppy</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>lun</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='bus'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>ide</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>fdc</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>scsi</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>usb</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>sata</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-non-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </disk>
Aug 01 18:17:29 user nova-compute[72150]:     <graphics supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='type'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>sdl</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vnc</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>spice</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>egl-headless</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </graphics>
Aug 01 18:17:29 user nova-compute[72150]:     <video supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='modelType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vga</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>cirrus</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vmvga</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>qxl</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>none</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>bochs</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>ramfb</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </video>
Aug 01 18:17:29 user nova-compute[72150]:     <hostdev supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='mode'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>subsystem</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='startupPolicy'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>default</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>mandatory</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>requisite</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>optional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='subsysType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>usb</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>pci</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>scsi</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='capsType'/>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='pciBackend'/>
Aug 01 18:17:29 user nova-compute[72150]:     </hostdev>
Aug 01 18:17:29 user nova-compute[72150]:     <rng supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-non-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='backendModel'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>random</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>egd</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>builtin</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </rng>
Aug 01 18:17:29 user nova-compute[72150]:     <filesystem supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='driverType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>path</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>handle</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtiofs</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </filesystem>
Aug 01 18:17:29 user nova-compute[72150]:     <tpm supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>tpm-tis</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>tpm-crb</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='backendModel'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>passthrough</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>emulator</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </tpm>
Aug 01 18:17:29 user nova-compute[72150]:   </devices>
Aug 01 18:17:29 user nova-compute[72150]:   <features>
Aug 01 18:17:29 user nova-compute[72150]:     <gic supported='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     <vmcoreinfo supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <genid supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <backingStoreInput supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <backup supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <sev supported='no'/>
Aug 01 18:17:29 user nova-compute[72150]:   </features>
Aug 01 18:17:29 user nova-compute[72150]: </domainCapabilities>
Aug 01 18:17:29 user nova-compute[72150]:  {{(pid=72150) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 01 18:17:29 user nova-compute[72150]: <domainCapabilities>
Aug 01 18:17:29 user nova-compute[72150]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 18:17:29 user nova-compute[72150]:   <domain>kvm</domain>
Aug 01 18:17:29 user nova-compute[72150]:   <machine>pc-q35-6.2</machine>
Aug 01 18:17:29 user nova-compute[72150]:   <arch>x86_64</arch>
Aug 01 18:17:29 user nova-compute[72150]:   <vcpu max='288'/>
Aug 01 18:17:29 user nova-compute[72150]:   <iothreads supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:   <os supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:     <enum name='firmware'>
Aug 01 18:17:29 user nova-compute[72150]:       <value>efi</value>
Aug 01 18:17:29 user nova-compute[72150]:     </enum>
Aug 01 18:17:29 user nova-compute[72150]:     <loader supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='type'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>rom</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>pflash</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='readonly'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>yes</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>no</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='secure'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>yes</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>no</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </loader>
Aug 01 18:17:29 user nova-compute[72150]:   </os>
Aug 01 18:17:29 user nova-compute[72150]:   <cpu>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='host-passthrough' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='hostPassthroughMigratable'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>on</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>off</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='maximum' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='maximumMigratable'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>on</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>off</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='host-model' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <vendor>Intel</vendor>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ss'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='vmx'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='pcid'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='hypervisor'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='arat'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='umip'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='md-clear'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='stibp'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ssbd'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='invtsc'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ibpb'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ibrs'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='amd-stibp'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='rsba'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='disable' name='erms'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='custom' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>qemu64</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>qemu32</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>phenom</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium3</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium2</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>n270</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>kvm64</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>kvm32</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>coreduo</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>core2duo</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>athlon</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Westmere</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Snowridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>SandyBridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Penryn</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G5</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G4</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G3</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G2</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Opteron_G1</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Nehalem</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>IvyBridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Icelake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-Rome</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-Milan</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Dhyana</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cooperlake</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Conroe</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>486</model>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:   </cpu>
Aug 01 18:17:29 user nova-compute[72150]:   <memoryBacking supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:     <enum name='sourceType'>
Aug 01 18:17:29 user nova-compute[72150]:       <value>file</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>anonymous</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>memfd</value>
Aug 01 18:17:29 user nova-compute[72150]:     </enum>
Aug 01 18:17:29 user nova-compute[72150]:   </memoryBacking>
Aug 01 18:17:29 user nova-compute[72150]:   <devices>
Aug 01 18:17:29 user nova-compute[72150]:     <disk supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='diskDevice'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>disk</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>cdrom</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>floppy</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>lun</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='bus'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>fdc</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>scsi</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>usb</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>sata</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-non-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </disk>
Aug 01 18:17:29 user nova-compute[72150]:     <graphics supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='type'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>sdl</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vnc</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>spice</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>egl-headless</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </graphics>
Aug 01 18:17:29 user nova-compute[72150]:     <video supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='modelType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vga</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>cirrus</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vmvga</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>qxl</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>none</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>bochs</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>ramfb</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </video>
Aug 01 18:17:29 user nova-compute[72150]:     <hostdev supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='mode'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>subsystem</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='startupPolicy'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>default</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>mandatory</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>requisite</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>optional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='subsysType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>usb</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>pci</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>scsi</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='capsType'/>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='pciBackend'/>
Aug 01 18:17:29 user nova-compute[72150]:     </hostdev>
Aug 01 18:17:29 user nova-compute[72150]:     <rng supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-non-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='backendModel'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>random</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>egd</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>builtin</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </rng>
Aug 01 18:17:29 user nova-compute[72150]:     <filesystem supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='driverType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>path</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>handle</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtiofs</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </filesystem>
Aug 01 18:17:29 user nova-compute[72150]:     <tpm supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>tpm-tis</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>tpm-crb</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='backendModel'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>passthrough</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>emulator</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </tpm>
Aug 01 18:17:29 user nova-compute[72150]:   </devices>
Aug 01 18:17:29 user nova-compute[72150]:   <features>
Aug 01 18:17:29 user nova-compute[72150]:     <gic supported='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     <vmcoreinfo supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <genid supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <backingStoreInput supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <backup supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <sev supported='no'/>
Aug 01 18:17:29 user nova-compute[72150]:   </features>
Aug 01 18:17:29 user nova-compute[72150]: </domainCapabilities>
Aug 01 18:17:29 user nova-compute[72150]:  {{(pid=72150) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 01 18:17:29 user nova-compute[72150]: <domainCapabilities>
Aug 01 18:17:29 user nova-compute[72150]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 18:17:29 user nova-compute[72150]:   <domain>kvm</domain>
Aug 01 18:17:29 user nova-compute[72150]:   <machine>pc-i440fx-jammy</machine>
Aug 01 18:17:29 user nova-compute[72150]:   <arch>x86_64</arch>
Aug 01 18:17:29 user nova-compute[72150]:   <vcpu max='255'/>
Aug 01 18:17:29 user nova-compute[72150]:   <iothreads supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:   <os supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:     <enum name='firmware'>
Aug 01 18:17:29 user nova-compute[72150]:       <value>efi</value>
Aug 01 18:17:29 user nova-compute[72150]:     </enum>
Aug 01 18:17:29 user nova-compute[72150]:     <loader supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='type'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>rom</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>pflash</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='readonly'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>yes</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>no</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='secure'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>no</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </loader>
Aug 01 18:17:29 user nova-compute[72150]:   </os>
Aug 01 18:17:29 user nova-compute[72150]:   <cpu>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='host-passthrough' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='hostPassthroughMigratable'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>on</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>off</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='maximum' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='maximumMigratable'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>on</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>off</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='host-model' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <vendor>Intel</vendor>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ss'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='vmx'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='pcid'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='hypervisor'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='arat'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='umip'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='md-clear'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='stibp'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ssbd'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='invtsc'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ibpb'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='ibrs'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='amd-stibp'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='rsba'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='disable' name='erms'/>
Aug 01 18:17:29 user nova-compute[72150]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:     <mode name='custom' supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>qemu64</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>qemu32</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>phenom</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium3</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium2</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>pentium</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>n270</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>kvm64</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>kvm32</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>coreduo</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>core2duo</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>athlon</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Westmere</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Snowridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Skylake-Client</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>SandyBridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Penryn</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G5</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G4</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G3</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Opteron_G2</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Opteron_G1</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Nehalem</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>IvyBridge</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Icelake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Haswell</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-Rome</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-Milan</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>EPYC</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Dhyana</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cooperlake</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>Conroe</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='no'>Broadwell</model>
Aug 01 18:17:29 user nova-compute[72150]:       <model usable='yes'>486</model>
Aug 01 18:17:29 user nova-compute[72150]:     </mode>
Aug 01 18:17:29 user nova-compute[72150]:   </cpu>
Aug 01 18:17:29 user nova-compute[72150]:   <memoryBacking supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:     <enum name='sourceType'>
Aug 01 18:17:29 user nova-compute[72150]:       <value>file</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>anonymous</value>
Aug 01 18:17:29 user nova-compute[72150]:       <value>memfd</value>
Aug 01 18:17:29 user nova-compute[72150]:     </enum>
Aug 01 18:17:29 user nova-compute[72150]:   </memoryBacking>
Aug 01 18:17:29 user nova-compute[72150]:   <devices>
Aug 01 18:17:29 user nova-compute[72150]:     <disk supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='diskDevice'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>disk</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>cdrom</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>floppy</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>lun</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='bus'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>ide</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>fdc</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>scsi</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>usb</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>sata</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-non-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </disk>
Aug 01 18:17:29 user nova-compute[72150]:     <graphics supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='type'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>sdl</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vnc</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>spice</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>egl-headless</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </graphics>
Aug 01 18:17:29 user nova-compute[72150]:     <video supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='modelType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vga</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>cirrus</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>vmvga</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>qxl</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>none</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>bochs</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>ramfb</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </video>
Aug 01 18:17:29 user nova-compute[72150]:     <hostdev supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='mode'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>subsystem</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='startupPolicy'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>default</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>mandatory</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>requisite</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>optional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='subsysType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>usb</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>pci</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>scsi</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='capsType'/>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='pciBackend'/>
Aug 01 18:17:29 user nova-compute[72150]:     </hostdev>
Aug 01 18:17:29 user nova-compute[72150]:     <rng supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtio-non-transitional</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='backendModel'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>random</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>egd</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>builtin</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </rng>
Aug 01 18:17:29 user nova-compute[72150]:     <filesystem supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='driverType'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>path</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>handle</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>virtiofs</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </filesystem>
Aug 01 18:17:29 user nova-compute[72150]:     <tpm supported='yes'>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='model'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>tpm-tis</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>tpm-crb</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:       <enum name='backendModel'>
Aug 01 18:17:29 user nova-compute[72150]:         <value>passthrough</value>
Aug 01 18:17:29 user nova-compute[72150]:         <value>emulator</value>
Aug 01 18:17:29 user nova-compute[72150]:       </enum>
Aug 01 18:17:29 user nova-compute[72150]:     </tpm>
Aug 01 18:17:29 user nova-compute[72150]:   </devices>
Aug 01 18:17:29 user nova-compute[72150]:   <features>
Aug 01 18:17:29 user nova-compute[72150]:     <gic supported='no'/>
Aug 01 18:17:29 user nova-compute[72150]:     <vmcoreinfo supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <genid supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <backingStoreInput supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <backup supported='yes'/>
Aug 01 18:17:29 user nova-compute[72150]:     <sev supported='no'/>
Aug 01 18:17:29 user nova-compute[72150]:   </features>
Aug 01 18:17:29 user nova-compute[72150]: </domainCapabilities>
Aug 01 18:17:29 user nova-compute[72150]:  {{(pid=72150) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72150) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72150) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Checking secure boot support for host arch (x86_64) {{(pid=72150) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 01 18:17:29 user nova-compute[72150]: INFO nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Secure Boot support detected
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] cpu compare xml: <cpu match="exact">
Aug 01 18:17:29 user nova-compute[72150]:   <model>Nehalem</model>
Aug 01 18:17:29 user nova-compute[72150]: </cpu>
Aug 01 18:17:29 user nova-compute[72150]:  {{(pid=72150) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 01 18:17:29 user nova-compute[72150]: INFO nova.virt.node [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Generated node identity f205788b-0048-4b9c-8d9d-b0437c5c3479
Aug 01 18:17:29 user nova-compute[72150]: INFO nova.virt.node [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Wrote node identity f205788b-0048-4b9c-8d9d-b0437c5c3479 to /opt/stack/data/nova/compute_id
Aug 01 18:17:29 user nova-compute[72150]: WARNING nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Compute nodes ['f205788b-0048-4b9c-8d9d-b0437c5c3479'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 01 18:17:29 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 01 18:17:29 user nova-compute[72150]: WARNING nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 01 18:17:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:17:29 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:17:30 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:17:30 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:17:30 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Hypervisor/Node resource view: name=user free_ram=10919MB free_disk=26.473068237304688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:17:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:17:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:17:30 user nova-compute[72150]: WARNING nova.compute.resource_tracker [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] No compute node record for user:f205788b-0048-4b9c-8d9d-b0437c5c3479: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host f205788b-0048-4b9c-8d9d-b0437c5c3479 could not be found.
Aug 01 18:17:30 user nova-compute[72150]: INFO nova.compute.resource_tracker [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Compute node record created for user:user with uuid: f205788b-0048-4b9c-8d9d-b0437c5c3479
Aug 01 18:17:30 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:17:30 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:17:30 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [req-2f77fa52-7c00-465e-8de4-5ad48621fdc6] Created resource provider record via placement API for resource provider with UUID f205788b-0048-4b9c-8d9d-b0437c5c3479 and name user.
Aug 01 18:17:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72150) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 01 18:17:30 user nova-compute[72150]: INFO nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] kernel doesn't support AMD SEV
Aug 01 18:17:30 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Updating inventory in ProviderTree for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 18:17:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:17:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Libvirt baseline CPU <cpu>
Aug 01 18:17:30 user nova-compute[72150]:   <arch>x86_64</arch>
Aug 01 18:17:30 user nova-compute[72150]:   <model>Nehalem</model>
Aug 01 18:17:30 user nova-compute[72150]:   <vendor>Intel</vendor>
Aug 01 18:17:30 user nova-compute[72150]:   <topology sockets="6" cores="1" threads="1"/>
Aug 01 18:17:30 user nova-compute[72150]: </cpu>
Aug 01 18:17:30 user nova-compute[72150]:  {{(pid=72150) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 01 18:17:30 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Updated inventory for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 01 18:17:30 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Updating resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479 generation from 0 to 1 during operation: update_inventory {{(pid=72150) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 01 18:17:30 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Updating inventory in ProviderTree for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 18:17:30 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Updating resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479 generation from 1 to 2 during operation: update_traits {{(pid=72150) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 01 18:17:30 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:17:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.610s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:17:30 user nova-compute[72150]: DEBUG nova.service [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Creating RPC server for service compute {{(pid=72150) start /opt/stack/nova/nova/service.py:182}}
Aug 01 18:17:30 user nova-compute[72150]: DEBUG nova.service [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Join ServiceGroup membership for this service compute {{(pid=72150) start /opt/stack/nova/nova/service.py:199}}
Aug 01 18:17:30 user nova-compute[72150]: DEBUG nova.servicegroup.drivers.db [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72150) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 01 18:17:47 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:17:47 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:18:21 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:18:21 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:18:21 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:18:21 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 18:18:21 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Didn't find any instances for network info cache update. {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 18:18:21 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:18:21 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:18:21 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:18:21 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:18:21 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:18:21 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:18:21 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:18:21 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:18:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:18:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:18:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:18:21 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:18:22 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:18:22 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:18:22 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=10241MB free_disk=26.376853942871094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:18:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:18:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:18:22 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:18:22 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:18:22 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:18:22 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:18:22 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:18:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.120s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:19:22 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:19:22 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:19:22 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:19:22 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:19:22 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:19:22 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:19:23 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:19:23 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:19:23 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 18:19:23 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Didn't find any instances for network info cache update. {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 18:19:23 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:19:23 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:19:23 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:19:23 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:19:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:19:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:19:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:19:23 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:19:24 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:19:24 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:19:24 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=10233MB free_disk=26.418766021728516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:19:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:19:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:19:24 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:19:24 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:19:24 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:19:24 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:19:24 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:19:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:20:22 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:20:22 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:20:22 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:20:22 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:20:23 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:20:23 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:20:23 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:20:23 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:20:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:20:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:20:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:20:23 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:20:24 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:20:24 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:20:24 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=10226MB free_disk=26.195858001708984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:20:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:20:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:20:24 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:20:24 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:20:24 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:20:24 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:20:24 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:20:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.105s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:20:26 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:20:26 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:20:26 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 18:20:26 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Didn't find any instances for network info cache update. {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 18:20:26 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:21:22 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:21:22 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:21:23 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:21:23 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:21:23 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:21:24 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:21:24 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:21:24 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:21:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:24 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:21:25 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:21:25 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:21:25 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=9498MB free_disk=26.217540740966797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:21:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:25 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:21:25 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:21:25 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:21:25 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:21:25 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:21:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:26 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:21:26 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:21:27 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:21:27 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:21:27 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 18:21:27 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Didn't find any instances for network info cache update. {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 18:21:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:21:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:21:30 user nova-compute[72150]: INFO nova.compute.claims [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Claim successful on node user
Aug 01 18:21:30 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:21:30 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:21:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:30 user nova-compute[72150]: DEBUG nova.compute.manager [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:21:30 user nova-compute[72150]: DEBUG nova.compute.manager [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:21:30 user nova-compute[72150]: DEBUG nova.network.neutron [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:21:30 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:21:30 user nova-compute[72150]: DEBUG nova.compute.manager [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:21:30 user nova-compute[72150]: DEBUG nova.compute.manager [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:21:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:21:30 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Creating image(s)
Aug 01 18:21:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "/opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "/opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:31 user nova-compute[72150]: DEBUG nova.policy [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5804d69f9f18482f9fe0e0d4d73c4e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493923414b464384bb3a1ce3e6f7a2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:21:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c.part --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c.part --force-share --output=json" returned: 0 in 0.179s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:32 user nova-compute[72150]: DEBUG nova.virt.images [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] dbc6b740-0555-4041-80f6-323ecd1d67db was qcow2, converting to raw {{(pid=72150) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 18:21:32 user nova-compute[72150]: DEBUG nova.privsep.utils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72150) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 18:21:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c.part /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c.converted {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c.part /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c.converted" returned: 0 in 0.174s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c.converted --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c.converted --force-share --output=json" returned: 0 in 0.164s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.041s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:32 user nova-compute[72150]: INFO oslo.privsep.daemon [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpthcpqgp0/privsep.sock']
Aug 01 18:21:32 user sudo[81284]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpthcpqgp0/privsep.sock
Aug 01 18:21:32 user sudo[81284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 18:21:34 user nova-compute[72150]: DEBUG nova.network.neutron [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Successfully created port: b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:21:34 user sudo[81284]: pam_unix(sudo:session): session closed for user root
Aug 01 18:21:34 user nova-compute[72150]: INFO oslo.privsep.daemon [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Spawned new privsep daemon via rootwrap
Aug 01 18:21:34 user nova-compute[72150]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 18:21:34 user nova-compute[72150]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 18:21:34 user nova-compute[72150]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 01 18:21:34 user nova-compute[72150]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81293
Aug 01 18:21:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Acquiring lock "c3811375-bcd1-46ac-b552-7ff1588a3667" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "c3811375-bcd1-46ac-b552-7ff1588a3667" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:34 user nova-compute[72150]: DEBUG nova.compute.manager [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:21:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.183s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:21:34 user nova-compute[72150]: INFO nova.compute.claims [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Claim successful on node user
Aug 01 18:21:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.131s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk 1073741824" returned: 0 in 0.041s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.176s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Cannot resize image /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG nova.objects.instance [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'migration_context' on Instance uuid 3f123d4e-1aec-4aa1-8717-f31305a62a5d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG nova.compute.manager [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Ensure instance console log exists: /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG nova.compute.manager [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG nova.network.neutron [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:21:35 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:21:35 user nova-compute[72150]: DEBUG nova.compute.manager [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG nova.compute.manager [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:21:35 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Creating image(s)
Aug 01 18:21:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3811375-bcd1-46ac-b552-7ff1588a3667/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "/opt/stack/data/nova/instances/c3811375-bcd1-46ac-b552-7ff1588a3667/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "/opt/stack/data/nova/instances/c3811375-bcd1-46ac-b552-7ff1588a3667/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG nova.policy [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '66f8d97f88cf445391decc1771f0e0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7f76aef75642d0bffa978550d6935d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG nova.network.neutron [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Successfully updated port: b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquired lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:21:35 user nova-compute[72150]: DEBUG nova.network.neutron [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.157s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/c3811375-bcd1-46ac-b552-7ff1588a3667/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.network.neutron [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/c3811375-bcd1-46ac-b552-7ff1588a3667/disk 1073741824" returned: 0 in 0.050s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3811375-bcd1-46ac-b552-7ff1588a3667/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3811375-bcd1-46ac-b552-7ff1588a3667/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.compute.manager [req-ef1500c7-be77-4095-96c8-8e874108d1a0 req-db9fae14-4fa4-41d9-8487-ebd5b4415695 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Received event network-changed-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.compute.manager [req-ef1500c7-be77-4095-96c8-8e874108d1a0 req-db9fae14-4fa4-41d9-8487-ebd5b4415695 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Refreshing instance network info cache due to event network-changed-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ef1500c7-be77-4095-96c8-8e874108d1a0 req-db9fae14-4fa4-41d9-8487-ebd5b4415695 service nova] Acquiring lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3811375-bcd1-46ac-b552-7ff1588a3667/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Cannot resize image /opt/stack/data/nova/instances/c3811375-bcd1-46ac-b552-7ff1588a3667/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.objects.instance [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lazy-loading 'migration_context' on Instance uuid c3811375-bcd1-46ac-b552-7ff1588a3667 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Ensure instance console log exists: /opt/stack/data/nova/instances/c3811375-bcd1-46ac-b552-7ff1588a3667/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.network.neutron [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Updating instance_info_cache with network_info: [{"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Releasing lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.compute.manager [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Instance network_info: |[{"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ef1500c7-be77-4095-96c8-8e874108d1a0 req-db9fae14-4fa4-41d9-8487-ebd5b4415695 service nova] Acquired lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.network.neutron [req-ef1500c7-be77-4095-96c8-8e874108d1a0 req-db9fae14-4fa4-41d9-8487-ebd5b4415695 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Refreshing network info cache for port b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Start _get_guest_xml network_info=[{"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:21:36 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:21:36 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.privsep.utils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72150) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1003209770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1003209770',id=1,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbjycC5zBZm+jvsm6GKYmgPP65OAatTQjCe2+mKm63L/m7E/UypS6JMjfua0Hf9QrTu6zvwdEzRoBZi9TuD4yBQcH8hOrW2tjxpilyk89sJYOLq8mOKZh/+51AlthHzMA==',key_name='tempest-keypair-1020169864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='493923414b464384bb3a1ce3e6f7a2f0',ramdisk_id='',reservation_id='r-6jxlw7xx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849821930',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849821930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:21:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5804d69f9f18482f9fe0e0d4d73c4e92',uuid=3f123d4e-1aec-4aa1-8717-f31305a62a5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converting VIF {"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fb:29,bridge_name='br-int',has_traffic_filtering=True,id=b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc6d1a-9b') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.objects.instance [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f123d4e-1aec-4aa1-8717-f31305a62a5d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:21:36 user nova-compute[72150]:   <uuid>3f123d4e-1aec-4aa1-8717-f31305a62a5d</uuid>
Aug 01 18:21:36 user nova-compute[72150]:   <name>instance-00000001</name>
Aug 01 18:21:36 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:21:36 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:21:36 user nova-compute[72150]:   <metadata>
Aug 01 18:21:36 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:21:36 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:21:36 user nova-compute[72150]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1003209770</nova:name>
Aug 01 18:21:36 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:21:36</nova:creationTime>
Aug 01 18:21:36 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:21:36 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:21:36 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:21:36 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:21:36 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:21:36 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:21:36 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:21:36 user nova-compute[72150]:       <nova:owner>
Aug 01 18:21:36 user nova-compute[72150]:         <nova:user uuid="5804d69f9f18482f9fe0e0d4d73c4e92">tempest-AttachVolumeShelveTestJSON-1849821930-project-member</nova:user>
Aug 01 18:21:36 user nova-compute[72150]:         <nova:project uuid="493923414b464384bb3a1ce3e6f7a2f0">tempest-AttachVolumeShelveTestJSON-1849821930</nova:project>
Aug 01 18:21:36 user nova-compute[72150]:       </nova:owner>
Aug 01 18:21:36 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:21:36 user nova-compute[72150]:       <nova:ports>
Aug 01 18:21:36 user nova-compute[72150]:         <nova:port uuid="b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17">
Aug 01 18:21:36 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 18:21:36 user nova-compute[72150]:         </nova:port>
Aug 01 18:21:36 user nova-compute[72150]:       </nova:ports>
Aug 01 18:21:36 user nova-compute[72150]:     </nova:instance>
Aug 01 18:21:36 user nova-compute[72150]:   </metadata>
Aug 01 18:21:36 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:21:36 user nova-compute[72150]:     <system>
Aug 01 18:21:36 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:21:36 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:21:36 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:21:36 user nova-compute[72150]:       <entry name="serial">3f123d4e-1aec-4aa1-8717-f31305a62a5d</entry>
Aug 01 18:21:36 user nova-compute[72150]:       <entry name="uuid">3f123d4e-1aec-4aa1-8717-f31305a62a5d</entry>
Aug 01 18:21:36 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:21:36 user nova-compute[72150]:     </system>
Aug 01 18:21:36 user nova-compute[72150]:   </sysinfo>
Aug 01 18:21:36 user nova-compute[72150]:   <os>
Aug 01 18:21:36 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:21:36 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:21:36 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:21:36 user nova-compute[72150]:   </os>
Aug 01 18:21:36 user nova-compute[72150]:   <features>
Aug 01 18:21:36 user nova-compute[72150]:     <acpi/>
Aug 01 18:21:36 user nova-compute[72150]:     <apic/>
Aug 01 18:21:36 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:21:36 user nova-compute[72150]:   </features>
Aug 01 18:21:36 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:21:36 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:21:36 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:21:36 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:21:36 user nova-compute[72150]:   </clock>
Aug 01 18:21:36 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:21:36 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:21:36 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:21:36 user nova-compute[72150]:   </cpu>
Aug 01 18:21:36 user nova-compute[72150]:   <devices>
Aug 01 18:21:36 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:21:36 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:21:36 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk"/>
Aug 01 18:21:36 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:21:36 user nova-compute[72150]:     </disk>
Aug 01 18:21:36 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:21:36 user nova-compute[72150]:       <mac address="fa:16:3e:c9:fb:29"/>
Aug 01 18:21:36 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:21:36 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:21:36 user nova-compute[72150]:       <target dev="tapb3bc6d1a-9b"/>
Aug 01 18:21:36 user nova-compute[72150]:     </interface>
Aug 01 18:21:36 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:21:36 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/console.log" append="off"/>
Aug 01 18:21:36 user nova-compute[72150]:     </serial>
Aug 01 18:21:36 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:21:36 user nova-compute[72150]:     <video>
Aug 01 18:21:36 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:21:36 user nova-compute[72150]:     </video>
Aug 01 18:21:36 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:21:36 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:21:36 user nova-compute[72150]:     </rng>
Aug 01 18:21:36 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:21:36 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:21:36 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:21:36 user nova-compute[72150]:     </memballoon>
Aug 01 18:21:36 user nova-compute[72150]:   </devices>
Aug 01 18:21:36 user nova-compute[72150]: </domain>
Aug 01 18:21:36 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1003209770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1003209770',id=1,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbjycC5zBZm+jvsm6GKYmgPP65OAatTQjCe2+mKm63L/m7E/UypS6JMjfua0Hf9QrTu6zvwdEzRoBZi9TuD4yBQcH8hOrW2tjxpilyk89sJYOLq8mOKZh/+51AlthHzMA==',key_name='tempest-keypair-1020169864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='493923414b464384bb3a1ce3e6f7a2f0',ramdisk_id='',reservation_id='r-6jxlw7xx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849821930',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849821930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:21:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5804d69f9f18482f9fe0e0d4d73c4e92',uuid=3f123d4e-1aec-4aa1-8717-f31305a62a5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converting VIF {"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fb:29,bridge_name='br-int',has_traffic_filtering=True,id=b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc6d1a-9b') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG os_vif [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fb:29,bridge_name='br-int',has_traffic_filtering=True,id=b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc6d1a-9b') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Created schema index Interface.name {{(pid=72150) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Created schema index Port.name {{(pid=72150) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Created schema index Bridge.name {{(pid=72150) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [POLLOUT] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:21:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:21:37 user nova-compute[72150]: INFO oslo.privsep.daemon [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp00phicuv/privsep.sock']
Aug 01 18:21:37 user sudo[81333]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp00phicuv/privsep.sock
Aug 01 18:21:37 user sudo[81333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 18:21:37 user nova-compute[72150]: DEBUG nova.network.neutron [req-ef1500c7-be77-4095-96c8-8e874108d1a0 req-db9fae14-4fa4-41d9-8487-ebd5b4415695 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Updated VIF entry in instance network info cache for port b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:21:37 user nova-compute[72150]: DEBUG nova.network.neutron [req-ef1500c7-be77-4095-96c8-8e874108d1a0 req-db9fae14-4fa4-41d9-8487-ebd5b4415695 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Updating instance_info_cache with network_info: [{"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:21:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ef1500c7-be77-4095-96c8-8e874108d1a0 req-db9fae14-4fa4-41d9-8487-ebd5b4415695 service nova] Releasing lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:21:38 user nova-compute[72150]: DEBUG nova.network.neutron [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Successfully created port: 1a68eacb-ee1f-4cf8-a15f-668e9a3da691 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:21:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "050260e0-53e0-43dd-a301-a4e3e411f34d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "050260e0-53e0-43dd-a301-a4e3e411f34d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:38 user nova-compute[72150]: DEBUG nova.compute.manager [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:21:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:38 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:21:38 user nova-compute[72150]: INFO nova.compute.claims [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Claim successful on node user
Aug 01 18:21:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:38 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:21:38 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:21:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:38 user nova-compute[72150]: DEBUG nova.compute.manager [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:21:38 user sudo[81333]: pam_unix(sudo:session): session closed for user root
Aug 01 18:21:38 user nova-compute[72150]: INFO oslo.privsep.daemon [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Spawned new privsep daemon via rootwrap
Aug 01 18:21:38 user nova-compute[72150]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 18:21:38 user nova-compute[72150]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 18:21:38 user nova-compute[72150]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 01 18:21:38 user nova-compute[72150]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81340
Aug 01 18:21:38 user nova-compute[72150]: DEBUG nova.compute.manager [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:21:38 user nova-compute[72150]: DEBUG nova.network.neutron [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:21:38 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:21:38 user nova-compute[72150]: DEBUG nova.compute.manager [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:21:38 user nova-compute[72150]: DEBUG nova.policy [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e312b378dd2b43798193756afb51e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cec5474a64d46c2bfc92435c677abf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG nova.compute.manager [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:21:39 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Creating image(s)
Aug 01 18:21:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "/opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "/opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "/opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3bc6d1a-9b, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3bc6d1a-9b, col_values=(('external_ids', {'iface-id': 'b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:fb:29', 'vm-uuid': '3f123d4e-1aec-4aa1-8717-f31305a62a5d'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:39 user nova-compute[72150]: INFO os_vif [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fb:29,bridge_name='br-int',has_traffic_filtering=True,id=b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc6d1a-9b')
Aug 01 18:21:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.166s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk 1073741824" returned: 0 in 0.047s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] No VIF found with MAC fa:16:3e:c9:fb:29, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.141s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Checking if we can resize image /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Cannot resize image /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG nova.objects.instance [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lazy-loading 'migration_context' on Instance uuid 050260e0-53e0-43dd-a301-a4e3e411f34d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Ensure instance console log exists: /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:40 user nova-compute[72150]: DEBUG nova.network.neutron [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Successfully created port: c82387ba-7cc9-4eac-9469-021c80c1c195 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:21:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:40 user nova-compute[72150]: DEBUG nova.network.neutron [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Successfully updated port: 1a68eacb-ee1f-4cf8-a15f-668e9a3da691 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:21:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Acquiring lock "refresh_cache-c3811375-bcd1-46ac-b552-7ff1588a3667" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:21:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Acquired lock "refresh_cache-c3811375-bcd1-46ac-b552-7ff1588a3667" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:21:40 user nova-compute[72150]: DEBUG nova.network.neutron [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:21:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:40 user nova-compute[72150]: DEBUG nova.network.neutron [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:21:41 user nova-compute[72150]: DEBUG nova.compute.manager [req-bdd05d18-c4a4-4094-a8f1-35e3681a13a4 req-20dde069-92ee-4aae-88c9-b683a0f61539 service nova] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Received event network-changed-1a68eacb-ee1f-4cf8-a15f-668e9a3da691 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:21:41 user nova-compute[72150]: DEBUG nova.compute.manager [req-bdd05d18-c4a4-4094-a8f1-35e3681a13a4 req-20dde069-92ee-4aae-88c9-b683a0f61539 service nova] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Refreshing instance network info cache due to event network-changed-1a68eacb-ee1f-4cf8-a15f-668e9a3da691. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:21:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bdd05d18-c4a4-4094-a8f1-35e3681a13a4 req-20dde069-92ee-4aae-88c9-b683a0f61539 service nova] Acquiring lock "refresh_cache-c3811375-bcd1-46ac-b552-7ff1588a3667" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:21:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:41 user nova-compute[72150]: DEBUG nova.compute.manager [req-00de72d1-2011-4369-ae56-9450cf562ff7 req-ca054c0d-0f79-420a-8b72-d8a6af2bb099 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Received event network-vif-plugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:21:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-00de72d1-2011-4369-ae56-9450cf562ff7 req-ca054c0d-0f79-420a-8b72-d8a6af2bb099 service nova] Acquiring lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-00de72d1-2011-4369-ae56-9450cf562ff7 req-ca054c0d-0f79-420a-8b72-d8a6af2bb099 service nova] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-00de72d1-2011-4369-ae56-9450cf562ff7 req-ca054c0d-0f79-420a-8b72-d8a6af2bb099 service nova] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:41 user nova-compute[72150]: DEBUG nova.compute.manager [req-00de72d1-2011-4369-ae56-9450cf562ff7 req-ca054c0d-0f79-420a-8b72-d8a6af2bb099 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] No waiting events found dispatching network-vif-plugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:21:41 user nova-compute[72150]: WARNING nova.compute.manager [req-00de72d1-2011-4369-ae56-9450cf562ff7 req-ca054c0d-0f79-420a-8b72-d8a6af2bb099 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Received unexpected event network-vif-plugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 for instance with vm_state building and task_state spawning.
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.network.neutron [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Updating instance_info_cache with network_info: [{"id": "1a68eacb-ee1f-4cf8-a15f-668e9a3da691", "address": "fa:16:3e:9e:ba:be", "network": {"id": "f3e4e91a-ba2c-4e94-9f12-bac4dc4607ad", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1636291956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7f76aef75642d0bffa978550d6935d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68eacb-ee", "ovs_interfaceid": "1a68eacb-ee1f-4cf8-a15f-668e9a3da691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Releasing lock "refresh_cache-c3811375-bcd1-46ac-b552-7ff1588a3667" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.compute.manager [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Instance network_info: |[{"id": "1a68eacb-ee1f-4cf8-a15f-668e9a3da691", "address": "fa:16:3e:9e:ba:be", "network": {"id": "f3e4e91a-ba2c-4e94-9f12-bac4dc4607ad", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1636291956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7f76aef75642d0bffa978550d6935d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68eacb-ee", "ovs_interfaceid": "1a68eacb-ee1f-4cf8-a15f-668e9a3da691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bdd05d18-c4a4-4094-a8f1-35e3681a13a4 req-20dde069-92ee-4aae-88c9-b683a0f61539 service nova] Acquired lock "refresh_cache-c3811375-bcd1-46ac-b552-7ff1588a3667" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.network.neutron [req-bdd05d18-c4a4-4094-a8f1-35e3681a13a4 req-20dde069-92ee-4aae-88c9-b683a0f61539 service nova] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Refreshing network info cache for port 1a68eacb-ee1f-4cf8-a15f-668e9a3da691 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Start _get_guest_xml network_info=[{"id": "1a68eacb-ee1f-4cf8-a15f-668e9a3da691", "address": "fa:16:3e:9e:ba:be", "network": {"id": "f3e4e91a-ba2c-4e94-9f12-bac4dc4607ad", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1636291956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7f76aef75642d0bffa978550d6935d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68eacb-ee", "ovs_interfaceid": "1a68eacb-ee1f-4cf8-a15f-668e9a3da691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:21:42 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:21:42 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:21:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-270748278',display_name='tempest-DeleteServersTestJSON-server-270748278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-270748278',id=2,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b7f76aef75642d0bffa978550d6935d',ramdisk_id='',reservation_id='r-cg3vb0p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-998275787',owner_user_name='tempest-DeleteServersTestJSON-998275787-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:21:36Z,user_data=None,user_id='66f8d97f88cf445391decc1771f0e0d9',uuid=c3811375-bcd1-46ac-b552-7ff1588a3667,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a68eacb-ee1f-4cf8-a15f-668e9a3da691", "address": "fa:16:3e:9e:ba:be", "network": {"id": "f3e4e91a-ba2c-4e94-9f12-bac4dc4607ad", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1636291956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7f76aef75642d0bffa978550d6935d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68eacb-ee", "ovs_interfaceid": "1a68eacb-ee1f-4cf8-a15f-668e9a3da691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Converting VIF {"id": "1a68eacb-ee1f-4cf8-a15f-668e9a3da691", "address": "fa:16:3e:9e:ba:be", "network": {"id": "f3e4e91a-ba2c-4e94-9f12-bac4dc4607ad", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1636291956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7f76aef75642d0bffa978550d6935d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68eacb-ee", "ovs_interfaceid": "1a68eacb-ee1f-4cf8-a15f-668e9a3da691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:ba:be,bridge_name='br-int',has_traffic_filtering=True,id=1a68eacb-ee1f-4cf8-a15f-668e9a3da691,network=Network(f3e4e91a-ba2c-4e94-9f12-bac4dc4607ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a68eacb-ee') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.objects.instance [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lazy-loading 'pci_devices' on Instance uuid c3811375-bcd1-46ac-b552-7ff1588a3667 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:21:42 user nova-compute[72150]:   <uuid>c3811375-bcd1-46ac-b552-7ff1588a3667</uuid>
Aug 01 18:21:42 user nova-compute[72150]:   <name>instance-00000002</name>
Aug 01 18:21:42 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:21:42 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:21:42 user nova-compute[72150]:   <metadata>
Aug 01 18:21:42 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:21:42 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:21:42 user nova-compute[72150]:       <nova:name>tempest-DeleteServersTestJSON-server-270748278</nova:name>
Aug 01 18:21:42 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:21:42</nova:creationTime>
Aug 01 18:21:42 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:21:42 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:21:42 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:21:42 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:21:42 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:21:42 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:21:42 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:21:42 user nova-compute[72150]:       <nova:owner>
Aug 01 18:21:42 user nova-compute[72150]:         <nova:user uuid="66f8d97f88cf445391decc1771f0e0d9">tempest-DeleteServersTestJSON-998275787-project-member</nova:user>
Aug 01 18:21:42 user nova-compute[72150]:         <nova:project uuid="9b7f76aef75642d0bffa978550d6935d">tempest-DeleteServersTestJSON-998275787</nova:project>
Aug 01 18:21:42 user nova-compute[72150]:       </nova:owner>
Aug 01 18:21:42 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:21:42 user nova-compute[72150]:       <nova:ports>
Aug 01 18:21:42 user nova-compute[72150]:         <nova:port uuid="1a68eacb-ee1f-4cf8-a15f-668e9a3da691">
Aug 01 18:21:42 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 18:21:42 user nova-compute[72150]:         </nova:port>
Aug 01 18:21:42 user nova-compute[72150]:       </nova:ports>
Aug 01 18:21:42 user nova-compute[72150]:     </nova:instance>
Aug 01 18:21:42 user nova-compute[72150]:   </metadata>
Aug 01 18:21:42 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:21:42 user nova-compute[72150]:     <system>
Aug 01 18:21:42 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:21:42 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:21:42 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:21:42 user nova-compute[72150]:       <entry name="serial">c3811375-bcd1-46ac-b552-7ff1588a3667</entry>
Aug 01 18:21:42 user nova-compute[72150]:       <entry name="uuid">c3811375-bcd1-46ac-b552-7ff1588a3667</entry>
Aug 01 18:21:42 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:21:42 user nova-compute[72150]:     </system>
Aug 01 18:21:42 user nova-compute[72150]:   </sysinfo>
Aug 01 18:21:42 user nova-compute[72150]:   <os>
Aug 01 18:21:42 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:21:42 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:21:42 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:21:42 user nova-compute[72150]:   </os>
Aug 01 18:21:42 user nova-compute[72150]:   <features>
Aug 01 18:21:42 user nova-compute[72150]:     <acpi/>
Aug 01 18:21:42 user nova-compute[72150]:     <apic/>
Aug 01 18:21:42 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:21:42 user nova-compute[72150]:   </features>
Aug 01 18:21:42 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:21:42 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:21:42 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:21:42 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:21:42 user nova-compute[72150]:   </clock>
Aug 01 18:21:42 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:21:42 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:21:42 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:21:42 user nova-compute[72150]:   </cpu>
Aug 01 18:21:42 user nova-compute[72150]:   <devices>
Aug 01 18:21:42 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:21:42 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:21:42 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/c3811375-bcd1-46ac-b552-7ff1588a3667/disk"/>
Aug 01 18:21:42 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:21:42 user nova-compute[72150]:     </disk>
Aug 01 18:21:42 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:21:42 user nova-compute[72150]:       <mac address="fa:16:3e:9e:ba:be"/>
Aug 01 18:21:42 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:21:42 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:21:42 user nova-compute[72150]:       <target dev="tap1a68eacb-ee"/>
Aug 01 18:21:42 user nova-compute[72150]:     </interface>
Aug 01 18:21:42 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:21:42 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/c3811375-bcd1-46ac-b552-7ff1588a3667/console.log" append="off"/>
Aug 01 18:21:42 user nova-compute[72150]:     </serial>
Aug 01 18:21:42 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:21:42 user nova-compute[72150]:     <video>
Aug 01 18:21:42 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:21:42 user nova-compute[72150]:     </video>
Aug 01 18:21:42 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:21:42 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:21:42 user nova-compute[72150]:     </rng>
Aug 01 18:21:42 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:21:42 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:21:42 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:21:42 user nova-compute[72150]:     </memballoon>
Aug 01 18:21:42 user nova-compute[72150]:   </devices>
Aug 01 18:21:42 user nova-compute[72150]: </domain>
Aug 01 18:21:42 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:21:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-270748278',display_name='tempest-DeleteServersTestJSON-server-270748278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-270748278',id=2,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b7f76aef75642d0bffa978550d6935d',ramdisk_id='',reservation_id='r-cg3vb0p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-998275787',owner_user_name='tempest-DeleteServersTestJSON-998275787-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:21:36Z,user_data=None,user_id='66f8d97f88cf445391decc1771f0e0d9',uuid=c3811375-bcd1-46ac-b552-7ff1588a3667,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a68eacb-ee1f-4cf8-a15f-668e9a3da691", "address": "fa:16:3e:9e:ba:be", "network": {"id": "f3e4e91a-ba2c-4e94-9f12-bac4dc4607ad", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1636291956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7f76aef75642d0bffa978550d6935d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68eacb-ee", "ovs_interfaceid": "1a68eacb-ee1f-4cf8-a15f-668e9a3da691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Converting VIF {"id": "1a68eacb-ee1f-4cf8-a15f-668e9a3da691", "address": "fa:16:3e:9e:ba:be", "network": {"id": "f3e4e91a-ba2c-4e94-9f12-bac4dc4607ad", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1636291956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7f76aef75642d0bffa978550d6935d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68eacb-ee", "ovs_interfaceid": "1a68eacb-ee1f-4cf8-a15f-668e9a3da691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:ba:be,bridge_name='br-int',has_traffic_filtering=True,id=1a68eacb-ee1f-4cf8-a15f-668e9a3da691,network=Network(f3e4e91a-ba2c-4e94-9f12-bac4dc4607ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a68eacb-ee') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG os_vif [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:ba:be,bridge_name='br-int',has_traffic_filtering=True,id=1a68eacb-ee1f-4cf8-a15f-668e9a3da691,network=Network(f3e4e91a-ba2c-4e94-9f12-bac4dc4607ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a68eacb-ee') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a68eacb-ee, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a68eacb-ee, col_values=(('external_ids', {'iface-id': '1a68eacb-ee1f-4cf8-a15f-668e9a3da691', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:ba:be', 'vm-uuid': 'c3811375-bcd1-46ac-b552-7ff1588a3667'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:42 user nova-compute[72150]: INFO os_vif [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:ba:be,bridge_name='br-int',has_traffic_filtering=True,id=1a68eacb-ee1f-4cf8-a15f-668e9a3da691,network=Network(f3e4e91a-ba2c-4e94-9f12-bac4dc4607ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a68eacb-ee')
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] No VIF found with MAC fa:16:3e:9e:ba:be, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914102.629016, 3f123d4e-1aec-4aa1-8717-f31305a62a5d => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:21:42 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] VM Resumed (Lifecycle Event)
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.compute.manager [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:21:42 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Instance spawned successfully.
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:21:42 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914102.6365254, 3f123d4e-1aec-4aa1-8717-f31305a62a5d => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:21:42 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] VM Started (Lifecycle Event)
Aug 01 18:21:42 user nova-compute[72150]: INFO nova.compute.manager [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Took 12.04 seconds to spawn the instance on the hypervisor.
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.compute.manager [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:21:42 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:21:42 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:21:42 user nova-compute[72150]: INFO nova.compute.manager [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Took 12.99 seconds to build instance.
Aug 01 18:21:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4fe30139-e294-4802-ae78-20bdd4b0f2d4 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.188s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:43 user nova-compute[72150]: DEBUG nova.network.neutron [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Successfully updated port: c82387ba-7cc9-4eac-9469-021c80c1c195 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:21:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "refresh_cache-050260e0-53e0-43dd-a301-a4e3e411f34d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:21:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquired lock "refresh_cache-050260e0-53e0-43dd-a301-a4e3e411f34d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:21:43 user nova-compute[72150]: DEBUG nova.network.neutron [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:21:43 user nova-compute[72150]: DEBUG nova.network.neutron [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:21:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:43 user nova-compute[72150]: DEBUG nova.compute.manager [req-c1d69c4b-d485-41d2-92ae-bf1c65342b30 req-afec612d-e68d-42f9-a9e8-b8a062eeb7ab service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Received event network-vif-plugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:21:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c1d69c4b-d485-41d2-92ae-bf1c65342b30 req-afec612d-e68d-42f9-a9e8-b8a062eeb7ab service nova] Acquiring lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c1d69c4b-d485-41d2-92ae-bf1c65342b30 req-afec612d-e68d-42f9-a9e8-b8a062eeb7ab service nova] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c1d69c4b-d485-41d2-92ae-bf1c65342b30 req-afec612d-e68d-42f9-a9e8-b8a062eeb7ab service nova] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:43 user nova-compute[72150]: DEBUG nova.compute.manager [req-c1d69c4b-d485-41d2-92ae-bf1c65342b30 req-afec612d-e68d-42f9-a9e8-b8a062eeb7ab service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] No waiting events found dispatching network-vif-plugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:21:43 user nova-compute[72150]: WARNING nova.compute.manager [req-c1d69c4b-d485-41d2-92ae-bf1c65342b30 req-afec612d-e68d-42f9-a9e8-b8a062eeb7ab service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Received unexpected event network-vif-plugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 for instance with vm_state active and task_state None.
Aug 01 18:21:43 user nova-compute[72150]: DEBUG nova.compute.manager [req-c1d69c4b-d485-41d2-92ae-bf1c65342b30 req-afec612d-e68d-42f9-a9e8-b8a062eeb7ab service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Received event network-changed-c82387ba-7cc9-4eac-9469-021c80c1c195 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:21:43 user nova-compute[72150]: DEBUG nova.compute.manager [req-c1d69c4b-d485-41d2-92ae-bf1c65342b30 req-afec612d-e68d-42f9-a9e8-b8a062eeb7ab service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Refreshing instance network info cache due to event network-changed-c82387ba-7cc9-4eac-9469-021c80c1c195. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:21:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c1d69c4b-d485-41d2-92ae-bf1c65342b30 req-afec612d-e68d-42f9-a9e8-b8a062eeb7ab service nova] Acquiring lock "refresh_cache-050260e0-53e0-43dd-a301-a4e3e411f34d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:21:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.network.neutron [req-bdd05d18-c4a4-4094-a8f1-35e3681a13a4 req-20dde069-92ee-4aae-88c9-b683a0f61539 service nova] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Updated VIF entry in instance network info cache for port 1a68eacb-ee1f-4cf8-a15f-668e9a3da691. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.network.neutron [req-bdd05d18-c4a4-4094-a8f1-35e3681a13a4 req-20dde069-92ee-4aae-88c9-b683a0f61539 service nova] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Updating instance_info_cache with network_info: [{"id": "1a68eacb-ee1f-4cf8-a15f-668e9a3da691", "address": "fa:16:3e:9e:ba:be", "network": {"id": "f3e4e91a-ba2c-4e94-9f12-bac4dc4607ad", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1636291956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7f76aef75642d0bffa978550d6935d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68eacb-ee", "ovs_interfaceid": "1a68eacb-ee1f-4cf8-a15f-668e9a3da691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bdd05d18-c4a4-4094-a8f1-35e3681a13a4 req-20dde069-92ee-4aae-88c9-b683a0f61539 service nova] Releasing lock "refresh_cache-c3811375-bcd1-46ac-b552-7ff1588a3667" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.network.neutron [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Updating instance_info_cache with network_info: [{"id": "c82387ba-7cc9-4eac-9469-021c80c1c195", "address": "fa:16:3e:ba:0b:96", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82387ba-7c", "ovs_interfaceid": "c82387ba-7cc9-4eac-9469-021c80c1c195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Releasing lock "refresh_cache-050260e0-53e0-43dd-a301-a4e3e411f34d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.compute.manager [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Instance network_info: |[{"id": "c82387ba-7cc9-4eac-9469-021c80c1c195", "address": "fa:16:3e:ba:0b:96", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82387ba-7c", "ovs_interfaceid": "c82387ba-7cc9-4eac-9469-021c80c1c195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c1d69c4b-d485-41d2-92ae-bf1c65342b30 req-afec612d-e68d-42f9-a9e8-b8a062eeb7ab service nova] Acquired lock "refresh_cache-050260e0-53e0-43dd-a301-a4e3e411f34d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.network.neutron [req-c1d69c4b-d485-41d2-92ae-bf1c65342b30 req-afec612d-e68d-42f9-a9e8-b8a062eeb7ab service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Refreshing network info cache for port c82387ba-7cc9-4eac-9469-021c80c1c195 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Start _get_guest_xml network_info=[{"id": "c82387ba-7cc9-4eac-9469-021c80c1c195", "address": "fa:16:3e:ba:0b:96", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82387ba-7c", "ovs_interfaceid": "c82387ba-7cc9-4eac-9469-021c80c1c195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:21:44 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:21:44 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-215959377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-215959377',id=3,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/wFowy+M1NAPnvANCXjan/daFtwmUjVAs74fsHLjZxiCYE/+xbPtnm8pIgXOeNbriQJTWIvWSP9HtPPGIZRq1lPhZFjuc5VnxhFyz1VYnUnucR7H9nTtIhQVb22bKz0Q==',key_name='tempest-keypair-926565866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cec5474a64d46c2bfc92435c677abf2',ramdisk_id='',reservation_id='r-h2809h54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1421721381',owner_user_name='tempest-ServerActionsV293TestJSON-1421721381-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:21:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e312b378dd2b43798193756afb51e343',uuid=050260e0-53e0-43dd-a301-a4e3e411f34d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c82387ba-7cc9-4eac-9469-021c80c1c195", "address": "fa:16:3e:ba:0b:96", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82387ba-7c", "ovs_interfaceid": "c82387ba-7cc9-4eac-9469-021c80c1c195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Converting VIF {"id": "c82387ba-7cc9-4eac-9469-021c80c1c195", "address": "fa:16:3e:ba:0b:96", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82387ba-7c", "ovs_interfaceid": "c82387ba-7cc9-4eac-9469-021c80c1c195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0b:96,bridge_name='br-int',has_traffic_filtering=True,id=c82387ba-7cc9-4eac-9469-021c80c1c195,network=Network(ac6e56c1-0122-4bc2-b6b2-a76d80894c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc82387ba-7c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.objects.instance [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lazy-loading 'pci_devices' on Instance uuid 050260e0-53e0-43dd-a301-a4e3e411f34d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:21:44 user nova-compute[72150]:   <uuid>050260e0-53e0-43dd-a301-a4e3e411f34d</uuid>
Aug 01 18:21:44 user nova-compute[72150]:   <name>instance-00000003</name>
Aug 01 18:21:44 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:21:44 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:21:44 user nova-compute[72150]:   <metadata>
Aug 01 18:21:44 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:21:44 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:21:44 user nova-compute[72150]:       <nova:name>tempest-ServerActionsV293TestJSON-server-215959377</nova:name>
Aug 01 18:21:44 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:21:44</nova:creationTime>
Aug 01 18:21:44 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:21:44 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:21:44 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:21:44 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:21:44 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:21:44 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:21:44 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:21:44 user nova-compute[72150]:       <nova:owner>
Aug 01 18:21:44 user nova-compute[72150]:         <nova:user uuid="e312b378dd2b43798193756afb51e343">tempest-ServerActionsV293TestJSON-1421721381-project-member</nova:user>
Aug 01 18:21:44 user nova-compute[72150]:         <nova:project uuid="4cec5474a64d46c2bfc92435c677abf2">tempest-ServerActionsV293TestJSON-1421721381</nova:project>
Aug 01 18:21:44 user nova-compute[72150]:       </nova:owner>
Aug 01 18:21:44 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:21:44 user nova-compute[72150]:       <nova:ports>
Aug 01 18:21:44 user nova-compute[72150]:         <nova:port uuid="c82387ba-7cc9-4eac-9469-021c80c1c195">
Aug 01 18:21:44 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 18:21:44 user nova-compute[72150]:         </nova:port>
Aug 01 18:21:44 user nova-compute[72150]:       </nova:ports>
Aug 01 18:21:44 user nova-compute[72150]:     </nova:instance>
Aug 01 18:21:44 user nova-compute[72150]:   </metadata>
Aug 01 18:21:44 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:21:44 user nova-compute[72150]:     <system>
Aug 01 18:21:44 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:21:44 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:21:44 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:21:44 user nova-compute[72150]:       <entry name="serial">050260e0-53e0-43dd-a301-a4e3e411f34d</entry>
Aug 01 18:21:44 user nova-compute[72150]:       <entry name="uuid">050260e0-53e0-43dd-a301-a4e3e411f34d</entry>
Aug 01 18:21:44 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:21:44 user nova-compute[72150]:     </system>
Aug 01 18:21:44 user nova-compute[72150]:   </sysinfo>
Aug 01 18:21:44 user nova-compute[72150]:   <os>
Aug 01 18:21:44 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:21:44 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:21:44 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:21:44 user nova-compute[72150]:   </os>
Aug 01 18:21:44 user nova-compute[72150]:   <features>
Aug 01 18:21:44 user nova-compute[72150]:     <acpi/>
Aug 01 18:21:44 user nova-compute[72150]:     <apic/>
Aug 01 18:21:44 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:21:44 user nova-compute[72150]:   </features>
Aug 01 18:21:44 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:21:44 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:21:44 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:21:44 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:21:44 user nova-compute[72150]:   </clock>
Aug 01 18:21:44 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:21:44 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:21:44 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:21:44 user nova-compute[72150]:   </cpu>
Aug 01 18:21:44 user nova-compute[72150]:   <devices>
Aug 01 18:21:44 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:21:44 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:21:44 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk"/>
Aug 01 18:21:44 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:21:44 user nova-compute[72150]:     </disk>
Aug 01 18:21:44 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:21:44 user nova-compute[72150]:       <mac address="fa:16:3e:ba:0b:96"/>
Aug 01 18:21:44 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:21:44 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:21:44 user nova-compute[72150]:       <target dev="tapc82387ba-7c"/>
Aug 01 18:21:44 user nova-compute[72150]:     </interface>
Aug 01 18:21:44 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:21:44 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/console.log" append="off"/>
Aug 01 18:21:44 user nova-compute[72150]:     </serial>
Aug 01 18:21:44 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:21:44 user nova-compute[72150]:     <video>
Aug 01 18:21:44 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:21:44 user nova-compute[72150]:     </video>
Aug 01 18:21:44 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:21:44 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:21:44 user nova-compute[72150]:     </rng>
Aug 01 18:21:44 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:21:44 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:21:44 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:21:44 user nova-compute[72150]:     </memballoon>
Aug 01 18:21:44 user nova-compute[72150]:   </devices>
Aug 01 18:21:44 user nova-compute[72150]: </domain>
Aug 01 18:21:44 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-215959377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-215959377',id=3,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/wFowy+M1NAPnvANCXjan/daFtwmUjVAs74fsHLjZxiCYE/+xbPtnm8pIgXOeNbriQJTWIvWSP9HtPPGIZRq1lPhZFjuc5VnxhFyz1VYnUnucR7H9nTtIhQVb22bKz0Q==',key_name='tempest-keypair-926565866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cec5474a64d46c2bfc92435c677abf2',ramdisk_id='',reservation_id='r-h2809h54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1421721381',owner_user_name='tempest-ServerActionsV293TestJSON-1421721381-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:21:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e312b378dd2b43798193756afb51e343',uuid=050260e0-53e0-43dd-a301-a4e3e411f34d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c82387ba-7cc9-4eac-9469-021c80c1c195", "address": "fa:16:3e:ba:0b:96", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82387ba-7c", "ovs_interfaceid": "c82387ba-7cc9-4eac-9469-021c80c1c195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Converting VIF {"id": "c82387ba-7cc9-4eac-9469-021c80c1c195", "address": "fa:16:3e:ba:0b:96", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82387ba-7c", "ovs_interfaceid": "c82387ba-7cc9-4eac-9469-021c80c1c195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0b:96,bridge_name='br-int',has_traffic_filtering=True,id=c82387ba-7cc9-4eac-9469-021c80c1c195,network=Network(ac6e56c1-0122-4bc2-b6b2-a76d80894c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc82387ba-7c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG os_vif [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0b:96,bridge_name='br-int',has_traffic_filtering=True,id=c82387ba-7cc9-4eac-9469-021c80c1c195,network=Network(ac6e56c1-0122-4bc2-b6b2-a76d80894c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc82387ba-7c') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc82387ba-7c, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc82387ba-7c, col_values=(('external_ids', {'iface-id': 'c82387ba-7cc9-4eac-9469-021c80c1c195', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:0b:96', 'vm-uuid': '050260e0-53e0-43dd-a301-a4e3e411f34d'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:44 user nova-compute[72150]: INFO os_vif [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0b:96,bridge_name='br-int',has_traffic_filtering=True,id=c82387ba-7cc9-4eac-9469-021c80c1c195,network=Network(ac6e56c1-0122-4bc2-b6b2-a76d80894c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc82387ba-7c')
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] No VIF found with MAC fa:16:3e:ba:0b:96, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-f9a0821f-71af-4fc6-8bf9-fe130ee83d67 req-61242207-e0fd-4600-a94d-38bc76c7f022 service nova] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Received event network-vif-plugged-1a68eacb-ee1f-4cf8-a15f-668e9a3da691 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f9a0821f-71af-4fc6-8bf9-fe130ee83d67 req-61242207-e0fd-4600-a94d-38bc76c7f022 service nova] Acquiring lock "c3811375-bcd1-46ac-b552-7ff1588a3667-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f9a0821f-71af-4fc6-8bf9-fe130ee83d67 req-61242207-e0fd-4600-a94d-38bc76c7f022 service nova] Lock "c3811375-bcd1-46ac-b552-7ff1588a3667-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f9a0821f-71af-4fc6-8bf9-fe130ee83d67 req-61242207-e0fd-4600-a94d-38bc76c7f022 service nova] Lock "c3811375-bcd1-46ac-b552-7ff1588a3667-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-f9a0821f-71af-4fc6-8bf9-fe130ee83d67 req-61242207-e0fd-4600-a94d-38bc76c7f022 service nova] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] No waiting events found dispatching network-vif-plugged-1a68eacb-ee1f-4cf8-a15f-668e9a3da691 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:21:44 user nova-compute[72150]: WARNING nova.compute.manager [req-f9a0821f-71af-4fc6-8bf9-fe130ee83d67 req-61242207-e0fd-4600-a94d-38bc76c7f022 service nova] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Received unexpected event network-vif-plugged-1a68eacb-ee1f-4cf8-a15f-668e9a3da691 for instance with vm_state building and task_state spawning.
Aug 01 18:21:45 user nova-compute[72150]: DEBUG nova.network.neutron [req-c1d69c4b-d485-41d2-92ae-bf1c65342b30 req-afec612d-e68d-42f9-a9e8-b8a062eeb7ab service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Updated VIF entry in instance network info cache for port c82387ba-7cc9-4eac-9469-021c80c1c195. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:21:45 user nova-compute[72150]: DEBUG nova.network.neutron [req-c1d69c4b-d485-41d2-92ae-bf1c65342b30 req-afec612d-e68d-42f9-a9e8-b8a062eeb7ab service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Updating instance_info_cache with network_info: [{"id": "c82387ba-7cc9-4eac-9469-021c80c1c195", "address": "fa:16:3e:ba:0b:96", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82387ba-7c", "ovs_interfaceid": "c82387ba-7cc9-4eac-9469-021c80c1c195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:21:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c1d69c4b-d485-41d2-92ae-bf1c65342b30 req-afec612d-e68d-42f9-a9e8-b8a062eeb7ab service nova] Releasing lock "refresh_cache-050260e0-53e0-43dd-a301-a4e3e411f34d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:21:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:46 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914106.549801, c3811375-bcd1-46ac-b552-7ff1588a3667 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:21:46 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] VM Resumed (Lifecycle Event)
Aug 01 18:21:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:21:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:21:46 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Instance spawned successfully.
Aug 01 18:21:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:21:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:21:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:21:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:21:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:21:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:21:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:21:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:21:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:21:46 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:21:46 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914106.5516472, c3811375-bcd1-46ac-b552-7ff1588a3667 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:21:46 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] VM Started (Lifecycle Event)
Aug 01 18:21:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:21:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:21:46 user nova-compute[72150]: INFO nova.compute.manager [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Took 10.99 seconds to spawn the instance on the hypervisor.
Aug 01 18:21:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:21:46 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:21:46 user nova-compute[72150]: DEBUG nova.compute.manager [req-ff2aef30-e532-4ab8-9007-8267d1c5ed99 req-5dccd1a9-6e31-45c5-a1ce-5673a6bb0c29 service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Received event network-vif-plugged-c82387ba-7cc9-4eac-9469-021c80c1c195 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:21:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ff2aef30-e532-4ab8-9007-8267d1c5ed99 req-5dccd1a9-6e31-45c5-a1ce-5673a6bb0c29 service nova] Acquiring lock "050260e0-53e0-43dd-a301-a4e3e411f34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ff2aef30-e532-4ab8-9007-8267d1c5ed99 req-5dccd1a9-6e31-45c5-a1ce-5673a6bb0c29 service nova] Lock "050260e0-53e0-43dd-a301-a4e3e411f34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ff2aef30-e532-4ab8-9007-8267d1c5ed99 req-5dccd1a9-6e31-45c5-a1ce-5673a6bb0c29 service nova] Lock "050260e0-53e0-43dd-a301-a4e3e411f34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:46 user nova-compute[72150]: DEBUG nova.compute.manager [req-ff2aef30-e532-4ab8-9007-8267d1c5ed99 req-5dccd1a9-6e31-45c5-a1ce-5673a6bb0c29 service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] No waiting events found dispatching network-vif-plugged-c82387ba-7cc9-4eac-9469-021c80c1c195 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:21:46 user nova-compute[72150]: WARNING nova.compute.manager [req-ff2aef30-e532-4ab8-9007-8267d1c5ed99 req-5dccd1a9-6e31-45c5-a1ce-5673a6bb0c29 service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Received unexpected event network-vif-plugged-c82387ba-7cc9-4eac-9469-021c80c1c195 for instance with vm_state building and task_state spawning.
Aug 01 18:21:46 user nova-compute[72150]: INFO nova.compute.manager [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Took 12.01 seconds to build instance.
Aug 01 18:21:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e3957108-499c-45d7-aa5f-ee8ac2c1497b tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "c3811375-bcd1-46ac-b552-7ff1588a3667" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.167s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-c32ab961-b1d6-44dd-9f80-41f89f89acce req-b8322932-d959-4983-b407-471e166c1c81 service nova] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Received event network-vif-plugged-1a68eacb-ee1f-4cf8-a15f-668e9a3da691 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:21:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c32ab961-b1d6-44dd-9f80-41f89f89acce req-b8322932-d959-4983-b407-471e166c1c81 service nova] Acquiring lock "c3811375-bcd1-46ac-b552-7ff1588a3667-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c32ab961-b1d6-44dd-9f80-41f89f89acce req-b8322932-d959-4983-b407-471e166c1c81 service nova] Lock "c3811375-bcd1-46ac-b552-7ff1588a3667-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c32ab961-b1d6-44dd-9f80-41f89f89acce req-b8322932-d959-4983-b407-471e166c1c81 service nova] Lock "c3811375-bcd1-46ac-b552-7ff1588a3667-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-c32ab961-b1d6-44dd-9f80-41f89f89acce req-b8322932-d959-4983-b407-471e166c1c81 service nova] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] No waiting events found dispatching network-vif-plugged-1a68eacb-ee1f-4cf8-a15f-668e9a3da691 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:21:47 user nova-compute[72150]: WARNING nova.compute.manager [req-c32ab961-b1d6-44dd-9f80-41f89f89acce req-b8322932-d959-4983-b407-471e166c1c81 service nova] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Received unexpected event network-vif-plugged-1a68eacb-ee1f-4cf8-a15f-668e9a3da691 for instance with vm_state active and task_state None.
Aug 01 18:21:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:48 user nova-compute[72150]: DEBUG nova.compute.manager [req-ffd92929-cc04-40f7-a109-084a64c21aba req-ad3e3931-cb74-4b75-8c56-f502617efa40 service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Received event network-vif-plugged-c82387ba-7cc9-4eac-9469-021c80c1c195 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:21:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ffd92929-cc04-40f7-a109-084a64c21aba req-ad3e3931-cb74-4b75-8c56-f502617efa40 service nova] Acquiring lock "050260e0-53e0-43dd-a301-a4e3e411f34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ffd92929-cc04-40f7-a109-084a64c21aba req-ad3e3931-cb74-4b75-8c56-f502617efa40 service nova] Lock "050260e0-53e0-43dd-a301-a4e3e411f34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ffd92929-cc04-40f7-a109-084a64c21aba req-ad3e3931-cb74-4b75-8c56-f502617efa40 service nova] Lock "050260e0-53e0-43dd-a301-a4e3e411f34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:48 user nova-compute[72150]: DEBUG nova.compute.manager [req-ffd92929-cc04-40f7-a109-084a64c21aba req-ad3e3931-cb74-4b75-8c56-f502617efa40 service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] No waiting events found dispatching network-vif-plugged-c82387ba-7cc9-4eac-9469-021c80c1c195 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:21:48 user nova-compute[72150]: WARNING nova.compute.manager [req-ffd92929-cc04-40f7-a109-084a64c21aba req-ad3e3931-cb74-4b75-8c56-f502617efa40 service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Received unexpected event network-vif-plugged-c82387ba-7cc9-4eac-9469-021c80c1c195 for instance with vm_state building and task_state spawning.
Aug 01 18:21:49 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914109.1242003, 050260e0-53e0-43dd-a301-a4e3e411f34d => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:21:49 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] VM Resumed (Lifecycle Event)
Aug 01 18:21:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:21:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:21:49 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Instance spawned successfully.
Aug 01 18:21:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:21:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:21:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:21:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:21:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:21:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:21:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:21:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:21:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:21:49 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:21:49 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914109.1245246, 050260e0-53e0-43dd-a301-a4e3e411f34d => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:21:49 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] VM Started (Lifecycle Event)
Aug 01 18:21:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:21:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:21:49 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:21:49 user nova-compute[72150]: INFO nova.compute.manager [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Took 10.36 seconds to spawn the instance on the hypervisor.
Aug 01 18:21:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:21:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:49 user nova-compute[72150]: INFO nova.compute.manager [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Took 11.21 seconds to build instance.
Aug 01 18:21:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5b43ad7c-e8e8-42ad-bea1-b679a0cf12fb tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "050260e0-53e0-43dd-a301-a4e3e411f34d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.365s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Acquiring lock "554b19ce-2ea6-4494-bdd9-a02444ca920e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:21:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:55 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:21:55 user nova-compute[72150]: INFO nova.compute.claims [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Claim successful on node user
Aug 01 18:21:55 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:21:55 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:21:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:55 user nova-compute[72150]: DEBUG nova.compute.manager [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:21:55 user nova-compute[72150]: DEBUG nova.compute.manager [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:21:55 user nova-compute[72150]: DEBUG nova.network.neutron [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:21:55 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:21:55 user nova-compute[72150]: DEBUG nova.compute.manager [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:21:55 user nova-compute[72150]: DEBUG nova.policy [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82554fe6d3e8493dad052be11ea1f30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914ef466b8524705868c2049eef686d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG nova.compute.manager [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:21:56 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Creating image(s)
Aug 01 18:21:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Acquiring lock "/opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "/opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "/opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.175s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.157s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk 1073741824" returned: 0 in 0.079s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.203s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Checking if we can resize image /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Cannot resize image /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG nova.objects.instance [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lazy-loading 'migration_context' on Instance uuid 554b19ce-2ea6-4494-bdd9-a02444ca920e {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG nova.network.neutron [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Successfully created port: ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Ensure instance console log exists: /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.network.neutron [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Successfully updated port: ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Acquiring lock "refresh_cache-554b19ce-2ea6-4494-bdd9-a02444ca920e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Acquired lock "refresh_cache-554b19ce-2ea6-4494-bdd9-a02444ca920e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.network.neutron [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-4945cd5a-7236-4f57-941f-428dd53e3f04 req-2859cb1b-9ca8-4a16-8130-6fa289ab7c19 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Received event network-changed-ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-4945cd5a-7236-4f57-941f-428dd53e3f04 req-2859cb1b-9ca8-4a16-8130-6fa289ab7c19 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Refreshing instance network info cache due to event network-changed-ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4945cd5a-7236-4f57-941f-428dd53e3f04 req-2859cb1b-9ca8-4a16-8130-6fa289ab7c19 service nova] Acquiring lock "refresh_cache-554b19ce-2ea6-4494-bdd9-a02444ca920e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.network.neutron [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.network.neutron [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Updating instance_info_cache with network_info: [{"id": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "address": "fa:16:3e:16:e2:2d", "network": {"id": "b006b5b5-51ee-476d-93d1-0f7c510088da", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1317073326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdd368e-4d", "ovs_interfaceid": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Releasing lock "refresh_cache-554b19ce-2ea6-4494-bdd9-a02444ca920e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Instance network_info: |[{"id": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "address": "fa:16:3e:16:e2:2d", "network": {"id": "b006b5b5-51ee-476d-93d1-0f7c510088da", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1317073326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdd368e-4d", "ovs_interfaceid": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4945cd5a-7236-4f57-941f-428dd53e3f04 req-2859cb1b-9ca8-4a16-8130-6fa289ab7c19 service nova] Acquired lock "refresh_cache-554b19ce-2ea6-4494-bdd9-a02444ca920e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.network.neutron [req-4945cd5a-7236-4f57-941f-428dd53e3f04 req-2859cb1b-9ca8-4a16-8130-6fa289ab7c19 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Refreshing network info cache for port ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Start _get_guest_xml network_info=[{"id": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "address": "fa:16:3e:16:e2:2d", "network": {"id": "b006b5b5-51ee-476d-93d1-0f7c510088da", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1317073326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdd368e-4d", "ovs_interfaceid": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:21:58 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:21:58 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:21:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-394626827',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-394626827',id=4,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGka8LdSLmSpjhTZLxRAxtcPMCKQajuZ77ZSdnGv3Wn3uuB5MQyyWWolkbZ67FX8/Xq0MR4R0cch8xeVC596/BP8zPK2w+Y90ycK77u4iqCmTXKKtZgqFB/uHq/hsiFKmg==',key_name='tempest-keypair-1974078877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='914ef466b8524705868c2049eef686d6',ramdisk_id='',reservation_id='r-tmr2ov96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1401298341',owner_user_name='tempest-TaggedAttachmentsTest-1401298341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:21:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82554fe6d3e8493dad052be11ea1f30b',uuid=554b19ce-2ea6-4494-bdd9-a02444ca920e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "address": "fa:16:3e:16:e2:2d", "network": {"id": "b006b5b5-51ee-476d-93d1-0f7c510088da", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1317073326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdd368e-4d", "ovs_interfaceid": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Converting VIF {"id": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "address": "fa:16:3e:16:e2:2d", "network": {"id": "b006b5b5-51ee-476d-93d1-0f7c510088da", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1317073326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdd368e-4d", "ovs_interfaceid": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:e2:2d,bridge_name='br-int',has_traffic_filtering=True,id=ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a,network=Network(b006b5b5-51ee-476d-93d1-0f7c510088da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecdd368e-4d') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.objects.instance [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lazy-loading 'pci_devices' on Instance uuid 554b19ce-2ea6-4494-bdd9-a02444ca920e {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:21:58 user nova-compute[72150]:   <uuid>554b19ce-2ea6-4494-bdd9-a02444ca920e</uuid>
Aug 01 18:21:58 user nova-compute[72150]:   <name>instance-00000004</name>
Aug 01 18:21:58 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:21:58 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:21:58 user nova-compute[72150]:   <metadata>
Aug 01 18:21:58 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:21:58 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:21:58 user nova-compute[72150]:       <nova:name>tempest-device-tagging-server-394626827</nova:name>
Aug 01 18:21:58 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:21:58</nova:creationTime>
Aug 01 18:21:58 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:21:58 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:21:58 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:21:58 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:21:58 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:21:58 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:21:58 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:21:58 user nova-compute[72150]:       <nova:owner>
Aug 01 18:21:58 user nova-compute[72150]:         <nova:user uuid="82554fe6d3e8493dad052be11ea1f30b">tempest-TaggedAttachmentsTest-1401298341-project-member</nova:user>
Aug 01 18:21:58 user nova-compute[72150]:         <nova:project uuid="914ef466b8524705868c2049eef686d6">tempest-TaggedAttachmentsTest-1401298341</nova:project>
Aug 01 18:21:58 user nova-compute[72150]:       </nova:owner>
Aug 01 18:21:58 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:21:58 user nova-compute[72150]:       <nova:ports>
Aug 01 18:21:58 user nova-compute[72150]:         <nova:port uuid="ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a">
Aug 01 18:21:58 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 18:21:58 user nova-compute[72150]:         </nova:port>
Aug 01 18:21:58 user nova-compute[72150]:       </nova:ports>
Aug 01 18:21:58 user nova-compute[72150]:     </nova:instance>
Aug 01 18:21:58 user nova-compute[72150]:   </metadata>
Aug 01 18:21:58 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:21:58 user nova-compute[72150]:     <system>
Aug 01 18:21:58 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:21:58 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:21:58 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:21:58 user nova-compute[72150]:       <entry name="serial">554b19ce-2ea6-4494-bdd9-a02444ca920e</entry>
Aug 01 18:21:58 user nova-compute[72150]:       <entry name="uuid">554b19ce-2ea6-4494-bdd9-a02444ca920e</entry>
Aug 01 18:21:58 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:21:58 user nova-compute[72150]:     </system>
Aug 01 18:21:58 user nova-compute[72150]:   </sysinfo>
Aug 01 18:21:58 user nova-compute[72150]:   <os>
Aug 01 18:21:58 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:21:58 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:21:58 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:21:58 user nova-compute[72150]:   </os>
Aug 01 18:21:58 user nova-compute[72150]:   <features>
Aug 01 18:21:58 user nova-compute[72150]:     <acpi/>
Aug 01 18:21:58 user nova-compute[72150]:     <apic/>
Aug 01 18:21:58 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:21:58 user nova-compute[72150]:   </features>
Aug 01 18:21:58 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:21:58 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:21:58 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:21:58 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:21:58 user nova-compute[72150]:   </clock>
Aug 01 18:21:58 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:21:58 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:21:58 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:21:58 user nova-compute[72150]:   </cpu>
Aug 01 18:21:58 user nova-compute[72150]:   <devices>
Aug 01 18:21:58 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:21:58 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:21:58 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk"/>
Aug 01 18:21:58 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:21:58 user nova-compute[72150]:     </disk>
Aug 01 18:21:58 user nova-compute[72150]:     <disk type="file" device="cdrom">
Aug 01 18:21:58 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 18:21:58 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk.config"/>
Aug 01 18:21:58 user nova-compute[72150]:       <target dev="hda" bus="ide"/>
Aug 01 18:21:58 user nova-compute[72150]:     </disk>
Aug 01 18:21:58 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:21:58 user nova-compute[72150]:       <mac address="fa:16:3e:16:e2:2d"/>
Aug 01 18:21:58 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:21:58 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:21:58 user nova-compute[72150]:       <target dev="tapecdd368e-4d"/>
Aug 01 18:21:58 user nova-compute[72150]:     </interface>
Aug 01 18:21:58 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:21:58 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/console.log" append="off"/>
Aug 01 18:21:58 user nova-compute[72150]:     </serial>
Aug 01 18:21:58 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:21:58 user nova-compute[72150]:     <video>
Aug 01 18:21:58 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:21:58 user nova-compute[72150]:     </video>
Aug 01 18:21:58 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:21:58 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:21:58 user nova-compute[72150]:     </rng>
Aug 01 18:21:58 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:21:58 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:21:58 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:21:58 user nova-compute[72150]:     </memballoon>
Aug 01 18:21:58 user nova-compute[72150]:   </devices>
Aug 01 18:21:58 user nova-compute[72150]: </domain>
Aug 01 18:21:58 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:21:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-394626827',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-394626827',id=4,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGka8LdSLmSpjhTZLxRAxtcPMCKQajuZ77ZSdnGv3Wn3uuB5MQyyWWolkbZ67FX8/Xq0MR4R0cch8xeVC596/BP8zPK2w+Y90ycK77u4iqCmTXKKtZgqFB/uHq/hsiFKmg==',key_name='tempest-keypair-1974078877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='914ef466b8524705868c2049eef686d6',ramdisk_id='',reservation_id='r-tmr2ov96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1401298341',owner_user_name='tempest-TaggedAttachmentsTest-1401298341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:21:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82554fe6d3e8493dad052be11ea1f30b',uuid=554b19ce-2ea6-4494-bdd9-a02444ca920e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "address": "fa:16:3e:16:e2:2d", "network": {"id": "b006b5b5-51ee-476d-93d1-0f7c510088da", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1317073326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdd368e-4d", "ovs_interfaceid": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Converting VIF {"id": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "address": "fa:16:3e:16:e2:2d", "network": {"id": "b006b5b5-51ee-476d-93d1-0f7c510088da", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1317073326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdd368e-4d", "ovs_interfaceid": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:e2:2d,bridge_name='br-int',has_traffic_filtering=True,id=ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a,network=Network(b006b5b5-51ee-476d-93d1-0f7c510088da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecdd368e-4d') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG os_vif [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:e2:2d,bridge_name='br-int',has_traffic_filtering=True,id=ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a,network=Network(b006b5b5-51ee-476d-93d1-0f7c510088da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecdd368e-4d') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecdd368e-4d, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapecdd368e-4d, col_values=(('external_ids', {'iface-id': 'ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:e2:2d', 'vm-uuid': '554b19ce-2ea6-4494-bdd9-a02444ca920e'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:21:58 user nova-compute[72150]: INFO os_vif [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:e2:2d,bridge_name='br-int',has_traffic_filtering=True,id=ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a,network=Network(b006b5b5-51ee-476d-93d1-0f7c510088da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecdd368e-4d')
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] No BDM found with device name hda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:21:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] No VIF found with MAC fa:16:3e:16:e2:2d, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:21:58 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Using config drive
Aug 01 18:21:59 user nova-compute[72150]: DEBUG nova.network.neutron [req-4945cd5a-7236-4f57-941f-428dd53e3f04 req-2859cb1b-9ca8-4a16-8130-6fa289ab7c19 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Updated VIF entry in instance network info cache for port ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:21:59 user nova-compute[72150]: DEBUG nova.network.neutron [req-4945cd5a-7236-4f57-941f-428dd53e3f04 req-2859cb1b-9ca8-4a16-8130-6fa289ab7c19 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Updating instance_info_cache with network_info: [{"id": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "address": "fa:16:3e:16:e2:2d", "network": {"id": "b006b5b5-51ee-476d-93d1-0f7c510088da", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1317073326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdd368e-4d", "ovs_interfaceid": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:21:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4945cd5a-7236-4f57-941f-428dd53e3f04 req-2859cb1b-9ca8-4a16-8130-6fa289ab7c19 service nova] Releasing lock "refresh_cache-554b19ce-2ea6-4494-bdd9-a02444ca920e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:21:59 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Creating config drive at /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk.config
Aug 01 18:21:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvilkh4dd {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:21:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Acquiring lock "161fa35c-1f33-4ea7-94a9-c3b78952155e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "161fa35c-1f33-4ea7-94a9-c3b78952155e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvilkh4dd" returned: 0 in 0.068s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:21:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:21:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:21:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:21:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:21:59 user nova-compute[72150]: INFO nova.compute.claims [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Claim successful on node user
Aug 01 18:22:00 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:22:00 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:22:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.709s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:00 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:22:00 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:22:00 user nova-compute[72150]: DEBUG nova.network.neutron [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:22:00 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 01 18:22:00 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:22:00 user nova-compute[72150]: DEBUG nova.policy [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a704b33afa884146b6c55f6dd8534db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac43f7be3cd43368a5c03411059c933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:22:00 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:22:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:22:00 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Creating image(s)
Aug 01 18:22:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Acquiring lock "/opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "/opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "/opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Acquiring lock "1f4244bd4e4c319d80d9307e030539d056aecc5f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "1f4244bd4e4c319d80d9307e030539d056aecc5f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f4244bd4e4c319d80d9307e030539d056aecc5f.part --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f4244bd4e4c319d80d9307e030539d056aecc5f.part --force-share --output=json" returned: 0 in 0.237s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:01 user nova-compute[72150]: DEBUG nova.virt.images [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] 120c1fb6-662b-491f-ac88-bd1183481042 was qcow2, converting to raw {{(pid=72150) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 18:22:01 user nova-compute[72150]: DEBUG nova.privsep.utils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72150) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 18:22:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1f4244bd4e4c319d80d9307e030539d056aecc5f.part /opt/stack/data/nova/instances/_base/1f4244bd4e4c319d80d9307e030539d056aecc5f.converted {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1f4244bd4e4c319d80d9307e030539d056aecc5f.part /opt/stack/data/nova/instances/_base/1f4244bd4e4c319d80d9307e030539d056aecc5f.converted" returned: 0 in 0.322s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f4244bd4e4c319d80d9307e030539d056aecc5f.converted --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:02 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f4244bd4e4c319d80d9307e030539d056aecc5f.converted --force-share --output=json" returned: 0 in 0.228s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "1f4244bd4e4c319d80d9307e030539d056aecc5f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.400s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:02 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f4244bd4e4c319d80d9307e030539d056aecc5f --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:02 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f4244bd4e4c319d80d9307e030539d056aecc5f --force-share --output=json" returned: 0 in 0.214s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Acquiring lock "1f4244bd4e4c319d80d9307e030539d056aecc5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "1f4244bd4e4c319d80d9307e030539d056aecc5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:02 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f4244bd4e4c319d80d9307e030539d056aecc5f --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:02 user nova-compute[72150]: DEBUG nova.compute.manager [req-ec8fea7e-e2ca-45a5-98e6-218645088f8b req-ffec514c-dd7f-49b2-8e18-ac4c4f207edd service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Received event network-vif-plugged-ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:22:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ec8fea7e-e2ca-45a5-98e6-218645088f8b req-ffec514c-dd7f-49b2-8e18-ac4c4f207edd service nova] Acquiring lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ec8fea7e-e2ca-45a5-98e6-218645088f8b req-ffec514c-dd7f-49b2-8e18-ac4c4f207edd service nova] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ec8fea7e-e2ca-45a5-98e6-218645088f8b req-ffec514c-dd7f-49b2-8e18-ac4c4f207edd service nova] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:02 user nova-compute[72150]: DEBUG nova.compute.manager [req-ec8fea7e-e2ca-45a5-98e6-218645088f8b req-ffec514c-dd7f-49b2-8e18-ac4c4f207edd service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] No waiting events found dispatching network-vif-plugged-ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:22:02 user nova-compute[72150]: WARNING nova.compute.manager [req-ec8fea7e-e2ca-45a5-98e6-218645088f8b req-ffec514c-dd7f-49b2-8e18-ac4c4f207edd service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Received unexpected event network-vif-plugged-ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a for instance with vm_state building and task_state spawning.
Aug 01 18:22:02 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f4244bd4e4c319d80d9307e030539d056aecc5f --force-share --output=json" returned: 0 in 0.230s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:02 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1f4244bd4e4c319d80d9307e030539d056aecc5f,backing_fmt=raw /opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:02 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1f4244bd4e4c319d80d9307e030539d056aecc5f,backing_fmt=raw /opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/disk 1073741824" returned: 0 in 0.071s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "1f4244bd4e4c319d80d9307e030539d056aecc5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:02 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f4244bd4e4c319d80d9307e030539d056aecc5f --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:02 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f4244bd4e4c319d80d9307e030539d056aecc5f --force-share --output=json" returned: 0 in 0.274s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:02 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Checking if we can resize image /opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:22:02 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:02 user nova-compute[72150]: DEBUG nova.network.neutron [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Successfully created port: 60b7ef01-f473-4729-8863-446ced3b583a {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:22:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:03 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Cannot resize image /opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:22:03 user nova-compute[72150]: DEBUG nova.objects.instance [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lazy-loading 'migration_context' on Instance uuid 161fa35c-1f33-4ea7-94a9-c3b78952155e {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:22:03 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:22:03 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Ensure instance console log exists: /opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:22:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.network.neutron [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Successfully updated port: 60b7ef01-f473-4729-8863-446ced3b583a {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Acquiring lock "refresh_cache-161fa35c-1f33-4ea7-94a9-c3b78952155e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Acquired lock "refresh_cache-161fa35c-1f33-4ea7-94a9-c3b78952155e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.network.neutron [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.network.neutron [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914124.3184328, 554b19ce-2ea6-4494-bdd9-a02444ca920e => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:22:04 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] VM Resumed (Lifecycle Event)
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:22:04 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Instance spawned successfully.
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:22:04 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914124.3276062, 554b19ce-2ea6-4494-bdd9-a02444ca920e => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:22:04 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] VM Started (Lifecycle Event)
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.compute.manager [req-18fe3794-1990-4958-8666-a018658900a1 req-a7c7d58c-a13c-42a0-90fd-ce61f20a3078 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Received event network-vif-plugged-ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-18fe3794-1990-4958-8666-a018658900a1 req-a7c7d58c-a13c-42a0-90fd-ce61f20a3078 service nova] Acquiring lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-18fe3794-1990-4958-8666-a018658900a1 req-a7c7d58c-a13c-42a0-90fd-ce61f20a3078 service nova] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-18fe3794-1990-4958-8666-a018658900a1 req-a7c7d58c-a13c-42a0-90fd-ce61f20a3078 service nova] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.compute.manager [req-18fe3794-1990-4958-8666-a018658900a1 req-a7c7d58c-a13c-42a0-90fd-ce61f20a3078 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] No waiting events found dispatching network-vif-plugged-ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:22:04 user nova-compute[72150]: WARNING nova.compute.manager [req-18fe3794-1990-4958-8666-a018658900a1 req-a7c7d58c-a13c-42a0-90fd-ce61f20a3078 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Received unexpected event network-vif-plugged-ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a for instance with vm_state building and task_state spawning.
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.compute.manager [req-18fe3794-1990-4958-8666-a018658900a1 req-a7c7d58c-a13c-42a0-90fd-ce61f20a3078 service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Received event network-changed-60b7ef01-f473-4729-8863-446ced3b583a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.compute.manager [req-18fe3794-1990-4958-8666-a018658900a1 req-a7c7d58c-a13c-42a0-90fd-ce61f20a3078 service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Refreshing instance network info cache due to event network-changed-60b7ef01-f473-4729-8863-446ced3b583a. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-18fe3794-1990-4958-8666-a018658900a1 req-a7c7d58c-a13c-42a0-90fd-ce61f20a3078 service nova] Acquiring lock "refresh_cache-161fa35c-1f33-4ea7-94a9-c3b78952155e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:22:04 user nova-compute[72150]: INFO nova.compute.manager [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Took 8.40 seconds to spawn the instance on the hypervisor.
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:22:04 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:22:04 user nova-compute[72150]: INFO nova.compute.manager [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Took 9.57 seconds to build instance.
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.network.neutron [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Updating instance_info_cache with network_info: [{"id": "60b7ef01-f473-4729-8863-446ced3b583a", "address": "fa:16:3e:fb:db:7f", "network": {"id": "1d6b993c-de21-483f-9a8a-609bf15eb582", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1811936764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac43f7be3cd43368a5c03411059c933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b7ef01-f4", "ovs_interfaceid": "60b7ef01-f473-4729-8863-446ced3b583a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Releasing lock "refresh_cache-161fa35c-1f33-4ea7-94a9-c3b78952155e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Instance network_info: |[{"id": "60b7ef01-f473-4729-8863-446ced3b583a", "address": "fa:16:3e:fb:db:7f", "network": {"id": "1d6b993c-de21-483f-9a8a-609bf15eb582", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1811936764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac43f7be3cd43368a5c03411059c933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b7ef01-f4", "ovs_interfaceid": "60b7ef01-f473-4729-8863-446ced3b583a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-18fe3794-1990-4958-8666-a018658900a1 req-a7c7d58c-a13c-42a0-90fd-ce61f20a3078 service nova] Acquired lock "refresh_cache-161fa35c-1f33-4ea7-94a9-c3b78952155e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.network.neutron [req-18fe3794-1990-4958-8666-a018658900a1 req-a7c7d58c-a13c-42a0-90fd-ce61f20a3078 service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Refreshing network info cache for port 60b7ef01-f473-4729-8863-446ced3b583a {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Start _get_guest_xml network_info=[{"id": "60b7ef01-f473-4729-8863-446ced3b583a", "address": "fa:16:3e:fb:db:7f", "network": {"id": "1d6b993c-de21-483f-9a8a-609bf15eb582", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1811936764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac43f7be3cd43368a5c03411059c933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b7ef01-f4", "ovs_interfaceid": "60b7ef01-f473-4729-8863-446ced3b583a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:21:52Z,direct_url=<?>,disk_format='qcow2',id=120c1fb6-662b-491f-ac88-bd1183481042,min_disk=0,min_ram=0,name='',owner='bc63b728637144ac927b1a0d67a949e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:21:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'image_id': '120c1fb6-662b-491f-ac88-bd1183481042'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc46f6b0-9116-46ed-8dc6-cd02296a0e2d tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.745s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:04 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:22:04 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:21:52Z,direct_url=<?>,disk_format='qcow2',id=120c1fb6-662b-491f-ac88-bd1183481042,min_disk=0,min_ram=0,name='',owner='bc63b728637144ac927b1a0d67a949e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:21:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:21:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1586121735',display_name='tempest-AttachSCSIVolumeTestJSON-server-1586121735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1586121735',id=5,image_ref='120c1fb6-662b-491f-ac88-bd1183481042',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH3hSaVqi10VPaXTMPUbv5vCl8GKYGKxRwmnL/rhXtfzbY8ZMIH7zzEYYoAAcheJRRmQLt2lz6E7TQKvLAtflAjlsZTrVU6yjGkm1aF9RmpeRzUjnSXyxzmGvMkEDV1Pw==',key_name='tempest-keypair-1236896563',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dac43f7be3cd43368a5c03411059c933',ramdisk_id='',reservation_id='r-y86to474',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='120c1fb6-662b-491f-ac88-bd1183481042',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1328185242',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1328185242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:22:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a704b33afa884146b6c55f6dd8534db0',uuid=161fa35c-1f33-4ea7-94a9-c3b78952155e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60b7ef01-f473-4729-8863-446ced3b583a", "address": "fa:16:3e:fb:db:7f", "network": {"id": "1d6b993c-de21-483f-9a8a-609bf15eb582", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1811936764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac43f7be3cd43368a5c03411059c933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b7ef01-f4", "ovs_interfaceid": "60b7ef01-f473-4729-8863-446ced3b583a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Converting VIF {"id": "60b7ef01-f473-4729-8863-446ced3b583a", "address": "fa:16:3e:fb:db:7f", "network": {"id": "1d6b993c-de21-483f-9a8a-609bf15eb582", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1811936764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac43f7be3cd43368a5c03411059c933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b7ef01-f4", "ovs_interfaceid": "60b7ef01-f473-4729-8863-446ced3b583a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:db:7f,bridge_name='br-int',has_traffic_filtering=True,id=60b7ef01-f473-4729-8863-446ced3b583a,network=Network(1d6b993c-de21-483f-9a8a-609bf15eb582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b7ef01-f4') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.objects.instance [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lazy-loading 'pci_devices' on Instance uuid 161fa35c-1f33-4ea7-94a9-c3b78952155e {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:22:04 user nova-compute[72150]:   <uuid>161fa35c-1f33-4ea7-94a9-c3b78952155e</uuid>
Aug 01 18:22:04 user nova-compute[72150]:   <name>instance-00000005</name>
Aug 01 18:22:04 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:22:04 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:22:04 user nova-compute[72150]:   <metadata>
Aug 01 18:22:04 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:22:04 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:22:04 user nova-compute[72150]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1586121735</nova:name>
Aug 01 18:22:04 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:22:04</nova:creationTime>
Aug 01 18:22:04 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:22:04 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:22:04 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:22:04 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:22:04 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:22:04 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:22:04 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:22:04 user nova-compute[72150]:       <nova:owner>
Aug 01 18:22:04 user nova-compute[72150]:         <nova:user uuid="a704b33afa884146b6c55f6dd8534db0">tempest-AttachSCSIVolumeTestJSON-1328185242-project-member</nova:user>
Aug 01 18:22:04 user nova-compute[72150]:         <nova:project uuid="dac43f7be3cd43368a5c03411059c933">tempest-AttachSCSIVolumeTestJSON-1328185242</nova:project>
Aug 01 18:22:04 user nova-compute[72150]:       </nova:owner>
Aug 01 18:22:04 user nova-compute[72150]:       <nova:root type="image" uuid="120c1fb6-662b-491f-ac88-bd1183481042"/>
Aug 01 18:22:04 user nova-compute[72150]:       <nova:ports>
Aug 01 18:22:04 user nova-compute[72150]:         <nova:port uuid="60b7ef01-f473-4729-8863-446ced3b583a">
Aug 01 18:22:04 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 18:22:04 user nova-compute[72150]:         </nova:port>
Aug 01 18:22:04 user nova-compute[72150]:       </nova:ports>
Aug 01 18:22:04 user nova-compute[72150]:     </nova:instance>
Aug 01 18:22:04 user nova-compute[72150]:   </metadata>
Aug 01 18:22:04 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:22:04 user nova-compute[72150]:     <system>
Aug 01 18:22:04 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:22:04 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:22:04 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:22:04 user nova-compute[72150]:       <entry name="serial">161fa35c-1f33-4ea7-94a9-c3b78952155e</entry>
Aug 01 18:22:04 user nova-compute[72150]:       <entry name="uuid">161fa35c-1f33-4ea7-94a9-c3b78952155e</entry>
Aug 01 18:22:04 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:22:04 user nova-compute[72150]:     </system>
Aug 01 18:22:04 user nova-compute[72150]:   </sysinfo>
Aug 01 18:22:04 user nova-compute[72150]:   <os>
Aug 01 18:22:04 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:22:04 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:22:04 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:22:04 user nova-compute[72150]:   </os>
Aug 01 18:22:04 user nova-compute[72150]:   <features>
Aug 01 18:22:04 user nova-compute[72150]:     <acpi/>
Aug 01 18:22:04 user nova-compute[72150]:     <apic/>
Aug 01 18:22:04 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:22:04 user nova-compute[72150]:   </features>
Aug 01 18:22:04 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:22:04 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:22:04 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:22:04 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:22:04 user nova-compute[72150]:   </clock>
Aug 01 18:22:04 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:22:04 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:22:04 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:22:04 user nova-compute[72150]:   </cpu>
Aug 01 18:22:04 user nova-compute[72150]:   <devices>
Aug 01 18:22:04 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:22:04 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:22:04 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/disk"/>
Aug 01 18:22:04 user nova-compute[72150]:       <target dev="sda" bus="scsi"/>
Aug 01 18:22:04 user nova-compute[72150]:       <address type="drive" controller="0" unit="0"/>
Aug 01 18:22:04 user nova-compute[72150]:     </disk>
Aug 01 18:22:04 user nova-compute[72150]:     <disk type="file" device="cdrom">
Aug 01 18:22:04 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 18:22:04 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/disk.config"/>
Aug 01 18:22:04 user nova-compute[72150]:       <target dev="sdb" bus="scsi"/>
Aug 01 18:22:04 user nova-compute[72150]:       <address type="drive" controller="0" unit="1"/>
Aug 01 18:22:04 user nova-compute[72150]:     </disk>
Aug 01 18:22:04 user nova-compute[72150]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 01 18:22:04 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:22:04 user nova-compute[72150]:       <mac address="fa:16:3e:fb:db:7f"/>
Aug 01 18:22:04 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:22:04 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:22:04 user nova-compute[72150]:       <target dev="tap60b7ef01-f4"/>
Aug 01 18:22:04 user nova-compute[72150]:     </interface>
Aug 01 18:22:04 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:22:04 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/console.log" append="off"/>
Aug 01 18:22:04 user nova-compute[72150]:     </serial>
Aug 01 18:22:04 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:22:04 user nova-compute[72150]:     <video>
Aug 01 18:22:04 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:22:04 user nova-compute[72150]:     </video>
Aug 01 18:22:04 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:22:04 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:22:04 user nova-compute[72150]:     </rng>
Aug 01 18:22:04 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:22:04 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:22:04 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:22:04 user nova-compute[72150]:     </memballoon>
Aug 01 18:22:04 user nova-compute[72150]:   </devices>
Aug 01 18:22:04 user nova-compute[72150]: </domain>
Aug 01 18:22:04 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:21:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1586121735',display_name='tempest-AttachSCSIVolumeTestJSON-server-1586121735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1586121735',id=5,image_ref='120c1fb6-662b-491f-ac88-bd1183481042',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH3hSaVqi10VPaXTMPUbv5vCl8GKYGKxRwmnL/rhXtfzbY8ZMIH7zzEYYoAAcheJRRmQLt2lz6E7TQKvLAtflAjlsZTrVU6yjGkm1aF9RmpeRzUjnSXyxzmGvMkEDV1Pw==',key_name='tempest-keypair-1236896563',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dac43f7be3cd43368a5c03411059c933',ramdisk_id='',reservation_id='r-y86to474',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='120c1fb6-662b-491f-ac88-bd1183481042',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1328185242',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1328185242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:22:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a704b33afa884146b6c55f6dd8534db0',uuid=161fa35c-1f33-4ea7-94a9-c3b78952155e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60b7ef01-f473-4729-8863-446ced3b583a", "address": "fa:16:3e:fb:db:7f", "network": {"id": "1d6b993c-de21-483f-9a8a-609bf15eb582", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1811936764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac43f7be3cd43368a5c03411059c933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b7ef01-f4", "ovs_interfaceid": "60b7ef01-f473-4729-8863-446ced3b583a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Converting VIF {"id": "60b7ef01-f473-4729-8863-446ced3b583a", "address": "fa:16:3e:fb:db:7f", "network": {"id": "1d6b993c-de21-483f-9a8a-609bf15eb582", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1811936764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac43f7be3cd43368a5c03411059c933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b7ef01-f4", "ovs_interfaceid": "60b7ef01-f473-4729-8863-446ced3b583a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:db:7f,bridge_name='br-int',has_traffic_filtering=True,id=60b7ef01-f473-4729-8863-446ced3b583a,network=Network(1d6b993c-de21-483f-9a8a-609bf15eb582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b7ef01-f4') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG os_vif [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:db:7f,bridge_name='br-int',has_traffic_filtering=True,id=60b7ef01-f473-4729-8863-446ced3b583a,network=Network(1d6b993c-de21-483f-9a8a-609bf15eb582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b7ef01-f4') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60b7ef01-f4, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap60b7ef01-f4, col_values=(('external_ids', {'iface-id': '60b7ef01-f473-4729-8863-446ced3b583a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:db:7f', 'vm-uuid': '161fa35c-1f33-4ea7-94a9-c3b78952155e'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:04 user nova-compute[72150]: INFO os_vif [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:db:7f,bridge_name='br-int',has_traffic_filtering=True,id=60b7ef01-f473-4729-8863-446ced3b583a,network=Network(1d6b993c-de21-483f-9a8a-609bf15eb582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b7ef01-f4')
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] No BDM found with device name sda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:22:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] No VIF found with MAC fa:16:3e:fb:db:7f, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:22:04 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Using config drive
Aug 01 18:22:05 user nova-compute[72150]: DEBUG nova.network.neutron [req-18fe3794-1990-4958-8666-a018658900a1 req-a7c7d58c-a13c-42a0-90fd-ce61f20a3078 service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Updated VIF entry in instance network info cache for port 60b7ef01-f473-4729-8863-446ced3b583a. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:22:05 user nova-compute[72150]: DEBUG nova.network.neutron [req-18fe3794-1990-4958-8666-a018658900a1 req-a7c7d58c-a13c-42a0-90fd-ce61f20a3078 service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Updating instance_info_cache with network_info: [{"id": "60b7ef01-f473-4729-8863-446ced3b583a", "address": "fa:16:3e:fb:db:7f", "network": {"id": "1d6b993c-de21-483f-9a8a-609bf15eb582", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1811936764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac43f7be3cd43368a5c03411059c933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b7ef01-f4", "ovs_interfaceid": "60b7ef01-f473-4729-8863-446ced3b583a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:22:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-18fe3794-1990-4958-8666-a018658900a1 req-a7c7d58c-a13c-42a0-90fd-ce61f20a3078 service nova] Releasing lock "refresh_cache-161fa35c-1f33-4ea7-94a9-c3b78952155e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:22:05 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Creating config drive at /opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/disk.config
Aug 01 18:22:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpu13yblfw {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpu13yblfw" returned: 0 in 0.065s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Acquiring lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:06 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:22:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:06 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:22:06 user nova-compute[72150]: INFO nova.compute.claims [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Claim successful on node user
Aug 01 18:22:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:06 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:22:06 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG nova.network.neutron [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:22:07 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:22:07 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG nova.compute.manager [req-60684242-11f2-431c-91c9-d096bb47f374 req-ee3cb682-1d13-48af-9ab1-da90d9335434 service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Received event network-vif-plugged-60b7ef01-f473-4729-8863-446ced3b583a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-60684242-11f2-431c-91c9-d096bb47f374 req-ee3cb682-1d13-48af-9ab1-da90d9335434 service nova] Acquiring lock "161fa35c-1f33-4ea7-94a9-c3b78952155e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-60684242-11f2-431c-91c9-d096bb47f374 req-ee3cb682-1d13-48af-9ab1-da90d9335434 service nova] Lock "161fa35c-1f33-4ea7-94a9-c3b78952155e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-60684242-11f2-431c-91c9-d096bb47f374 req-ee3cb682-1d13-48af-9ab1-da90d9335434 service nova] Lock "161fa35c-1f33-4ea7-94a9-c3b78952155e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG nova.compute.manager [req-60684242-11f2-431c-91c9-d096bb47f374 req-ee3cb682-1d13-48af-9ab1-da90d9335434 service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] No waiting events found dispatching network-vif-plugged-60b7ef01-f473-4729-8863-446ced3b583a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:22:07 user nova-compute[72150]: WARNING nova.compute.manager [req-60684242-11f2-431c-91c9-d096bb47f374 req-ee3cb682-1d13-48af-9ab1-da90d9335434 service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Received unexpected event network-vif-plugged-60b7ef01-f473-4729-8863-446ced3b583a for instance with vm_state building and task_state spawning.
Aug 01 18:22:07 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:22:07 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Creating image(s)
Aug 01 18:22:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "/opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "/opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG nova.policy [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d068c0606cd411ca3b5641509825b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b8e37a30724a0186d9b7f126a46b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.190s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.156s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk 1073741824" returned: 0 in 0.059s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.198s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:08 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:22:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:08 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Cannot resize image /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:22:08 user nova-compute[72150]: DEBUG nova.objects.instance [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lazy-loading 'migration_context' on Instance uuid ad033976-bfc8-46b9-89bf-f752ae0cdf01 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:22:08 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:22:08 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Ensure instance console log exists: /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:22:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:08 user nova-compute[72150]: DEBUG nova.network.neutron [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Successfully created port: 8509ce7f-8cec-4926-a30d-5900fbddac8a {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:22:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:09 user nova-compute[72150]: DEBUG nova.compute.manager [req-e1a433fc-8964-41eb-b3f9-e799335da966 req-89d8010f-2e73-4c77-8af2-8c6ac2daed9e service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Received event network-vif-plugged-60b7ef01-f473-4729-8863-446ced3b583a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:22:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e1a433fc-8964-41eb-b3f9-e799335da966 req-89d8010f-2e73-4c77-8af2-8c6ac2daed9e service nova] Acquiring lock "161fa35c-1f33-4ea7-94a9-c3b78952155e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e1a433fc-8964-41eb-b3f9-e799335da966 req-89d8010f-2e73-4c77-8af2-8c6ac2daed9e service nova] Lock "161fa35c-1f33-4ea7-94a9-c3b78952155e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e1a433fc-8964-41eb-b3f9-e799335da966 req-89d8010f-2e73-4c77-8af2-8c6ac2daed9e service nova] Lock "161fa35c-1f33-4ea7-94a9-c3b78952155e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:09 user nova-compute[72150]: DEBUG nova.compute.manager [req-e1a433fc-8964-41eb-b3f9-e799335da966 req-89d8010f-2e73-4c77-8af2-8c6ac2daed9e service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] No waiting events found dispatching network-vif-plugged-60b7ef01-f473-4729-8863-446ced3b583a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:22:09 user nova-compute[72150]: WARNING nova.compute.manager [req-e1a433fc-8964-41eb-b3f9-e799335da966 req-89d8010f-2e73-4c77-8af2-8c6ac2daed9e service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Received unexpected event network-vif-plugged-60b7ef01-f473-4729-8863-446ced3b583a for instance with vm_state building and task_state spawning.
Aug 01 18:22:09 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914129.4399006, 161fa35c-1f33-4ea7-94a9-c3b78952155e => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:22:09 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] VM Resumed (Lifecycle Event)
Aug 01 18:22:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:22:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:22:09 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Instance spawned successfully.
Aug 01 18:22:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:22:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:22:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:22:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:22:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:22:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:22:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:22:09 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:22:09 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914129.440706, 161fa35c-1f33-4ea7-94a9-c3b78952155e => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:22:09 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] VM Started (Lifecycle Event)
Aug 01 18:22:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:22:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:22:09 user nova-compute[72150]: INFO nova.compute.manager [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Took 8.87 seconds to spawn the instance on the hypervisor.
Aug 01 18:22:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:22:09 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:22:09 user nova-compute[72150]: DEBUG nova.network.neutron [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Successfully updated port: 8509ce7f-8cec-4926-a30d-5900fbddac8a {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:22:09 user nova-compute[72150]: INFO nova.compute.manager [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Took 10.15 seconds to build instance.
Aug 01 18:22:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Acquiring lock "refresh_cache-ad033976-bfc8-46b9-89bf-f752ae0cdf01" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:22:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Acquired lock "refresh_cache-ad033976-bfc8-46b9-89bf-f752ae0cdf01" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:22:09 user nova-compute[72150]: DEBUG nova.network.neutron [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:22:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bfe163e2-ecec-479d-aaee-4cc1f9595a0f tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "161fa35c-1f33-4ea7-94a9-c3b78952155e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.277s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:09 user nova-compute[72150]: DEBUG nova.network.neutron [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:22:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.network.neutron [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Updating instance_info_cache with network_info: [{"id": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "address": "fa:16:3e:86:2e:4d", "network": {"id": "64d2a931-7450-40f4-827a-e54a5db845a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-125648202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b8e37a30724a0186d9b7f126a46b0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8509ce7f-8c", "ovs_interfaceid": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Releasing lock "refresh_cache-ad033976-bfc8-46b9-89bf-f752ae0cdf01" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Instance network_info: |[{"id": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "address": "fa:16:3e:86:2e:4d", "network": {"id": "64d2a931-7450-40f4-827a-e54a5db845a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-125648202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b8e37a30724a0186d9b7f126a46b0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8509ce7f-8c", "ovs_interfaceid": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Start _get_guest_xml network_info=[{"id": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "address": "fa:16:3e:86:2e:4d", "network": {"id": "64d2a931-7450-40f4-827a-e54a5db845a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-125648202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b8e37a30724a0186d9b7f126a46b0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8509ce7f-8c", "ovs_interfaceid": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:22:10 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:22:10 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-983852594',display_name='tempest-TestVolumeSwap-server-983852594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-983852594',id=6,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKN3UJDBvsSCDyxyiABJEe+o7rPvNztF+1CDAjZJdHP3OssRDUtMd4FG3xdPbLXlSgKzwOuj8SVkT3kqGEnKCNOj1qIXrc1OJPhlUiYwemnjTrNa9g73Dds3kAktpXYWg==',key_name='tempest-keypair-523819296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6b8e37a30724a0186d9b7f126a46b0d',ramdisk_id='',reservation_id='r-otyndced',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1013643713',owner_user_name='tempest-TestVolumeSwap-1013643713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d068c0606cd411ca3b5641509825b7b',uuid=ad033976-bfc8-46b9-89bf-f752ae0cdf01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "address": "fa:16:3e:86:2e:4d", "network": {"id": "64d2a931-7450-40f4-827a-e54a5db845a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-125648202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b8e37a30724a0186d9b7f126a46b0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8509ce7f-8c", "ovs_interfaceid": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Converting VIF {"id": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "address": "fa:16:3e:86:2e:4d", "network": {"id": "64d2a931-7450-40f4-827a-e54a5db845a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-125648202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b8e37a30724a0186d9b7f126a46b0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8509ce7f-8c", "ovs_interfaceid": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:2e:4d,bridge_name='br-int',has_traffic_filtering=True,id=8509ce7f-8cec-4926-a30d-5900fbddac8a,network=Network(64d2a931-7450-40f4-827a-e54a5db845a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8509ce7f-8c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.objects.instance [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lazy-loading 'pci_devices' on Instance uuid ad033976-bfc8-46b9-89bf-f752ae0cdf01 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:22:10 user nova-compute[72150]:   <uuid>ad033976-bfc8-46b9-89bf-f752ae0cdf01</uuid>
Aug 01 18:22:10 user nova-compute[72150]:   <name>instance-00000006</name>
Aug 01 18:22:10 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:22:10 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:22:10 user nova-compute[72150]:   <metadata>
Aug 01 18:22:10 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:22:10 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:22:10 user nova-compute[72150]:       <nova:name>tempest-TestVolumeSwap-server-983852594</nova:name>
Aug 01 18:22:10 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:22:10</nova:creationTime>
Aug 01 18:22:10 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:22:10 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:22:10 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:22:10 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:22:10 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:22:10 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:22:10 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:22:10 user nova-compute[72150]:       <nova:owner>
Aug 01 18:22:10 user nova-compute[72150]:         <nova:user uuid="3d068c0606cd411ca3b5641509825b7b">tempest-TestVolumeSwap-1013643713-project-member</nova:user>
Aug 01 18:22:10 user nova-compute[72150]:         <nova:project uuid="b6b8e37a30724a0186d9b7f126a46b0d">tempest-TestVolumeSwap-1013643713</nova:project>
Aug 01 18:22:10 user nova-compute[72150]:       </nova:owner>
Aug 01 18:22:10 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:22:10 user nova-compute[72150]:       <nova:ports>
Aug 01 18:22:10 user nova-compute[72150]:         <nova:port uuid="8509ce7f-8cec-4926-a30d-5900fbddac8a">
Aug 01 18:22:10 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 18:22:10 user nova-compute[72150]:         </nova:port>
Aug 01 18:22:10 user nova-compute[72150]:       </nova:ports>
Aug 01 18:22:10 user nova-compute[72150]:     </nova:instance>
Aug 01 18:22:10 user nova-compute[72150]:   </metadata>
Aug 01 18:22:10 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:22:10 user nova-compute[72150]:     <system>
Aug 01 18:22:10 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:22:10 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:22:10 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:22:10 user nova-compute[72150]:       <entry name="serial">ad033976-bfc8-46b9-89bf-f752ae0cdf01</entry>
Aug 01 18:22:10 user nova-compute[72150]:       <entry name="uuid">ad033976-bfc8-46b9-89bf-f752ae0cdf01</entry>
Aug 01 18:22:10 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:22:10 user nova-compute[72150]:     </system>
Aug 01 18:22:10 user nova-compute[72150]:   </sysinfo>
Aug 01 18:22:10 user nova-compute[72150]:   <os>
Aug 01 18:22:10 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:22:10 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:22:10 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:22:10 user nova-compute[72150]:   </os>
Aug 01 18:22:10 user nova-compute[72150]:   <features>
Aug 01 18:22:10 user nova-compute[72150]:     <acpi/>
Aug 01 18:22:10 user nova-compute[72150]:     <apic/>
Aug 01 18:22:10 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:22:10 user nova-compute[72150]:   </features>
Aug 01 18:22:10 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:22:10 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:22:10 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:22:10 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:22:10 user nova-compute[72150]:   </clock>
Aug 01 18:22:10 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:22:10 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:22:10 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:22:10 user nova-compute[72150]:   </cpu>
Aug 01 18:22:10 user nova-compute[72150]:   <devices>
Aug 01 18:22:10 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:22:10 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:22:10 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk"/>
Aug 01 18:22:10 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:22:10 user nova-compute[72150]:     </disk>
Aug 01 18:22:10 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:22:10 user nova-compute[72150]:       <mac address="fa:16:3e:86:2e:4d"/>
Aug 01 18:22:10 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:22:10 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:22:10 user nova-compute[72150]:       <target dev="tap8509ce7f-8c"/>
Aug 01 18:22:10 user nova-compute[72150]:     </interface>
Aug 01 18:22:10 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:22:10 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/console.log" append="off"/>
Aug 01 18:22:10 user nova-compute[72150]:     </serial>
Aug 01 18:22:10 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:22:10 user nova-compute[72150]:     <video>
Aug 01 18:22:10 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:22:10 user nova-compute[72150]:     </video>
Aug 01 18:22:10 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:22:10 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:22:10 user nova-compute[72150]:     </rng>
Aug 01 18:22:10 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:22:10 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:22:10 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:22:10 user nova-compute[72150]:     </memballoon>
Aug 01 18:22:10 user nova-compute[72150]:   </devices>
Aug 01 18:22:10 user nova-compute[72150]: </domain>
Aug 01 18:22:10 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-983852594',display_name='tempest-TestVolumeSwap-server-983852594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-983852594',id=6,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKN3UJDBvsSCDyxyiABJEe+o7rPvNztF+1CDAjZJdHP3OssRDUtMd4FG3xdPbLXlSgKzwOuj8SVkT3kqGEnKCNOj1qIXrc1OJPhlUiYwemnjTrNa9g73Dds3kAktpXYWg==',key_name='tempest-keypair-523819296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6b8e37a30724a0186d9b7f126a46b0d',ramdisk_id='',reservation_id='r-otyndced',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1013643713',owner_user_name='tempest-TestVolumeSwap-1013643713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d068c0606cd411ca3b5641509825b7b',uuid=ad033976-bfc8-46b9-89bf-f752ae0cdf01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "address": "fa:16:3e:86:2e:4d", "network": {"id": "64d2a931-7450-40f4-827a-e54a5db845a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-125648202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b8e37a30724a0186d9b7f126a46b0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8509ce7f-8c", "ovs_interfaceid": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Converting VIF {"id": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "address": "fa:16:3e:86:2e:4d", "network": {"id": "64d2a931-7450-40f4-827a-e54a5db845a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-125648202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b8e37a30724a0186d9b7f126a46b0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8509ce7f-8c", "ovs_interfaceid": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:2e:4d,bridge_name='br-int',has_traffic_filtering=True,id=8509ce7f-8cec-4926-a30d-5900fbddac8a,network=Network(64d2a931-7450-40f4-827a-e54a5db845a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8509ce7f-8c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG os_vif [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:2e:4d,bridge_name='br-int',has_traffic_filtering=True,id=8509ce7f-8cec-4926-a30d-5900fbddac8a,network=Network(64d2a931-7450-40f4-827a-e54a5db845a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8509ce7f-8c') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8509ce7f-8c, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8509ce7f-8c, col_values=(('external_ids', {'iface-id': '8509ce7f-8cec-4926-a30d-5900fbddac8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:2e:4d', 'vm-uuid': 'ad033976-bfc8-46b9-89bf-f752ae0cdf01'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:10 user nova-compute[72150]: INFO os_vif [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:2e:4d,bridge_name='br-int',has_traffic_filtering=True,id=8509ce7f-8cec-4926-a30d-5900fbddac8a,network=Network(64d2a931-7450-40f4-827a-e54a5db845a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8509ce7f-8c')
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:22:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] No VIF found with MAC fa:16:3e:86:2e:4d, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:22:11 user nova-compute[72150]: DEBUG nova.compute.manager [req-18dbb84f-a5e1-4b13-9848-d18cd321fe25 req-8842b27f-e833-4fc7-8c2d-4881c9be98d8 service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Received event network-changed-8509ce7f-8cec-4926-a30d-5900fbddac8a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:22:11 user nova-compute[72150]: DEBUG nova.compute.manager [req-18dbb84f-a5e1-4b13-9848-d18cd321fe25 req-8842b27f-e833-4fc7-8c2d-4881c9be98d8 service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Refreshing instance network info cache due to event network-changed-8509ce7f-8cec-4926-a30d-5900fbddac8a. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:22:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-18dbb84f-a5e1-4b13-9848-d18cd321fe25 req-8842b27f-e833-4fc7-8c2d-4881c9be98d8 service nova] Acquiring lock "refresh_cache-ad033976-bfc8-46b9-89bf-f752ae0cdf01" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:22:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-18dbb84f-a5e1-4b13-9848-d18cd321fe25 req-8842b27f-e833-4fc7-8c2d-4881c9be98d8 service nova] Acquired lock "refresh_cache-ad033976-bfc8-46b9-89bf-f752ae0cdf01" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:22:11 user nova-compute[72150]: DEBUG nova.network.neutron [req-18dbb84f-a5e1-4b13-9848-d18cd321fe25 req-8842b27f-e833-4fc7-8c2d-4881c9be98d8 service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Refreshing network info cache for port 8509ce7f-8cec-4926-a30d-5900fbddac8a {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:22:12 user nova-compute[72150]: DEBUG nova.network.neutron [req-18dbb84f-a5e1-4b13-9848-d18cd321fe25 req-8842b27f-e833-4fc7-8c2d-4881c9be98d8 service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Updated VIF entry in instance network info cache for port 8509ce7f-8cec-4926-a30d-5900fbddac8a. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:22:12 user nova-compute[72150]: DEBUG nova.network.neutron [req-18dbb84f-a5e1-4b13-9848-d18cd321fe25 req-8842b27f-e833-4fc7-8c2d-4881c9be98d8 service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Updating instance_info_cache with network_info: [{"id": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "address": "fa:16:3e:86:2e:4d", "network": {"id": "64d2a931-7450-40f4-827a-e54a5db845a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-125648202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b8e37a30724a0186d9b7f126a46b0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8509ce7f-8c", "ovs_interfaceid": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:22:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-18dbb84f-a5e1-4b13-9848-d18cd321fe25 req-8842b27f-e833-4fc7-8c2d-4881c9be98d8 service nova] Releasing lock "refresh_cache-ad033976-bfc8-46b9-89bf-f752ae0cdf01" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:22:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:13 user nova-compute[72150]: DEBUG nova.compute.manager [req-88c22017-f0e3-4514-be5f-9d7bbe7c7b91 req-ceddf1f2-786f-4165-92dd-86aaa0f530ba service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Received event network-vif-plugged-8509ce7f-8cec-4926-a30d-5900fbddac8a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:22:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-88c22017-f0e3-4514-be5f-9d7bbe7c7b91 req-ceddf1f2-786f-4165-92dd-86aaa0f530ba service nova] Acquiring lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-88c22017-f0e3-4514-be5f-9d7bbe7c7b91 req-ceddf1f2-786f-4165-92dd-86aaa0f530ba service nova] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-88c22017-f0e3-4514-be5f-9d7bbe7c7b91 req-ceddf1f2-786f-4165-92dd-86aaa0f530ba service nova] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:13 user nova-compute[72150]: DEBUG nova.compute.manager [req-88c22017-f0e3-4514-be5f-9d7bbe7c7b91 req-ceddf1f2-786f-4165-92dd-86aaa0f530ba service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] No waiting events found dispatching network-vif-plugged-8509ce7f-8cec-4926-a30d-5900fbddac8a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:22:13 user nova-compute[72150]: WARNING nova.compute.manager [req-88c22017-f0e3-4514-be5f-9d7bbe7c7b91 req-ceddf1f2-786f-4165-92dd-86aaa0f530ba service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Received unexpected event network-vif-plugged-8509ce7f-8cec-4926-a30d-5900fbddac8a for instance with vm_state building and task_state spawning.
Aug 01 18:22:13 user nova-compute[72150]: DEBUG nova.compute.manager [req-88c22017-f0e3-4514-be5f-9d7bbe7c7b91 req-ceddf1f2-786f-4165-92dd-86aaa0f530ba service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Received event network-vif-plugged-8509ce7f-8cec-4926-a30d-5900fbddac8a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:22:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-88c22017-f0e3-4514-be5f-9d7bbe7c7b91 req-ceddf1f2-786f-4165-92dd-86aaa0f530ba service nova] Acquiring lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-88c22017-f0e3-4514-be5f-9d7bbe7c7b91 req-ceddf1f2-786f-4165-92dd-86aaa0f530ba service nova] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-88c22017-f0e3-4514-be5f-9d7bbe7c7b91 req-ceddf1f2-786f-4165-92dd-86aaa0f530ba service nova] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:13 user nova-compute[72150]: DEBUG nova.compute.manager [req-88c22017-f0e3-4514-be5f-9d7bbe7c7b91 req-ceddf1f2-786f-4165-92dd-86aaa0f530ba service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] No waiting events found dispatching network-vif-plugged-8509ce7f-8cec-4926-a30d-5900fbddac8a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:22:13 user nova-compute[72150]: WARNING nova.compute.manager [req-88c22017-f0e3-4514-be5f-9d7bbe7c7b91 req-ceddf1f2-786f-4165-92dd-86aaa0f530ba service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Received unexpected event network-vif-plugged-8509ce7f-8cec-4926-a30d-5900fbddac8a for instance with vm_state building and task_state spawning.
Aug 01 18:22:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:22:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:22:14 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914134.7220669, ad033976-bfc8-46b9-89bf-f752ae0cdf01 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:22:14 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] VM Resumed (Lifecycle Event)
Aug 01 18:22:14 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Instance spawned successfully.
Aug 01 18:22:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:22:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:22:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:22:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:22:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:22:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:22:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:22:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:22:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:22:14 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:22:14 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914134.7257323, ad033976-bfc8-46b9-89bf-f752ae0cdf01 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:22:14 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] VM Started (Lifecycle Event)
Aug 01 18:22:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:22:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:22:14 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:22:14 user nova-compute[72150]: INFO nova.compute.manager [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Took 7.46 seconds to spawn the instance on the hypervisor.
Aug 01 18:22:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:22:15 user nova-compute[72150]: INFO nova.compute.manager [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Took 8.62 seconds to build instance.
Aug 01 18:22:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bc5e332e-0be3-4923-b250-3a59560d8e73 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.770s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:21 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:22:21 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Cleaning up deleted instances {{(pid=72150) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 18:22:21 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] There are 0 instances to clean {{(pid=72150) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 18:22:21 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:22:21 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72150) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 18:22:21 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:22:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:24 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:22:24 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:22:24 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:22:24 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:22:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:24 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:22:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3811375-bcd1-46ac-b552-7ff1588a3667/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3811375-bcd1-46ac-b552-7ff1588a3667/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3811375-bcd1-46ac-b552-7ff1588a3667/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3811375-bcd1-46ac-b552-7ff1588a3667/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:27 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:22:27 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:22:27 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=7747MB free_disk=25.95032501220703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:22:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:27 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 3f123d4e-1aec-4aa1-8717-f31305a62a5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:22:27 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance c3811375-bcd1-46ac-b552-7ff1588a3667 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:22:27 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 050260e0-53e0-43dd-a301-a4e3e411f34d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:22:27 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 554b19ce-2ea6-4494-bdd9-a02444ca920e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:22:27 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 161fa35c-1f33-4ea7-94a9-c3b78952155e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:22:27 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ad033976-bfc8-46b9-89bf-f752ae0cdf01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:22:27 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:22:27 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:22:27 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:22:28 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:22:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:22:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Acquiring lock "214cf2f9-8bb2-431c-b5f4-15fc2fa526ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Lock "214cf2f9-8bb2-431c-b5f4-15fc2fa526ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:22:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:28 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:22:28 user nova-compute[72150]: INFO nova.compute.claims [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Claim successful on node user
Aug 01 18:22:28 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:22:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:28 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:22:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:22:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:22:28 user nova-compute[72150]: DEBUG nova.network.neutron [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:22:28 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:22:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:22:28 user nova-compute[72150]: DEBUG nova.policy [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f34fd2084e79488f92afe91deefa4d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22ea1b3d91a40baa45ba58eda78e6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:22:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:22:28 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:22:28 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Creating image(s)
Aug 01 18:22:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Acquiring lock "/opt/stack/data/nova/instances/214cf2f9-8bb2-431c-b5f4-15fc2fa526ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Lock "/opt/stack/data/nova/instances/214cf2f9-8bb2-431c-b5f4-15fc2fa526ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Lock "/opt/stack/data/nova/instances/214cf2f9-8bb2-431c-b5f4-15fc2fa526ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.164s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.127s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/214cf2f9-8bb2-431c-b5f4-15fc2fa526ed/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/214cf2f9-8bb2-431c-b5f4-15fc2fa526ed/disk 1073741824" returned: 0 in 0.073s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.164s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Checking if we can resize image /opt/stack/data/nova/instances/214cf2f9-8bb2-431c-b5f4-15fc2fa526ed/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/214cf2f9-8bb2-431c-b5f4-15fc2fa526ed/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG nova.network.neutron [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Successfully created port: 307425fc-ae0c-4e24-aede-f9497c7b21fc {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/214cf2f9-8bb2-431c-b5f4-15fc2fa526ed/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Cannot resize image /opt/stack/data/nova/instances/214cf2f9-8bb2-431c-b5f4-15fc2fa526ed/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG nova.objects.instance [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Lazy-loading 'migration_context' on Instance uuid 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Ensure instance console log exists: /opt/stack/data/nova/instances/214cf2f9-8bb2-431c-b5f4-15fc2fa526ed/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Skipping network cache update for instance because it is Building. {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:22:29 user nova-compute[72150]: DEBUG nova.objects.instance [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lazy-loading 'info_cache' on Instance uuid 3f123d4e-1aec-4aa1-8717-f31305a62a5d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.network.neutron [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Successfully updated port: 307425fc-ae0c-4e24-aede-f9497c7b21fc {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Acquiring lock "refresh_cache-214cf2f9-8bb2-431c-b5f4-15fc2fa526ed" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Acquired lock "refresh_cache-214cf2f9-8bb2-431c-b5f4-15fc2fa526ed" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.network.neutron [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.compute.manager [req-83105489-19a0-4fc1-8ebf-18e7e7c4172f req-ff7fd700-56e1-4315-b4c3-c7c910ec56f2 service nova] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Received event network-changed-307425fc-ae0c-4e24-aede-f9497c7b21fc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.compute.manager [req-83105489-19a0-4fc1-8ebf-18e7e7c4172f req-ff7fd700-56e1-4315-b4c3-c7c910ec56f2 service nova] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Refreshing instance network info cache due to event network-changed-307425fc-ae0c-4e24-aede-f9497c7b21fc. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-83105489-19a0-4fc1-8ebf-18e7e7c4172f req-ff7fd700-56e1-4315-b4c3-c7c910ec56f2 service nova] Acquiring lock "refresh_cache-214cf2f9-8bb2-431c-b5f4-15fc2fa526ed" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.network.neutron [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Updating instance_info_cache with network_info: [{"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.network.neutron [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Updating instance_info_cache with network_info: [{"id": "307425fc-ae0c-4e24-aede-f9497c7b21fc", "address": "fa:16:3e:22:5c:fb", "network": {"id": "246f10fd-f9be-4514-a4ca-9bf05a878810", "bridge": "br-int", "label": "tempest-VolumesActionsTest-795896996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22ea1b3d91a40baa45ba58eda78e6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307425fc-ae", "ovs_interfaceid": "307425fc-ae0c-4e24-aede-f9497c7b21fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Releasing lock "refresh_cache-214cf2f9-8bb2-431c-b5f4-15fc2fa526ed" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.compute.manager [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Instance network_info: |[{"id": "307425fc-ae0c-4e24-aede-f9497c7b21fc", "address": "fa:16:3e:22:5c:fb", "network": {"id": "246f10fd-f9be-4514-a4ca-9bf05a878810", "bridge": "br-int", "label": "tempest-VolumesActionsTest-795896996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22ea1b3d91a40baa45ba58eda78e6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307425fc-ae", "ovs_interfaceid": "307425fc-ae0c-4e24-aede-f9497c7b21fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-83105489-19a0-4fc1-8ebf-18e7e7c4172f req-ff7fd700-56e1-4315-b4c3-c7c910ec56f2 service nova] Acquired lock "refresh_cache-214cf2f9-8bb2-431c-b5f4-15fc2fa526ed" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.network.neutron [req-83105489-19a0-4fc1-8ebf-18e7e7c4172f req-ff7fd700-56e1-4315-b4c3-c7c910ec56f2 service nova] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Refreshing network info cache for port 307425fc-ae0c-4e24-aede-f9497c7b21fc {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Start _get_guest_xml network_info=[{"id": "307425fc-ae0c-4e24-aede-f9497c7b21fc", "address": "fa:16:3e:22:5c:fb", "network": {"id": "246f10fd-f9be-4514-a4ca-9bf05a878810", "bridge": "br-int", "label": "tempest-VolumesActionsTest-795896996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22ea1b3d91a40baa45ba58eda78e6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307425fc-ae", "ovs_interfaceid": "307425fc-ae0c-4e24-aede-f9497c7b21fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:22:30 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:22:30 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:22:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1701584882',display_name='tempest-VolumesActionsTest-instance-1701584882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1701584882',id=7,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a22ea1b3d91a40baa45ba58eda78e6c9',ramdisk_id='',reservation_id='r-l655vzdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1335718488',owner_user_name='tempest-VolumesActionsTest-1335718488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:22:29Z,user_data=None,user_id='f34fd2084e79488f92afe91deefa4d6c',uuid=214cf2f9-8bb2-431c-b5f4-15fc2fa526ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "307425fc-ae0c-4e24-aede-f9497c7b21fc", "address": "fa:16:3e:22:5c:fb", "network": {"id": "246f10fd-f9be-4514-a4ca-9bf05a878810", "bridge": "br-int", "label": "tempest-VolumesActionsTest-795896996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22ea1b3d91a40baa45ba58eda78e6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307425fc-ae", "ovs_interfaceid": "307425fc-ae0c-4e24-aede-f9497c7b21fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Converting VIF {"id": "307425fc-ae0c-4e24-aede-f9497c7b21fc", "address": "fa:16:3e:22:5c:fb", "network": {"id": "246f10fd-f9be-4514-a4ca-9bf05a878810", "bridge": "br-int", "label": "tempest-VolumesActionsTest-795896996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22ea1b3d91a40baa45ba58eda78e6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307425fc-ae", "ovs_interfaceid": "307425fc-ae0c-4e24-aede-f9497c7b21fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:5c:fb,bridge_name='br-int',has_traffic_filtering=True,id=307425fc-ae0c-4e24-aede-f9497c7b21fc,network=Network(246f10fd-f9be-4514-a4ca-9bf05a878810),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307425fc-ae') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.objects.instance [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Lazy-loading 'pci_devices' on Instance uuid 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:22:30 user nova-compute[72150]:   <uuid>214cf2f9-8bb2-431c-b5f4-15fc2fa526ed</uuid>
Aug 01 18:22:30 user nova-compute[72150]:   <name>instance-00000007</name>
Aug 01 18:22:30 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:22:30 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:22:30 user nova-compute[72150]:   <metadata>
Aug 01 18:22:30 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:22:30 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:22:30 user nova-compute[72150]:       <nova:name>tempest-VolumesActionsTest-instance-1701584882</nova:name>
Aug 01 18:22:30 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:22:30</nova:creationTime>
Aug 01 18:22:30 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:22:30 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:22:30 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:22:30 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:22:30 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:22:30 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:22:30 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:22:30 user nova-compute[72150]:       <nova:owner>
Aug 01 18:22:30 user nova-compute[72150]:         <nova:user uuid="f34fd2084e79488f92afe91deefa4d6c">tempest-VolumesActionsTest-1335718488-project-member</nova:user>
Aug 01 18:22:30 user nova-compute[72150]:         <nova:project uuid="a22ea1b3d91a40baa45ba58eda78e6c9">tempest-VolumesActionsTest-1335718488</nova:project>
Aug 01 18:22:30 user nova-compute[72150]:       </nova:owner>
Aug 01 18:22:30 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:22:30 user nova-compute[72150]:       <nova:ports>
Aug 01 18:22:30 user nova-compute[72150]:         <nova:port uuid="307425fc-ae0c-4e24-aede-f9497c7b21fc">
Aug 01 18:22:30 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 18:22:30 user nova-compute[72150]:         </nova:port>
Aug 01 18:22:30 user nova-compute[72150]:       </nova:ports>
Aug 01 18:22:30 user nova-compute[72150]:     </nova:instance>
Aug 01 18:22:30 user nova-compute[72150]:   </metadata>
Aug 01 18:22:30 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:22:30 user nova-compute[72150]:     <system>
Aug 01 18:22:30 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:22:30 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:22:30 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:22:30 user nova-compute[72150]:       <entry name="serial">214cf2f9-8bb2-431c-b5f4-15fc2fa526ed</entry>
Aug 01 18:22:30 user nova-compute[72150]:       <entry name="uuid">214cf2f9-8bb2-431c-b5f4-15fc2fa526ed</entry>
Aug 01 18:22:30 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:22:30 user nova-compute[72150]:     </system>
Aug 01 18:22:30 user nova-compute[72150]:   </sysinfo>
Aug 01 18:22:30 user nova-compute[72150]:   <os>
Aug 01 18:22:30 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:22:30 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:22:30 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:22:30 user nova-compute[72150]:   </os>
Aug 01 18:22:30 user nova-compute[72150]:   <features>
Aug 01 18:22:30 user nova-compute[72150]:     <acpi/>
Aug 01 18:22:30 user nova-compute[72150]:     <apic/>
Aug 01 18:22:30 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:22:30 user nova-compute[72150]:   </features>
Aug 01 18:22:30 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:22:30 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:22:30 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:22:30 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:22:30 user nova-compute[72150]:   </clock>
Aug 01 18:22:30 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:22:30 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:22:30 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:22:30 user nova-compute[72150]:   </cpu>
Aug 01 18:22:30 user nova-compute[72150]:   <devices>
Aug 01 18:22:30 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:22:30 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:22:30 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/214cf2f9-8bb2-431c-b5f4-15fc2fa526ed/disk"/>
Aug 01 18:22:30 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:22:30 user nova-compute[72150]:     </disk>
Aug 01 18:22:30 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:22:30 user nova-compute[72150]:       <mac address="fa:16:3e:22:5c:fb"/>
Aug 01 18:22:30 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:22:30 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:22:30 user nova-compute[72150]:       <target dev="tap307425fc-ae"/>
Aug 01 18:22:30 user nova-compute[72150]:     </interface>
Aug 01 18:22:30 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:22:30 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/214cf2f9-8bb2-431c-b5f4-15fc2fa526ed/console.log" append="off"/>
Aug 01 18:22:30 user nova-compute[72150]:     </serial>
Aug 01 18:22:30 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:22:30 user nova-compute[72150]:     <video>
Aug 01 18:22:30 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:22:30 user nova-compute[72150]:     </video>
Aug 01 18:22:30 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:22:30 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:22:30 user nova-compute[72150]:     </rng>
Aug 01 18:22:30 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:22:30 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:22:30 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:22:30 user nova-compute[72150]:     </memballoon>
Aug 01 18:22:30 user nova-compute[72150]:   </devices>
Aug 01 18:22:30 user nova-compute[72150]: </domain>
Aug 01 18:22:30 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:22:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1701584882',display_name='tempest-VolumesActionsTest-instance-1701584882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1701584882',id=7,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a22ea1b3d91a40baa45ba58eda78e6c9',ramdisk_id='',reservation_id='r-l655vzdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1335718488',owner_user_name='tempest-VolumesActionsTest-1335718488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:22:29Z,user_data=None,user_id='f34fd2084e79488f92afe91deefa4d6c',uuid=214cf2f9-8bb2-431c-b5f4-15fc2fa526ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "307425fc-ae0c-4e24-aede-f9497c7b21fc", "address": "fa:16:3e:22:5c:fb", "network": {"id": "246f10fd-f9be-4514-a4ca-9bf05a878810", "bridge": "br-int", "label": "tempest-VolumesActionsTest-795896996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22ea1b3d91a40baa45ba58eda78e6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307425fc-ae", "ovs_interfaceid": "307425fc-ae0c-4e24-aede-f9497c7b21fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Converting VIF {"id": "307425fc-ae0c-4e24-aede-f9497c7b21fc", "address": "fa:16:3e:22:5c:fb", "network": {"id": "246f10fd-f9be-4514-a4ca-9bf05a878810", "bridge": "br-int", "label": "tempest-VolumesActionsTest-795896996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22ea1b3d91a40baa45ba58eda78e6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307425fc-ae", "ovs_interfaceid": "307425fc-ae0c-4e24-aede-f9497c7b21fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:5c:fb,bridge_name='br-int',has_traffic_filtering=True,id=307425fc-ae0c-4e24-aede-f9497c7b21fc,network=Network(246f10fd-f9be-4514-a4ca-9bf05a878810),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307425fc-ae') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG os_vif [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:5c:fb,bridge_name='br-int',has_traffic_filtering=True,id=307425fc-ae0c-4e24-aede-f9497c7b21fc,network=Network(246f10fd-f9be-4514-a4ca-9bf05a878810),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307425fc-ae') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap307425fc-ae, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap307425fc-ae, col_values=(('external_ids', {'iface-id': '307425fc-ae0c-4e24-aede-f9497c7b21fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:5c:fb', 'vm-uuid': '214cf2f9-8bb2-431c-b5f4-15fc2fa526ed'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:22:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:30 user nova-compute[72150]: INFO os_vif [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:5c:fb,bridge_name='br-int',has_traffic_filtering=True,id=307425fc-ae0c-4e24-aede-f9497c7b21fc,network=Network(246f10fd-f9be-4514-a4ca-9bf05a878810),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307425fc-ae')
Aug 01 18:22:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:22:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] No VIF found with MAC fa:16:3e:22:5c:fb, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:22:31 user nova-compute[72150]: DEBUG nova.network.neutron [req-83105489-19a0-4fc1-8ebf-18e7e7c4172f req-ff7fd700-56e1-4315-b4c3-c7c910ec56f2 service nova] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Updated VIF entry in instance network info cache for port 307425fc-ae0c-4e24-aede-f9497c7b21fc. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:22:31 user nova-compute[72150]: DEBUG nova.network.neutron [req-83105489-19a0-4fc1-8ebf-18e7e7c4172f req-ff7fd700-56e1-4315-b4c3-c7c910ec56f2 service nova] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Updating instance_info_cache with network_info: [{"id": "307425fc-ae0c-4e24-aede-f9497c7b21fc", "address": "fa:16:3e:22:5c:fb", "network": {"id": "246f10fd-f9be-4514-a4ca-9bf05a878810", "bridge": "br-int", "label": "tempest-VolumesActionsTest-795896996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22ea1b3d91a40baa45ba58eda78e6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307425fc-ae", "ovs_interfaceid": "307425fc-ae0c-4e24-aede-f9497c7b21fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:22:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-83105489-19a0-4fc1-8ebf-18e7e7c4172f req-ff7fd700-56e1-4315-b4c3-c7c910ec56f2 service nova] Releasing lock "refresh_cache-214cf2f9-8bb2-431c-b5f4-15fc2fa526ed" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:22:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:32 user nova-compute[72150]: DEBUG nova.compute.manager [req-ab2244ec-9e62-419f-9977-ef2aba32b1af req-56deeb3e-e0ea-4e2e-a4f6-e7d8dd58ac4a service nova] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Received event network-vif-plugged-307425fc-ae0c-4e24-aede-f9497c7b21fc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:22:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ab2244ec-9e62-419f-9977-ef2aba32b1af req-56deeb3e-e0ea-4e2e-a4f6-e7d8dd58ac4a service nova] Acquiring lock "214cf2f9-8bb2-431c-b5f4-15fc2fa526ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ab2244ec-9e62-419f-9977-ef2aba32b1af req-56deeb3e-e0ea-4e2e-a4f6-e7d8dd58ac4a service nova] Lock "214cf2f9-8bb2-431c-b5f4-15fc2fa526ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ab2244ec-9e62-419f-9977-ef2aba32b1af req-56deeb3e-e0ea-4e2e-a4f6-e7d8dd58ac4a service nova] Lock "214cf2f9-8bb2-431c-b5f4-15fc2fa526ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:32 user nova-compute[72150]: DEBUG nova.compute.manager [req-ab2244ec-9e62-419f-9977-ef2aba32b1af req-56deeb3e-e0ea-4e2e-a4f6-e7d8dd58ac4a service nova] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] No waiting events found dispatching network-vif-plugged-307425fc-ae0c-4e24-aede-f9497c7b21fc {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:22:32 user nova-compute[72150]: WARNING nova.compute.manager [req-ab2244ec-9e62-419f-9977-ef2aba32b1af req-56deeb3e-e0ea-4e2e-a4f6-e7d8dd58ac4a service nova] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Received unexpected event network-vif-plugged-307425fc-ae0c-4e24-aede-f9497c7b21fc for instance with vm_state building and task_state spawning.
Aug 01 18:22:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:34 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914154.9773455, 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:22:34 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] VM Resumed (Lifecycle Event)
Aug 01 18:22:34 user nova-compute[72150]: DEBUG nova.compute.manager [req-f5dbc11e-7368-486f-b56f-b403668bd463 req-7c8c5af7-f0b4-4b3a-9a63-12748fe0dca9 service nova] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Received event network-vif-plugged-307425fc-ae0c-4e24-aede-f9497c7b21fc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:22:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f5dbc11e-7368-486f-b56f-b403668bd463 req-7c8c5af7-f0b4-4b3a-9a63-12748fe0dca9 service nova] Acquiring lock "214cf2f9-8bb2-431c-b5f4-15fc2fa526ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:22:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f5dbc11e-7368-486f-b56f-b403668bd463 req-7c8c5af7-f0b4-4b3a-9a63-12748fe0dca9 service nova] Lock "214cf2f9-8bb2-431c-b5f4-15fc2fa526ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:22:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f5dbc11e-7368-486f-b56f-b403668bd463 req-7c8c5af7-f0b4-4b3a-9a63-12748fe0dca9 service nova] Lock "214cf2f9-8bb2-431c-b5f4-15fc2fa526ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:34 user nova-compute[72150]: DEBUG nova.compute.manager [req-f5dbc11e-7368-486f-b56f-b403668bd463 req-7c8c5af7-f0b4-4b3a-9a63-12748fe0dca9 service nova] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] No waiting events found dispatching network-vif-plugged-307425fc-ae0c-4e24-aede-f9497c7b21fc {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:22:34 user nova-compute[72150]: WARNING nova.compute.manager [req-f5dbc11e-7368-486f-b56f-b403668bd463 req-7c8c5af7-f0b4-4b3a-9a63-12748fe0dca9 service nova] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Received unexpected event network-vif-plugged-307425fc-ae0c-4e24-aede-f9497c7b21fc for instance with vm_state building and task_state spawning.
Aug 01 18:22:34 user nova-compute[72150]: DEBUG nova.compute.manager [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:22:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:22:34 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Instance spawned successfully.
Aug 01 18:22:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:22:35 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:22:35 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:22:35 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:22:35 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:22:35 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:22:35 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:22:35 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:22:35 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:22:35 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:22:35 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914154.9782293, 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:22:35 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] VM Started (Lifecycle Event)
Aug 01 18:22:35 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:22:35 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:22:35 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:22:35 user nova-compute[72150]: INFO nova.compute.manager [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Took 6.28 seconds to spawn the instance on the hypervisor.
Aug 01 18:22:35 user nova-compute[72150]: DEBUG nova.compute.manager [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:22:35 user nova-compute[72150]: INFO nova.compute.manager [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Took 7.03 seconds to build instance.
Aug 01 18:22:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b843af-7d5b-4633-819a-a1f8e6004e73 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Lock "214cf2f9-8bb2-431c-b5f4-15fc2fa526ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.133s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:22:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:22:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "56ad8a5d-4046-463d-9259-67014867ebfe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:00 user nova-compute[72150]: DEBUG nova.compute.manager [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:23:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:00 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:23:00 user nova-compute[72150]: INFO nova.compute.claims [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Claim successful on node user
Aug 01 18:23:00 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Refreshing inventories for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 18:23:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:00 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Updating ProviderTree inventory for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 18:23:00 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Updating inventory in ProviderTree for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 18:23:01 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Refreshing aggregate associations for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479, aggregates: None {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 18:23:01 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Refreshing trait associations for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 18:23:01 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:23:01 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:23:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.846s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:01 user nova-compute[72150]: DEBUG nova.compute.manager [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:23:01 user nova-compute[72150]: DEBUG nova.compute.manager [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:23:01 user nova-compute[72150]: DEBUG nova.network.neutron [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:23:01 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:23:01 user nova-compute[72150]: DEBUG nova.compute.manager [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:23:01 user nova-compute[72150]: INFO nova.virt.block_device [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Booting with volume b4616a37-17ef-4d3d-a9c8-02871bd0b134 at /dev/vda
Aug 01 18:23:02 user nova-compute[72150]: DEBUG nova.policy [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '315bf50b017b4f9fbe8bfe987fcea8a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6276f231fd7d45098b6a469e59fe4a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:23:02 user nova-compute[72150]: DEBUG os_brick.utils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:23:02 user nova-compute[72150]: INFO oslo.privsep.daemon [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpec7bibuc/privsep.sock']
Aug 01 18:23:02 user sudo[82937]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpec7bibuc/privsep.sock
Aug 01 18:23:02 user sudo[82937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 18:23:03 user nova-compute[72150]: DEBUG nova.network.neutron [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Successfully created port: 7e74d56b-c054-4c2e-8f0f-6502341a1fac {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:23:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:04 user sudo[82937]: pam_unix(sudo:session): session closed for user root
Aug 01 18:23:04 user nova-compute[72150]: INFO oslo.privsep.daemon [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Spawned new privsep daemon via rootwrap
Aug 01 18:23:04 user nova-compute[72150]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 18:23:04 user nova-compute[72150]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 18:23:04 user nova-compute[72150]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 01 18:23:04 user nova-compute[72150]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82940
Aug 01 18:23:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b232672-ce6f-445c-a7ae-3495dd2190fe]: (2,) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:04 user nova-compute[72150]: DEBUG nova.network.neutron [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Successfully created port: 624f99f7-d827-4106-9ffc-f57b26c45b5c {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:23:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[64838bb6-7343-428e-868e-87b446f24e33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:04 user nova-compute[72150]: WARNING os_brick.initiator.connectors.nvmeof [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 01 18:23:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4356b1-4b01-4b5e-a1dc-149854084b05]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab02a0c9-e4bf-48d7-8ee4-0452402d35f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f34f03-5566-45c1-9b8f-127b0307718e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:23:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:23:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:23:04 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:23:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[209131d7-4c8d-43d9-b469-539f48fd9dd6]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:23:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:23:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:23:04 user nova-compute[72150]: DEBUG os_brick.utils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] <== get_connector_properties: return (2198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:23:04 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Updating existing volume attachment record: 4508dd60-2c2d-4da5-893a-f8a0f5a5b3f7 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:23:05 user nova-compute[72150]: DEBUG nova.network.neutron [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Successfully created port: 9b5fca36-3823-421c-9e7e-bcfb0a4c00ab {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:23:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:05 user nova-compute[72150]: DEBUG nova.network.neutron [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Successfully created port: af62c1f6-4440-4109-92b3-80721228f311 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:23:06 user nova-compute[72150]: DEBUG nova.network.neutron [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Successfully created port: 13ea9e27-a7e5-4afa-bda3-87c95c480373 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:23:07 user nova-compute[72150]: DEBUG nova.network.neutron [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Successfully updated port: 7e74d56b-c054-4c2e-8f0f-6502341a1fac {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:23:07 user nova-compute[72150]: DEBUG nova.compute.manager [req-69e917bd-daae-4ea0-a807-5e8487196af9 req-7715b887-8e6f-43a1-9a4d-52660968fab3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-changed-7e74d56b-c054-4c2e-8f0f-6502341a1fac {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:07 user nova-compute[72150]: DEBUG nova.compute.manager [req-69e917bd-daae-4ea0-a807-5e8487196af9 req-7715b887-8e6f-43a1-9a4d-52660968fab3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Refreshing instance network info cache due to event network-changed-7e74d56b-c054-4c2e-8f0f-6502341a1fac. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-69e917bd-daae-4ea0-a807-5e8487196af9 req-7715b887-8e6f-43a1-9a4d-52660968fab3 service nova] Acquiring lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-69e917bd-daae-4ea0-a807-5e8487196af9 req-7715b887-8e6f-43a1-9a4d-52660968fab3 service nova] Acquired lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:07 user nova-compute[72150]: DEBUG nova.network.neutron [req-69e917bd-daae-4ea0-a807-5e8487196af9 req-7715b887-8e6f-43a1-9a4d-52660968fab3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Refreshing network info cache for port 7e74d56b-c054-4c2e-8f0f-6502341a1fac {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:07 user nova-compute[72150]: DEBUG nova.network.neutron [req-69e917bd-daae-4ea0-a807-5e8487196af9 req-7715b887-8e6f-43a1-9a4d-52660968fab3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:23:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:07 user nova-compute[72150]: DEBUG nova.compute.manager [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:23:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:23:08 user nova-compute[72150]: INFO nova.compute.claims [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Claim successful on node user
Aug 01 18:23:08 user nova-compute[72150]: DEBUG nova.network.neutron [req-69e917bd-daae-4ea0-a807-5e8487196af9 req-7715b887-8e6f-43a1-9a4d-52660968fab3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-69e917bd-daae-4ea0-a807-5e8487196af9 req-7715b887-8e6f-43a1-9a4d-52660968fab3 service nova] Releasing lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG nova.network.neutron [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Successfully updated port: d2976671-7ae2-4b1a-a3eb-dc87ba628494 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG nova.compute.manager [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG nova.compute.manager [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG nova.network.neutron [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:23:08 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:23:08 user nova-compute[72150]: DEBUG nova.compute.manager [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:23:08 user nova-compute[72150]: INFO nova.virt.block_device [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Booting with volume 4265b021-38ab-4756-9284-466525908b84 at /dev/vda
Aug 01 18:23:08 user nova-compute[72150]: DEBUG nova.policy [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f62806f8d5534c86a3a1808daa5edbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b336a42e94d27b1079bbf8732eb7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG os_brick.utils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6f6d3a-fd36-4148-b2d2-e82af6e896af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d976d49b-1e0c-4382-9fdf-d6134351c75a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ba884b-dd84-43b3-841d-0b79321d0408]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19448a8-3568-4629-8c3a-ad50138136e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:23:08 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:23:08 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[865b5d7c-aaef-494c-a858-1cd273dd8361]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG os_brick.utils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:23:08 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Updating existing volume attachment record: 293becc9-c8e4-4721-9a4b-6022026a79bb {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:23:09 user nova-compute[72150]: DEBUG nova.network.neutron [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Successfully updated port: d11da1cb-a45e-468e-949d-48d3bdc0628b {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:23:09 user nova-compute[72150]: DEBUG nova.network.neutron [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Successfully created port: 39a977ce-d734-4852-838b-6dfbb51c0bf8 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:23:09 user nova-compute[72150]: DEBUG nova.compute.manager [req-97d9a05c-b36c-49a5-a6e9-663239212df7 req-51f90bfa-11e8-40f1-ba49-b638bab9edf9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-changed-d2976671-7ae2-4b1a-a3eb-dc87ba628494 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:09 user nova-compute[72150]: DEBUG nova.compute.manager [req-97d9a05c-b36c-49a5-a6e9-663239212df7 req-51f90bfa-11e8-40f1-ba49-b638bab9edf9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Refreshing instance network info cache due to event network-changed-d2976671-7ae2-4b1a-a3eb-dc87ba628494. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-97d9a05c-b36c-49a5-a6e9-663239212df7 req-51f90bfa-11e8-40f1-ba49-b638bab9edf9 service nova] Acquiring lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-97d9a05c-b36c-49a5-a6e9-663239212df7 req-51f90bfa-11e8-40f1-ba49-b638bab9edf9 service nova] Acquired lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:09 user nova-compute[72150]: DEBUG nova.network.neutron [req-97d9a05c-b36c-49a5-a6e9-663239212df7 req-51f90bfa-11e8-40f1-ba49-b638bab9edf9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Refreshing network info cache for port d2976671-7ae2-4b1a-a3eb-dc87ba628494 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:09 user nova-compute[72150]: DEBUG nova.network.neutron [req-97d9a05c-b36c-49a5-a6e9-663239212df7 req-51f90bfa-11e8-40f1-ba49-b638bab9edf9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:23:10 user nova-compute[72150]: DEBUG nova.network.neutron [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Successfully updated port: 624f99f7-d827-4106-9ffc-f57b26c45b5c {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:23:10 user nova-compute[72150]: DEBUG nova.network.neutron [req-97d9a05c-b36c-49a5-a6e9-663239212df7 req-51f90bfa-11e8-40f1-ba49-b638bab9edf9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:10 user nova-compute[72150]: DEBUG nova.network.neutron [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Successfully created port: 541680e9-0c34-47e2-b297-b3365281b90a {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:23:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-97d9a05c-b36c-49a5-a6e9-663239212df7 req-51f90bfa-11e8-40f1-ba49-b638bab9edf9 service nova] Releasing lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-97d9a05c-b36c-49a5-a6e9-663239212df7 req-51f90bfa-11e8-40f1-ba49-b638bab9edf9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-changed-d11da1cb-a45e-468e-949d-48d3bdc0628b {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-97d9a05c-b36c-49a5-a6e9-663239212df7 req-51f90bfa-11e8-40f1-ba49-b638bab9edf9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Refreshing instance network info cache due to event network-changed-d11da1cb-a45e-468e-949d-48d3bdc0628b. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-97d9a05c-b36c-49a5-a6e9-663239212df7 req-51f90bfa-11e8-40f1-ba49-b638bab9edf9 service nova] Acquiring lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-97d9a05c-b36c-49a5-a6e9-663239212df7 req-51f90bfa-11e8-40f1-ba49-b638bab9edf9 service nova] Acquired lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:10 user nova-compute[72150]: DEBUG nova.network.neutron [req-97d9a05c-b36c-49a5-a6e9-663239212df7 req-51f90bfa-11e8-40f1-ba49-b638bab9edf9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Refreshing network info cache for port d11da1cb-a45e-468e-949d-48d3bdc0628b {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:10 user nova-compute[72150]: DEBUG nova.network.neutron [req-97d9a05c-b36c-49a5-a6e9-663239212df7 req-51f90bfa-11e8-40f1-ba49-b638bab9edf9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:23:10 user nova-compute[72150]: DEBUG nova.network.neutron [req-97d9a05c-b36c-49a5-a6e9-663239212df7 req-51f90bfa-11e8-40f1-ba49-b638bab9edf9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-97d9a05c-b36c-49a5-a6e9-663239212df7 req-51f90bfa-11e8-40f1-ba49-b638bab9edf9 service nova] Releasing lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:11 user nova-compute[72150]: DEBUG nova.network.neutron [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Successfully created port: 1e6546d6-8fa5-4298-851b-3fb6efa9420c {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:23:11 user nova-compute[72150]: DEBUG nova.network.neutron [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Successfully updated port: 9b5fca36-3823-421c-9e7e-bcfb0a4c00ab {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:23:11 user nova-compute[72150]: DEBUG nova.compute.manager [req-d129f639-64e7-458d-b44b-ccbd1ea7e81c req-c1d034df-a6a3-405b-9edf-240a271b520f service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-changed-624f99f7-d827-4106-9ffc-f57b26c45b5c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:11 user nova-compute[72150]: DEBUG nova.compute.manager [req-d129f639-64e7-458d-b44b-ccbd1ea7e81c req-c1d034df-a6a3-405b-9edf-240a271b520f service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Refreshing instance network info cache due to event network-changed-624f99f7-d827-4106-9ffc-f57b26c45b5c. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d129f639-64e7-458d-b44b-ccbd1ea7e81c req-c1d034df-a6a3-405b-9edf-240a271b520f service nova] Acquiring lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d129f639-64e7-458d-b44b-ccbd1ea7e81c req-c1d034df-a6a3-405b-9edf-240a271b520f service nova] Acquired lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:11 user nova-compute[72150]: DEBUG nova.network.neutron [req-d129f639-64e7-458d-b44b-ccbd1ea7e81c req-c1d034df-a6a3-405b-9edf-240a271b520f service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Refreshing network info cache for port 624f99f7-d827-4106-9ffc-f57b26c45b5c {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:11 user nova-compute[72150]: DEBUG nova.network.neutron [req-d129f639-64e7-458d-b44b-ccbd1ea7e81c req-c1d034df-a6a3-405b-9edf-240a271b520f service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:23:12 user nova-compute[72150]: DEBUG nova.network.neutron [req-d129f639-64e7-458d-b44b-ccbd1ea7e81c req-c1d034df-a6a3-405b-9edf-240a271b520f service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d129f639-64e7-458d-b44b-ccbd1ea7e81c req-c1d034df-a6a3-405b-9edf-240a271b520f service nova] Releasing lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:12 user nova-compute[72150]: DEBUG nova.compute.manager [req-d129f639-64e7-458d-b44b-ccbd1ea7e81c req-c1d034df-a6a3-405b-9edf-240a271b520f service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-changed-9b5fca36-3823-421c-9e7e-bcfb0a4c00ab {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:12 user nova-compute[72150]: DEBUG nova.compute.manager [req-d129f639-64e7-458d-b44b-ccbd1ea7e81c req-c1d034df-a6a3-405b-9edf-240a271b520f service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Refreshing instance network info cache due to event network-changed-9b5fca36-3823-421c-9e7e-bcfb0a4c00ab. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d129f639-64e7-458d-b44b-ccbd1ea7e81c req-c1d034df-a6a3-405b-9edf-240a271b520f service nova] Acquiring lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d129f639-64e7-458d-b44b-ccbd1ea7e81c req-c1d034df-a6a3-405b-9edf-240a271b520f service nova] Acquired lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:12 user nova-compute[72150]: DEBUG nova.network.neutron [req-d129f639-64e7-458d-b44b-ccbd1ea7e81c req-c1d034df-a6a3-405b-9edf-240a271b520f service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Refreshing network info cache for port 9b5fca36-3823-421c-9e7e-bcfb0a4c00ab {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:12 user nova-compute[72150]: DEBUG nova.network.neutron [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Successfully created port: 650c8b02-2525-403f-88d4-450a0903b33c {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:23:12 user nova-compute[72150]: DEBUG nova.network.neutron [req-d129f639-64e7-458d-b44b-ccbd1ea7e81c req-c1d034df-a6a3-405b-9edf-240a271b520f service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:23:12 user nova-compute[72150]: DEBUG nova.network.neutron [req-d129f639-64e7-458d-b44b-ccbd1ea7e81c req-c1d034df-a6a3-405b-9edf-240a271b520f service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d129f639-64e7-458d-b44b-ccbd1ea7e81c req-c1d034df-a6a3-405b-9edf-240a271b520f service nova] Releasing lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG nova.network.neutron [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Successfully created port: c024ac3e-43d1-4453-8715-9b49c747fb08 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG nova.network.neutron [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Successfully updated port: af62c1f6-4440-4109-92b3-80721228f311 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:23:13 user nova-compute[72150]: INFO nova.virt.block_device [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Booting with volume ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f at /dev/vdb
Aug 01 18:23:13 user nova-compute[72150]: DEBUG os_brick.utils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ea6590-3a6d-46f3-aa00-25b9bb70bfca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65ae0ec-8160-4cc0-9a5d-cd90c2ba6f24]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ecd3eb-641f-4b07-b323-eb975f3e321c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6f372b-eda1-4896-853a-22f21282b73e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:23:13 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:23:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5018423e-386d-47d0-a1da-2e1c1e879485]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG os_brick.utils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Updating existing volume attachment record: fb7cdf57-d861-4b4b-b88b-37343925ae1d {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG nova.compute.manager [req-380b4c5c-25b0-41db-85c6-cdce03b453dd req-07783611-03c9-47cf-97cc-26b82983fc45 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-changed-af62c1f6-4440-4109-92b3-80721228f311 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG nova.compute.manager [req-380b4c5c-25b0-41db-85c6-cdce03b453dd req-07783611-03c9-47cf-97cc-26b82983fc45 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Refreshing instance network info cache due to event network-changed-af62c1f6-4440-4109-92b3-80721228f311. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-380b4c5c-25b0-41db-85c6-cdce03b453dd req-07783611-03c9-47cf-97cc-26b82983fc45 service nova] Acquiring lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-380b4c5c-25b0-41db-85c6-cdce03b453dd req-07783611-03c9-47cf-97cc-26b82983fc45 service nova] Acquired lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:13 user nova-compute[72150]: DEBUG nova.network.neutron [req-380b4c5c-25b0-41db-85c6-cdce03b453dd req-07783611-03c9-47cf-97cc-26b82983fc45 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Refreshing network info cache for port af62c1f6-4440-4109-92b3-80721228f311 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:14 user nova-compute[72150]: DEBUG nova.network.neutron [req-380b4c5c-25b0-41db-85c6-cdce03b453dd req-07783611-03c9-47cf-97cc-26b82983fc45 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:23:14 user nova-compute[72150]: DEBUG nova.network.neutron [req-380b4c5c-25b0-41db-85c6-cdce03b453dd req-07783611-03c9-47cf-97cc-26b82983fc45 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:14 user nova-compute[72150]: DEBUG nova.network.neutron [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Successfully updated port: 39a977ce-d734-4852-838b-6dfbb51c0bf8 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:23:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-380b4c5c-25b0-41db-85c6-cdce03b453dd req-07783611-03c9-47cf-97cc-26b82983fc45 service nova] Releasing lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:14 user nova-compute[72150]: DEBUG nova.compute.manager [req-4809e30d-146b-4c5a-b327-7a720bc393a1 req-2cd0d60c-95e0-4943-aa82-ba8e8ddcfed9 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-changed-39a977ce-d734-4852-838b-6dfbb51c0bf8 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:14 user nova-compute[72150]: DEBUG nova.compute.manager [req-4809e30d-146b-4c5a-b327-7a720bc393a1 req-2cd0d60c-95e0-4943-aa82-ba8e8ddcfed9 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Refreshing instance network info cache due to event network-changed-39a977ce-d734-4852-838b-6dfbb51c0bf8. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4809e30d-146b-4c5a-b327-7a720bc393a1 req-2cd0d60c-95e0-4943-aa82-ba8e8ddcfed9 service nova] Acquiring lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4809e30d-146b-4c5a-b327-7a720bc393a1 req-2cd0d60c-95e0-4943-aa82-ba8e8ddcfed9 service nova] Acquired lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:14 user nova-compute[72150]: DEBUG nova.network.neutron [req-4809e30d-146b-4c5a-b327-7a720bc393a1 req-2cd0d60c-95e0-4943-aa82-ba8e8ddcfed9 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Refreshing network info cache for port 39a977ce-d734-4852-838b-6dfbb51c0bf8 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:14 user nova-compute[72150]: DEBUG nova.network.neutron [req-4809e30d-146b-4c5a-b327-7a720bc393a1 req-2cd0d60c-95e0-4943-aa82-ba8e8ddcfed9 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:23:14 user nova-compute[72150]: DEBUG nova.network.neutron [req-4809e30d-146b-4c5a-b327-7a720bc393a1 req-2cd0d60c-95e0-4943-aa82-ba8e8ddcfed9 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4809e30d-146b-4c5a-b327-7a720bc393a1 req-2cd0d60c-95e0-4943-aa82-ba8e8ddcfed9 service nova] Releasing lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:14 user nova-compute[72150]: DEBUG nova.network.neutron [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Successfully updated port: 13ea9e27-a7e5-4afa-bda3-87c95c480373 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:23:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Acquiring lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Acquired lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:14 user nova-compute[72150]: DEBUG nova.network.neutron [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:23:14 user nova-compute[72150]: DEBUG nova.network.neutron [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:23:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:15 user nova-compute[72150]: DEBUG nova.network.neutron [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Successfully updated port: 77546d5a-e74c-4058-9008-a09a455ba8d0 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:23:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:16 user nova-compute[72150]: DEBUG nova.compute.manager [req-b41210e6-a6ef-41d2-a50b-838c52b05985 req-0eed4aef-da03-44fa-aec9-8986222f4f62 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-changed-13ea9e27-a7e5-4afa-bda3-87c95c480373 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:16 user nova-compute[72150]: DEBUG nova.compute.manager [req-b41210e6-a6ef-41d2-a50b-838c52b05985 req-0eed4aef-da03-44fa-aec9-8986222f4f62 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Refreshing instance network info cache due to event network-changed-13ea9e27-a7e5-4afa-bda3-87c95c480373. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b41210e6-a6ef-41d2-a50b-838c52b05985 req-0eed4aef-da03-44fa-aec9-8986222f4f62 service nova] Acquiring lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:16 user nova-compute[72150]: DEBUG nova.compute.manager [req-df7f2737-be29-4597-a6f4-55fc2f0b3c3e req-c047d5b0-4362-4d56-b379-e23c80ffd301 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-changed-77546d5a-e74c-4058-9008-a09a455ba8d0 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:16 user nova-compute[72150]: DEBUG nova.compute.manager [req-df7f2737-be29-4597-a6f4-55fc2f0b3c3e req-c047d5b0-4362-4d56-b379-e23c80ffd301 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Refreshing instance network info cache due to event network-changed-77546d5a-e74c-4058-9008-a09a455ba8d0. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-df7f2737-be29-4597-a6f4-55fc2f0b3c3e req-c047d5b0-4362-4d56-b379-e23c80ffd301 service nova] Acquiring lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-df7f2737-be29-4597-a6f4-55fc2f0b3c3e req-c047d5b0-4362-4d56-b379-e23c80ffd301 service nova] Acquired lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:16 user nova-compute[72150]: DEBUG nova.network.neutron [req-df7f2737-be29-4597-a6f4-55fc2f0b3c3e req-c047d5b0-4362-4d56-b379-e23c80ffd301 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Refreshing network info cache for port 77546d5a-e74c-4058-9008-a09a455ba8d0 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:16 user nova-compute[72150]: DEBUG nova.network.neutron [req-df7f2737-be29-4597-a6f4-55fc2f0b3c3e req-c047d5b0-4362-4d56-b379-e23c80ffd301 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:23:17 user nova-compute[72150]: DEBUG nova.network.neutron [req-df7f2737-be29-4597-a6f4-55fc2f0b3c3e req-c047d5b0-4362-4d56-b379-e23c80ffd301 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-df7f2737-be29-4597-a6f4-55fc2f0b3c3e req-c047d5b0-4362-4d56-b379-e23c80ffd301 service nova] Releasing lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:17 user nova-compute[72150]: DEBUG nova.network.neutron [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Successfully updated port: fab43aac-fc06-4876-8c52-6f3e5a492217 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:23:17 user nova-compute[72150]: DEBUG nova.network.neutron [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Updating instance_info_cache with network_info: [{"id": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "address": "fa:16:3e:92:3a:b2", "network": {"id": "e17eb56a-a429-4b1b-a469-106a0e453e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-502389898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e74d56b-c0", "ovs_interfaceid": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "address": "fa:16:3e:b7:55:d4", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2976671-7a", "ovs_interfaceid": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "address": "fa:16:3e:4d:a2:31", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11da1cb-a4", "ovs_interfaceid": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "624f99f7-d827-4106-9ffc-f57b26c45b5c", "address": "fa:16:3e:6e:78:7e", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624f99f7-d8", "ovs_interfaceid": "624f99f7-d827-4106-9ffc-f57b26c45b5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "address": "fa:16:3e:53:16:5f", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5fca36-38", "ovs_interfaceid": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af62c1f6-4440-4109-92b3-80721228f311", "address": "fa:16:3e:0a:89:2e", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf62c1f6-44", "ovs_interfaceid": "af62c1f6-4440-4109-92b3-80721228f311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "address": "fa:16:3e:1b:a3:2f", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ea9e27-a7", "ovs_interfaceid": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Releasing lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:17 user nova-compute[72150]: DEBUG nova.compute.manager [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Instance network_info: |[{"id": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "address": "fa:16:3e:92:3a:b2", "network": {"id": "e17eb56a-a429-4b1b-a469-106a0e453e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-502389898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e74d56b-c0", "ovs_interfaceid": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "address": "fa:16:3e:b7:55:d4", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2976671-7a", "ovs_interfaceid": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "address": "fa:16:3e:4d:a2:31", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11da1cb-a4", "ovs_interfaceid": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "624f99f7-d827-4106-9ffc-f57b26c45b5c", "address": "fa:16:3e:6e:78:7e", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624f99f7-d8", "ovs_interfaceid": "624f99f7-d827-4106-9ffc-f57b26c45b5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "address": "fa:16:3e:53:16:5f", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5fca36-38", "ovs_interfaceid": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af62c1f6-4440-4109-92b3-80721228f311", "address": "fa:16:3e:0a:89:2e", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf62c1f6-44", "ovs_interfaceid": "af62c1f6-4440-4109-92b3-80721228f311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "address": "fa:16:3e:1b:a3:2f", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ea9e27-a7", "ovs_interfaceid": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:23:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b41210e6-a6ef-41d2-a50b-838c52b05985 req-0eed4aef-da03-44fa-aec9-8986222f4f62 service nova] Acquired lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:17 user nova-compute[72150]: DEBUG nova.network.neutron [req-b41210e6-a6ef-41d2-a50b-838c52b05985 req-0eed4aef-da03-44fa-aec9-8986222f4f62 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Refreshing network info cache for port 13ea9e27-a7e5-4afa-bda3-87c95c480373 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:18 user nova-compute[72150]: DEBUG nova.compute.manager [req-4b95b6c5-86f4-4ff9-ad6d-e9bd37ff9c19 req-772d5652-9698-4c53-a6e6-44cae9f7be82 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-changed-fab43aac-fc06-4876-8c52-6f3e5a492217 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:18 user nova-compute[72150]: DEBUG nova.compute.manager [req-4b95b6c5-86f4-4ff9-ad6d-e9bd37ff9c19 req-772d5652-9698-4c53-a6e6-44cae9f7be82 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Refreshing instance network info cache due to event network-changed-fab43aac-fc06-4876-8c52-6f3e5a492217. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4b95b6c5-86f4-4ff9-ad6d-e9bd37ff9c19 req-772d5652-9698-4c53-a6e6-44cae9f7be82 service nova] Acquiring lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4b95b6c5-86f4-4ff9-ad6d-e9bd37ff9c19 req-772d5652-9698-4c53-a6e6-44cae9f7be82 service nova] Acquired lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:18 user nova-compute[72150]: DEBUG nova.network.neutron [req-4b95b6c5-86f4-4ff9-ad6d-e9bd37ff9c19 req-772d5652-9698-4c53-a6e6-44cae9f7be82 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Refreshing network info cache for port fab43aac-fc06-4876-8c52-6f3e5a492217 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:18 user nova-compute[72150]: DEBUG nova.network.neutron [req-4b95b6c5-86f4-4ff9-ad6d-e9bd37ff9c19 req-772d5652-9698-4c53-a6e6-44cae9f7be82 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:23:18 user nova-compute[72150]: DEBUG nova.network.neutron [req-4b95b6c5-86f4-4ff9-ad6d-e9bd37ff9c19 req-772d5652-9698-4c53-a6e6-44cae9f7be82 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4b95b6c5-86f4-4ff9-ad6d-e9bd37ff9c19 req-772d5652-9698-4c53-a6e6-44cae9f7be82 service nova] Releasing lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:19 user nova-compute[72150]: DEBUG nova.network.neutron [req-b41210e6-a6ef-41d2-a50b-838c52b05985 req-0eed4aef-da03-44fa-aec9-8986222f4f62 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Updated VIF entry in instance network info cache for port 13ea9e27-a7e5-4afa-bda3-87c95c480373. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:23:19 user nova-compute[72150]: DEBUG nova.network.neutron [req-b41210e6-a6ef-41d2-a50b-838c52b05985 req-0eed4aef-da03-44fa-aec9-8986222f4f62 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Updating instance_info_cache with network_info: [{"id": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "address": "fa:16:3e:92:3a:b2", "network": {"id": "e17eb56a-a429-4b1b-a469-106a0e453e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-502389898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e74d56b-c0", "ovs_interfaceid": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "address": "fa:16:3e:b7:55:d4", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2976671-7a", "ovs_interfaceid": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "address": "fa:16:3e:4d:a2:31", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11da1cb-a4", "ovs_interfaceid": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "624f99f7-d827-4106-9ffc-f57b26c45b5c", "address": "fa:16:3e:6e:78:7e", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624f99f7-d8", "ovs_interfaceid": "624f99f7-d827-4106-9ffc-f57b26c45b5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "address": "fa:16:3e:53:16:5f", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5fca36-38", "ovs_interfaceid": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af62c1f6-4440-4109-92b3-80721228f311", "address": "fa:16:3e:0a:89:2e", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf62c1f6-44", "ovs_interfaceid": "af62c1f6-4440-4109-92b3-80721228f311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "address": "fa:16:3e:1b:a3:2f", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ea9e27-a7", "ovs_interfaceid": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b41210e6-a6ef-41d2-a50b-838c52b05985 req-0eed4aef-da03-44fa-aec9-8986222f4f62 service nova] Releasing lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:19 user nova-compute[72150]: DEBUG nova.network.neutron [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Successfully updated port: 541680e9-0c34-47e2-b297-b3365281b90a {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:23:20 user nova-compute[72150]: DEBUG nova.network.neutron [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Successfully updated port: 1e6546d6-8fa5-4298-851b-3fb6efa9420c {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:23:20 user nova-compute[72150]: DEBUG nova.compute.manager [req-982ba359-8263-441e-adcb-5fd168b2844f req-74058f19-6c03-463d-808f-3f7d4085c8d6 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-changed-541680e9-0c34-47e2-b297-b3365281b90a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:20 user nova-compute[72150]: DEBUG nova.compute.manager [req-982ba359-8263-441e-adcb-5fd168b2844f req-74058f19-6c03-463d-808f-3f7d4085c8d6 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Refreshing instance network info cache due to event network-changed-541680e9-0c34-47e2-b297-b3365281b90a. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-982ba359-8263-441e-adcb-5fd168b2844f req-74058f19-6c03-463d-808f-3f7d4085c8d6 service nova] Acquiring lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-982ba359-8263-441e-adcb-5fd168b2844f req-74058f19-6c03-463d-808f-3f7d4085c8d6 service nova] Acquired lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:20 user nova-compute[72150]: DEBUG nova.network.neutron [req-982ba359-8263-441e-adcb-5fd168b2844f req-74058f19-6c03-463d-808f-3f7d4085c8d6 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Refreshing network info cache for port 541680e9-0c34-47e2-b297-b3365281b90a {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:21 user nova-compute[72150]: DEBUG nova.network.neutron [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Successfully updated port: 650c8b02-2525-403f-88d4-450a0903b33c {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:23:21 user nova-compute[72150]: DEBUG nova.network.neutron [req-982ba359-8263-441e-adcb-5fd168b2844f req-74058f19-6c03-463d-808f-3f7d4085c8d6 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:23:21 user nova-compute[72150]: DEBUG nova.network.neutron [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Successfully updated port: c024ac3e-43d1-4453-8715-9b49c747fb08 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:23:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Acquiring lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:21 user nova-compute[72150]: DEBUG nova.network.neutron [req-982ba359-8263-441e-adcb-5fd168b2844f req-74058f19-6c03-463d-808f-3f7d4085c8d6 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-982ba359-8263-441e-adcb-5fd168b2844f req-74058f19-6c03-463d-808f-3f7d4085c8d6 service nova] Releasing lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:21 user nova-compute[72150]: DEBUG nova.compute.manager [req-982ba359-8263-441e-adcb-5fd168b2844f req-74058f19-6c03-463d-808f-3f7d4085c8d6 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-changed-1e6546d6-8fa5-4298-851b-3fb6efa9420c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:21 user nova-compute[72150]: DEBUG nova.compute.manager [req-982ba359-8263-441e-adcb-5fd168b2844f req-74058f19-6c03-463d-808f-3f7d4085c8d6 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Refreshing instance network info cache due to event network-changed-1e6546d6-8fa5-4298-851b-3fb6efa9420c. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-982ba359-8263-441e-adcb-5fd168b2844f req-74058f19-6c03-463d-808f-3f7d4085c8d6 service nova] Acquiring lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-982ba359-8263-441e-adcb-5fd168b2844f req-74058f19-6c03-463d-808f-3f7d4085c8d6 service nova] Acquired lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:21 user nova-compute[72150]: DEBUG nova.network.neutron [req-982ba359-8263-441e-adcb-5fd168b2844f req-74058f19-6c03-463d-808f-3f7d4085c8d6 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Refreshing network info cache for port 1e6546d6-8fa5-4298-851b-3fb6efa9420c {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:22 user nova-compute[72150]: DEBUG nova.network.neutron [req-982ba359-8263-441e-adcb-5fd168b2844f req-74058f19-6c03-463d-808f-3f7d4085c8d6 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:23:22 user nova-compute[72150]: DEBUG nova.network.neutron [req-982ba359-8263-441e-adcb-5fd168b2844f req-74058f19-6c03-463d-808f-3f7d4085c8d6 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-982ba359-8263-441e-adcb-5fd168b2844f req-74058f19-6c03-463d-808f-3f7d4085c8d6 service nova] Releasing lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Acquired lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:22 user nova-compute[72150]: DEBUG nova.network.neutron [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:23:22 user nova-compute[72150]: DEBUG nova.network.neutron [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:23:22 user nova-compute[72150]: DEBUG nova.compute.manager [req-506eece2-9d5b-4288-9427-bcc1cc44b25c req-85f2bd99-4207-4658-a612-b8a41bae0435 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-changed-650c8b02-2525-403f-88d4-450a0903b33c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:22 user nova-compute[72150]: DEBUG nova.compute.manager [req-506eece2-9d5b-4288-9427-bcc1cc44b25c req-85f2bd99-4207-4658-a612-b8a41bae0435 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Refreshing instance network info cache due to event network-changed-650c8b02-2525-403f-88d4-450a0903b33c. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-506eece2-9d5b-4288-9427-bcc1cc44b25c req-85f2bd99-4207-4658-a612-b8a41bae0435 service nova] Acquiring lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:22 user nova-compute[72150]: DEBUG nova.compute.manager [req-75ce6a44-a3c0-4e69-be98-9500c2028bbe req-3f2ff3ef-4797-4652-9d08-26af13320000 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Received event network-changed-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:22 user nova-compute[72150]: DEBUG nova.compute.manager [req-75ce6a44-a3c0-4e69-be98-9500c2028bbe req-3f2ff3ef-4797-4652-9d08-26af13320000 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Refreshing instance network info cache due to event network-changed-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-75ce6a44-a3c0-4e69-be98-9500c2028bbe req-3f2ff3ef-4797-4652-9d08-26af13320000 service nova] Acquiring lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-75ce6a44-a3c0-4e69-be98-9500c2028bbe req-3f2ff3ef-4797-4652-9d08-26af13320000 service nova] Acquired lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:22 user nova-compute[72150]: DEBUG nova.network.neutron [req-75ce6a44-a3c0-4e69-be98-9500c2028bbe req-3f2ff3ef-4797-4652-9d08-26af13320000 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Refreshing network info cache for port b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:23 user nova-compute[72150]: INFO nova.virt.block_device [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Booting with volume 8274439e-c3d8-41cc-af90-e53d3ae158a9 at /dev/vdc
Aug 01 18:23:23 user nova-compute[72150]: DEBUG os_brick.utils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f257ff-ba21-42d0-9352-4b941ba72caa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4489d17e-8857-4639-b7a0-adbc306b51a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f706d3b-5952-45e4-8d0c-cf43387e96bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[96888c26-5cae-46c2-93e1-85baab2d353d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:23:23 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:23:23 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9ed2ff-7acc-4a92-93c8-5a544c260c17]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG os_brick.utils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Updating existing volume attachment record: ed7cb00b-e873-4db7-af2e-a69b874147f6 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG nova.network.neutron [req-75ce6a44-a3c0-4e69-be98-9500c2028bbe req-3f2ff3ef-4797-4652-9d08-26af13320000 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Updated VIF entry in instance network info cache for port b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG nova.network.neutron [req-75ce6a44-a3c0-4e69-be98-9500c2028bbe req-3f2ff3ef-4797-4652-9d08-26af13320000 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Updating instance_info_cache with network_info: [{"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-75ce6a44-a3c0-4e69-be98-9500c2028bbe req-3f2ff3ef-4797-4652-9d08-26af13320000 service nova] Releasing lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:24 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:23:24 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:23:24 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:23:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:24 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/214cf2f9-8bb2-431c-b5f4-15fc2fa526ed/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:25 user nova-compute[72150]: INFO nova.virt.block_device [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Booting with volume 12312153-e821-4e64-820f-7db2a4b28ea6 at /dev/vdb
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/214cf2f9-8bb2-431c-b5f4-15fc2fa526ed/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/214cf2f9-8bb2-431c-b5f4-15fc2fa526ed/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG os_brick.utils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/214cf2f9-8bb2-431c-b5f4-15fc2fa526ed/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d16ac0-2cd1-4154-a78a-e2a0a15ed54e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d63fca-46fe-490c-8e6a-99a4acb3e95e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdf97c4-fde3-4602-a282-0d1e59551e24]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[095988e1-3173-4d6f-bc1a-0f993e1bc361]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:23:25 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a70f4f4-6d99-4094-82b7-465bc44b6ea0]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG os_brick.utils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] <== get_connector_properties: return (194ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Updating existing volume attachment record: 47f11ea0-9d7d-4674-8694-cb2bca90eab2 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG nova.network.neutron [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Updating instance_info_cache with network_info: [{"id": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "address": "fa:16:3e:dc:77:d0", "network": {"id": "f9631fa1-8ca7-453e-a8c2-a550baa29167", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2010840575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a977ce-d7", "ovs_interfaceid": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77546d5a-e74c-4058-9008-a09a455ba8d0", "address": "fa:16:3e:87:f5:13", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77546d5a-e7", "ovs_interfaceid": "77546d5a-e74c-4058-9008-a09a455ba8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fab43aac-fc06-4876-8c52-6f3e5a492217", "address": "fa:16:3e:9c:44:4d", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab43aac-fc", "ovs_interfaceid": "fab43aac-fc06-4876-8c52-6f3e5a492217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "541680e9-0c34-47e2-b297-b3365281b90a", "address": "fa:16:3e:7f:67:77", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541680e9-0c", "ovs_interfaceid": "541680e9-0c34-47e2-b297-b3365281b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "address": "fa:16:3e:a8:fc:df", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6546d6-8f", "ovs_interfaceid": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "650c8b02-2525-403f-88d4-450a0903b33c", "address": "fa:16:3e:72:45:67", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650c8b02-25", "ovs_interfaceid": "650c8b02-2525-403f-88d4-450a0903b33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c024ac3e-43d1-4453-8715-9b49c747fb08", "address": "fa:16:3e:c3:8d:39", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc024ac3e-43", "ovs_interfaceid": "c024ac3e-43d1-4453-8715-9b49c747fb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Releasing lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG nova.compute.manager [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Instance network_info: |[{"id": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "address": "fa:16:3e:dc:77:d0", "network": {"id": "f9631fa1-8ca7-453e-a8c2-a550baa29167", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2010840575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a977ce-d7", "ovs_interfaceid": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77546d5a-e74c-4058-9008-a09a455ba8d0", "address": "fa:16:3e:87:f5:13", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77546d5a-e7", "ovs_interfaceid": "77546d5a-e74c-4058-9008-a09a455ba8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fab43aac-fc06-4876-8c52-6f3e5a492217", "address": "fa:16:3e:9c:44:4d", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab43aac-fc", "ovs_interfaceid": "fab43aac-fc06-4876-8c52-6f3e5a492217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "541680e9-0c34-47e2-b297-b3365281b90a", "address": "fa:16:3e:7f:67:77", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541680e9-0c", "ovs_interfaceid": "541680e9-0c34-47e2-b297-b3365281b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "address": "fa:16:3e:a8:fc:df", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6546d6-8f", "ovs_interfaceid": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "650c8b02-2525-403f-88d4-450a0903b33c", "address": "fa:16:3e:72:45:67", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650c8b02-25", "ovs_interfaceid": "650c8b02-2525-403f-88d4-450a0903b33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c024ac3e-43d1-4453-8715-9b49c747fb08", "address": "fa:16:3e:c3:8d:39", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc024ac3e-43", "ovs_interfaceid": "c024ac3e-43d1-4453-8715-9b49c747fb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-506eece2-9d5b-4288-9427-bcc1cc44b25c req-85f2bd99-4207-4658-a612-b8a41bae0435 service nova] Acquired lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG nova.network.neutron [req-506eece2-9d5b-4288-9427-bcc1cc44b25c req-85f2bd99-4207-4658-a612-b8a41bae0435 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Refreshing network info cache for port 650c8b02-2525-403f-88d4-450a0903b33c {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3811375-bcd1-46ac-b552-7ff1588a3667/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3811375-bcd1-46ac-b552-7ff1588a3667/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3811375-bcd1-46ac-b552-7ff1588a3667/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3811375-bcd1-46ac-b552-7ff1588a3667/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG nova.network.neutron [req-506eece2-9d5b-4288-9427-bcc1cc44b25c req-85f2bd99-4207-4658-a612-b8a41bae0435 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Updated VIF entry in instance network info cache for port 650c8b02-2525-403f-88d4-450a0903b33c. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG nova.network.neutron [req-506eece2-9d5b-4288-9427-bcc1cc44b25c req-85f2bd99-4207-4658-a612-b8a41bae0435 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Updating instance_info_cache with network_info: [{"id": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "address": "fa:16:3e:dc:77:d0", "network": {"id": "f9631fa1-8ca7-453e-a8c2-a550baa29167", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2010840575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a977ce-d7", "ovs_interfaceid": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77546d5a-e74c-4058-9008-a09a455ba8d0", "address": "fa:16:3e:87:f5:13", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77546d5a-e7", "ovs_interfaceid": "77546d5a-e74c-4058-9008-a09a455ba8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fab43aac-fc06-4876-8c52-6f3e5a492217", "address": "fa:16:3e:9c:44:4d", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab43aac-fc", "ovs_interfaceid": "fab43aac-fc06-4876-8c52-6f3e5a492217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "541680e9-0c34-47e2-b297-b3365281b90a", "address": "fa:16:3e:7f:67:77", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541680e9-0c", "ovs_interfaceid": "541680e9-0c34-47e2-b297-b3365281b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "address": "fa:16:3e:a8:fc:df", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6546d6-8f", "ovs_interfaceid": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "650c8b02-2525-403f-88d4-450a0903b33c", "address": "fa:16:3e:72:45:67", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650c8b02-25", "ovs_interfaceid": "650c8b02-2525-403f-88d4-450a0903b33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c024ac3e-43d1-4453-8715-9b49c747fb08", "address": "fa:16:3e:c3:8d:39", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc024ac3e-43", "ovs_interfaceid": "c024ac3e-43d1-4453-8715-9b49c747fb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:28 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:23:28 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:23:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=7476MB free_disk=25.870807647705078GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-506eece2-9d5b-4288-9427-bcc1cc44b25c req-85f2bd99-4207-4658-a612-b8a41bae0435 service nova] Releasing lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG nova.compute.manager [req-506eece2-9d5b-4288-9427-bcc1cc44b25c req-85f2bd99-4207-4658-a612-b8a41bae0435 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-changed-c024ac3e-43d1-4453-8715-9b49c747fb08 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG nova.compute.manager [req-506eece2-9d5b-4288-9427-bcc1cc44b25c req-85f2bd99-4207-4658-a612-b8a41bae0435 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Refreshing instance network info cache due to event network-changed-c024ac3e-43d1-4453-8715-9b49c747fb08. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-506eece2-9d5b-4288-9427-bcc1cc44b25c req-85f2bd99-4207-4658-a612-b8a41bae0435 service nova] Acquiring lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-506eece2-9d5b-4288-9427-bcc1cc44b25c req-85f2bd99-4207-4658-a612-b8a41bae0435 service nova] Acquired lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG nova.network.neutron [req-506eece2-9d5b-4288-9427-bcc1cc44b25c req-85f2bd99-4207-4658-a612-b8a41bae0435 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Refreshing network info cache for port c024ac3e-43d1-4453-8715-9b49c747fb08 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 3f123d4e-1aec-4aa1-8717-f31305a62a5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance c3811375-bcd1-46ac-b552-7ff1588a3667 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 050260e0-53e0-43dd-a301-a4e3e411f34d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 554b19ce-2ea6-4494-bdd9-a02444ca920e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 161fa35c-1f33-4ea7-94a9-c3b78952155e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ad033976-bfc8-46b9-89bf-f752ae0cdf01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 56ad8a5d-4046-463d-9259-67014867ebfe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 39ed0e93-df10-4f34-b13a-66a1825d21b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:28 user nova-compute[72150]: INFO nova.compute.manager [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Shelving
Aug 01 18:23:28 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.575s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG nova.network.neutron [req-506eece2-9d5b-4288-9427-bcc1cc44b25c req-85f2bd99-4207-4658-a612-b8a41bae0435 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Updated VIF entry in instance network info cache for port c024ac3e-43d1-4453-8715-9b49c747fb08. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:23:28 user nova-compute[72150]: DEBUG nova.network.neutron [req-506eece2-9d5b-4288-9427-bcc1cc44b25c req-85f2bd99-4207-4658-a612-b8a41bae0435 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Updating instance_info_cache with network_info: [{"id": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "address": "fa:16:3e:dc:77:d0", "network": {"id": "f9631fa1-8ca7-453e-a8c2-a550baa29167", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2010840575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a977ce-d7", "ovs_interfaceid": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77546d5a-e74c-4058-9008-a09a455ba8d0", "address": "fa:16:3e:87:f5:13", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77546d5a-e7", "ovs_interfaceid": "77546d5a-e74c-4058-9008-a09a455ba8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fab43aac-fc06-4876-8c52-6f3e5a492217", "address": "fa:16:3e:9c:44:4d", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab43aac-fc", "ovs_interfaceid": "fab43aac-fc06-4876-8c52-6f3e5a492217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "541680e9-0c34-47e2-b297-b3365281b90a", "address": "fa:16:3e:7f:67:77", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541680e9-0c", "ovs_interfaceid": "541680e9-0c34-47e2-b297-b3365281b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "address": "fa:16:3e:a8:fc:df", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6546d6-8f", "ovs_interfaceid": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "650c8b02-2525-403f-88d4-450a0903b33c", "address": "fa:16:3e:72:45:67", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650c8b02-25", "ovs_interfaceid": "650c8b02-2525-403f-88d4-450a0903b33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c024ac3e-43d1-4453-8715-9b49c747fb08", "address": "fa:16:3e:c3:8d:39", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc024ac3e-43", "ovs_interfaceid": "c024ac3e-43d1-4453-8715-9b49c747fb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-506eece2-9d5b-4288-9427-bcc1cc44b25c req-85f2bd99-4207-4658-a612-b8a41bae0435 service nova] Releasing lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Acquiring lock "c3811375-bcd1-46ac-b552-7ff1588a3667" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "c3811375-bcd1-46ac-b552-7ff1588a3667" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-0222a1cf-9c6b-4222-bcde-1a12350648ec req-351f272e-7ba2-4efc-987f-95eea5383066 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Received event network-vif-unplugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0222a1cf-9c6b-4222-bcde-1a12350648ec req-351f272e-7ba2-4efc-987f-95eea5383066 service nova] Acquiring lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0222a1cf-9c6b-4222-bcde-1a12350648ec req-351f272e-7ba2-4efc-987f-95eea5383066 service nova] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0222a1cf-9c6b-4222-bcde-1a12350648ec req-351f272e-7ba2-4efc-987f-95eea5383066 service nova] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-0222a1cf-9c6b-4222-bcde-1a12350648ec req-351f272e-7ba2-4efc-987f-95eea5383066 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] No waiting events found dispatching network-vif-unplugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:29 user nova-compute[72150]: WARNING nova.compute.manager [req-0222a1cf-9c6b-4222-bcde-1a12350648ec req-351f272e-7ba2-4efc-987f-95eea5383066 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Received unexpected event network-vif-unplugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 for instance with vm_state active and task_state shelving.
Aug 01 18:23:29 user nova-compute[72150]: DEBUG nova.objects.instance [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lazy-loading 'flavor' on Instance uuid c3811375-bcd1-46ac-b552-7ff1588a3667 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "c3811375-bcd1-46ac-b552-7ff1588a3667" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Acquiring lock "c3811375-bcd1-46ac-b552-7ff1588a3667" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "c3811375-bcd1-46ac-b552-7ff1588a3667" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:29 user nova-compute[72150]: INFO nova.compute.manager [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Attaching volume 6555d10c-408e-4e93-8df2-ab6b69855a60 to /dev/vdb
Aug 01 18:23:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-757833dd-e2ca-43c3-a593-43b408d410a8 req-cde67d2f-74df-4455-a9a9-09d8838e1dd4 service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Received event network-changed-c82387ba-7cc9-4eac-9469-021c80c1c195 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-757833dd-e2ca-43c3-a593-43b408d410a8 req-cde67d2f-74df-4455-a9a9-09d8838e1dd4 service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Refreshing instance network info cache due to event network-changed-c82387ba-7cc9-4eac-9469-021c80c1c195. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-757833dd-e2ca-43c3-a593-43b408d410a8 req-cde67d2f-74df-4455-a9a9-09d8838e1dd4 service nova] Acquiring lock "refresh_cache-050260e0-53e0-43dd-a301-a4e3e411f34d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-757833dd-e2ca-43c3-a593-43b408d410a8 req-cde67d2f-74df-4455-a9a9-09d8838e1dd4 service nova] Acquired lock "refresh_cache-050260e0-53e0-43dd-a301-a4e3e411f34d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG nova.network.neutron [req-757833dd-e2ca-43c3-a593-43b408d410a8 req-cde67d2f-74df-4455-a9a9-09d8838e1dd4 service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Refreshing network info cache for port c82387ba-7cc9-4eac-9469-021c80c1c195 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:29 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Instance destroyed successfully.
Aug 01 18:23:29 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Beginning cold snapshot process
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG os_brick.utils [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a3b6ad-5713-4fed-a9d2-48cf735700e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8e1811-9f9a-48aa-a068-6ed2d0dd281a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13d7fc1-88e4-45b5-b003-a731832ec184]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1020ea3-1e6d-42bb-964b-d75af6425fa6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:23:29 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:23:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9081915-e58c-4e29-9965-60a7a32df053]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG os_brick.utils [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:23:29 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Updating existing volume attachment record: 1e1a74fa-a56d-443d-bc3c-a64e59cff288 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:23:30 user nova-compute[72150]: DEBUG nova.privsep.utils [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72150) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 18:23:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk /opt/stack/data/nova/instances/snapshots/tmpwhai94iy/b25f2c602c4d4b2f9ad44d4da7ec976b {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:30 user nova-compute[72150]: DEBUG nova.network.neutron [req-757833dd-e2ca-43c3-a593-43b408d410a8 req-cde67d2f-74df-4455-a9a9-09d8838e1dd4 service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Updated VIF entry in instance network info cache for port c82387ba-7cc9-4eac-9469-021c80c1c195. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:23:30 user nova-compute[72150]: DEBUG nova.network.neutron [req-757833dd-e2ca-43c3-a593-43b408d410a8 req-cde67d2f-74df-4455-a9a9-09d8838e1dd4 service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Updating instance_info_cache with network_info: [{"id": "c82387ba-7cc9-4eac-9469-021c80c1c195", "address": "fa:16:3e:ba:0b:96", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82387ba-7c", "ovs_interfaceid": "c82387ba-7cc9-4eac-9469-021c80c1c195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-757833dd-e2ca-43c3-a593-43b408d410a8 req-cde67d2f-74df-4455-a9a9-09d8838e1dd4 service nova] Releasing lock "refresh_cache-050260e0-53e0-43dd-a301-a4e3e411f34d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk /opt/stack/data/nova/instances/snapshots/tmpwhai94iy/b25f2c602c4d4b2f9ad44d4da7ec976b" returned: 0 in 0.790s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:30 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Snapshot extracted, beginning image upload
Aug 01 18:23:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:31 user nova-compute[72150]: DEBUG nova.compute.manager [req-4a3ce0a0-f8a9-44ec-9010-3b7c3eae26f4 req-a3cf212b-0832-46fd-9cfd-e9b154887d16 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Received event network-vif-plugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4a3ce0a0-f8a9-44ec-9010-3b7c3eae26f4 req-a3cf212b-0832-46fd-9cfd-e9b154887d16 service nova] Acquiring lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4a3ce0a0-f8a9-44ec-9010-3b7c3eae26f4 req-a3cf212b-0832-46fd-9cfd-e9b154887d16 service nova] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4a3ce0a0-f8a9-44ec-9010-3b7c3eae26f4 req-a3cf212b-0832-46fd-9cfd-e9b154887d16 service nova] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:31 user nova-compute[72150]: DEBUG nova.compute.manager [req-4a3ce0a0-f8a9-44ec-9010-3b7c3eae26f4 req-a3cf212b-0832-46fd-9cfd-e9b154887d16 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] No waiting events found dispatching network-vif-plugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:31 user nova-compute[72150]: WARNING nova.compute.manager [req-4a3ce0a0-f8a9-44ec-9010-3b7c3eae26f4 req-a3cf212b-0832-46fd-9cfd-e9b154887d16 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Received unexpected event network-vif-plugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 for instance with vm_state active and task_state shelving_image_uploading.
Aug 01 18:23:31 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:23:31 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:23:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-c3811375-bcd1-46ac-b552-7ff1588a3667" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-c3811375-bcd1-46ac-b552-7ff1588a3667" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:31 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:23:32 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Updating instance_info_cache with network_info: [{"id": "1a68eacb-ee1f-4cf8-a15f-668e9a3da691", "address": "fa:16:3e:9e:ba:be", "network": {"id": "f3e4e91a-ba2c-4e94-9f12-bac4dc4607ad", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1636291956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7f76aef75642d0bffa978550d6935d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68eacb-ee", "ovs_interfaceid": "1a68eacb-ee1f-4cf8-a15f-668e9a3da691", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-c3811375-bcd1-46ac-b552-7ff1588a3667" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:32 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:23:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:33 user nova-compute[72150]: DEBUG nova.compute.manager [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:23:33 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Snapshot image upload complete
Aug 01 18:23:33 user nova-compute[72150]: DEBUG nova.compute.manager [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:23:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:33 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:23:33 user nova-compute[72150]: INFO nova.compute.claims [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Claim successful on node user
Aug 01 18:23:33 user nova-compute[72150]: INFO nova.compute.manager [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Shelve offloading
Aug 01 18:23:33 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Instance destroyed successfully.
Aug 01 18:23:33 user nova-compute[72150]: DEBUG nova.compute.manager [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:23:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquired lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:33 user nova-compute[72150]: DEBUG nova.network.neutron [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.compute.manager [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:23:34 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Creating image(s)
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Did not create local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Ensure instance console log exists: /opt/stack/data/nova/instances/56ad8a5d-4046-463d-9259-67014867ebfe/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Start _get_guest_xml network_info=[{"id": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "address": "fa:16:3e:92:3a:b2", "network": {"id": "e17eb56a-a429-4b1b-a469-106a0e453e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-502389898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e74d56b-c0", "ovs_interfaceid": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "address": "fa:16:3e:b7:55:d4", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2976671-7a", "ovs_interfaceid": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "address": "fa:16:3e:4d:a2:31", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11da1cb-a4", "ovs_interfaceid": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "624f99f7-d827-4106-9ffc-f57b26c45b5c", "address": "fa:16:3e:6e:78:7e", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624f99f7-d8", "ovs_interfaceid": "624f99f7-d827-4106-9ffc-f57b26c45b5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "address": "fa:16:3e:53:16:5f", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5fca36-38", "ovs_interfaceid": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af62c1f6-4440-4109-92b3-80721228f311", "address": "fa:16:3e:0a:89:2e", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf62c1f6-44", "ovs_interfaceid": "af62c1f6-4440-4109-92b3-80721228f311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "address": "fa:16:3e:1b:a3:2f", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ea9e27-a7", "ovs_interfaceid": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4508dd60-2c2d-4da5-893a-f8a0f5a5b3f7', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dpAqiOch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '56ad8a5d-4046-463d-9259-67014867ebfe', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4616a37-17ef-4d3d-a9c8-02871bd0b134', 'serial': 'b4616a37-17ef-4d3d-a9c8-02871bd0b134'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': 'fb7cdf57-d861-4b4b-b88b-37343925ae1d', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cXhLHmgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '56ad8a5d-4046-463d-9259-67014867ebfe', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f', 'serial': 'ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': 'ed7cb00b-e873-4db7-af2e-a69b874147f6', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'acUrAZfO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '56ad8a5d-4046-463d-9259-67014867ebfe', 'attached_at': '', 'detached_at': '', 'volume_id': '8274439e-c3d8-41cc-af90-e53d3ae158a9', 'serial': '8274439e-c3d8-41cc-af90-e53d3ae158a9'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:23:34 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:23:34 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.connector [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Factory for ISCSI on None {{(pid=72150) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dpAqiOch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:23:34 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:23:34 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:23:34 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0119fb80-6f34-4d44-95cc-411023ea7b92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:23:34 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17ce194-06a9-47b3-96aa-0fd34c68ca73]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134] added
Aug 01 18:23:34 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[75838e12-e9ff-480b-ae92-dda582ec63c8]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6ebb4b-3b5b-4c1c-8592-699f815d3d20]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dpAqiOch {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.727s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.compute.manager [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dpAqiOch" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fb351f-0444-403d-9a33-28b9888a462a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dpAqiOch'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac729fe-17c1-4077-991f-3710252eed02]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.network.neutron [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Updating instance_info_cache with network_info: [{"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb54121a-24a8-416d-90d2-71fb08aa9ca6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 18:23:34 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 18:23:34 user nova-compute[72150]:  {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:23:34 user nova-compute[72150]: WARNING os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 18:23:34 user nova-compute[72150]: 
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Releasing lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.compute.manager [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.network.neutron [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a053e7dc-5895-4bad-9038-aa4f87ffc54d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134, portal: 172.16.0.220,3260]
Aug 01 18:23:34 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134, portal: 172.16.0.220,3260] successful.
Aug 01 18:23:34 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:34 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdb2826-8f58-439b-adc3-42edc66d7f75]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.compute.manager [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec053fc-1672-4dba-91e5-f27ec6577f31]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:34 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:34 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] HCTL ('33', '-', '-', 0) found on session 4 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2303a355-9ec0-4b56-b119-0e4c1f9bef26]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Searching for a device in session 4 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dpAqiOch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.policy [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d89a05b857d43c48f0767eb073a2f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96498272792348f3a3c36ee8544100f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.compute.manager [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:23:34 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Creating image(s)
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "/opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "/opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "/opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "49572197531b3fda7c0e699167df4e97b908aabe" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "49572197531b3fda7c0e699167df4e97b908aabe" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:34 user nova-compute[72150]: INFO nova.virt.block_device [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Booting with volume 5a5cada3-ff99-466b-8de0-0ffa99d75534 at /dev/vdc
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49572197531b3fda7c0e699167df4e97b908aabe.part --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG os_brick.utils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee926f04-9286-425c-ada4-b94307ece72f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49572197531b3fda7c0e699167df4e97b908aabe.part --force-share --output=json" returned: 0 in 0.177s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG nova.virt.images [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] 77f1cc65-b096-4fb4-9a06-228694cfa68c was qcow2, converting to raw {{(pid=72150) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG nova.privsep.utils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72150) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/49572197531b3fda7c0e699167df4e97b908aabe.part /opt/stack/data/nova/instances/_base/49572197531b3fda7c0e699167df4e97b908aabe.converted {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c8cd1e-7923-4c9d-b871-546a58018b74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG nova.compute.manager [req-ffb6f98e-88a2-415a-9069-98a26acc6a4e req-5139e359-6376-4e6b-b2ef-84df1f9dd9d3 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Received event network-changed-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG nova.compute.manager [req-ffb6f98e-88a2-415a-9069-98a26acc6a4e req-5139e359-6376-4e6b-b2ef-84df1f9dd9d3 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Refreshing instance network info cache due to event network-changed-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ffb6f98e-88a2-415a-9069-98a26acc6a4e req-5139e359-6376-4e6b-b2ef-84df1f9dd9d3 service nova] Acquiring lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ffb6f98e-88a2-415a-9069-98a26acc6a4e req-5139e359-6376-4e6b-b2ef-84df1f9dd9d3 service nova] Acquired lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG nova.network.neutron [req-ffb6f98e-88a2-415a-9069-98a26acc6a4e req-5139e359-6376-4e6b-b2ef-84df1f9dd9d3 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Refreshing network info cache for port b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:35 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Instance destroyed successfully.
Aug 01 18:23:35 user nova-compute[72150]: DEBUG nova.objects.instance [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'resources' on Instance uuid 3f123d4e-1aec-4aa1-8717-f31305a62a5d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb2d006-b59d-4523-bdfc-bccd4e40af8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1003209770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1003209770',id=1,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbjycC5zBZm+jvsm6GKYmgPP65OAatTQjCe2+mKm63L/m7E/UypS6JMjfua0Hf9QrTu6zvwdEzRoBZi9TuD4yBQcH8hOrW2tjxpilyk89sJYOLq8mOKZh/+51AlthHzMA==',key_name='tempest-keypair-1020169864',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:21:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='493923414b464384bb3a1ce3e6f7a2f0',ramdisk_id='',reservation_id='r-6jxlw7xx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849821930',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849821930-project-member',shelved_at='2023-08-01T18:23:33.835905',shelved_host='user',shelved_image_id='57df6da1-0e8d-4695-8c9f-330d0cd907aa'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:23:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5804d69f9f18482f9fe0e0d4d73c4e92',uuid=3f123d4e-1aec-4aa1-8717-f31305a62a5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converting VIF {"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fb:29,bridge_name='br-int',has_traffic_filtering=True,id=b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc6d1a-9b') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG os_vif [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fb:29,bridge_name='br-int',has_traffic_filtering=True,id=b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc6d1a-9b') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[181447c5-da6b-43fb-b2ab-0e40434e3f58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3bc6d1a-9b, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/49572197531b3fda7c0e699167df4e97b908aabe.part /opt/stack/data/nova/instances/_base/49572197531b3fda7c0e699167df4e97b908aabe.converted" returned: 0 in 0.151s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49572197531b3fda7c0e699167df4e97b908aabe.converted --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:23:35 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3def312c-0d00-46c4-b531-13e9c4e03f26]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG os_brick.utils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] <== get_connector_properties: return (245ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Updating existing volume attachment record: ea432378-ba11-4c9f-96e0-352c1bd2ce46 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:23:35 user nova-compute[72150]: INFO os_vif [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fb:29,bridge_name='br-int',has_traffic_filtering=True,id=b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc6d1a-9b')
Aug 01 18:23:35 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Deleting instance files /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d_del
Aug 01 18:23:35 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Deletion of /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d_del complete
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49572197531b3fda7c0e699167df4e97b908aabe.converted --force-share --output=json" returned: 0 in 0.147s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "49572197531b3fda7c0e699167df4e97b908aabe" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.882s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49572197531b3fda7c0e699167df4e97b908aabe --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '23233393636663966', 'path': '/dev/sdb'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233393636663966', 'path': '/dev/sdb'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72150) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 01 18:23:35 user nova-compute[72150]: INFO nova.virt.libvirt.host [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] UEFI support detected
Aug 01 18:23:35 user nova-compute[72150]: DEBUG nova.network.neutron [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Successfully created port: 10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cXhLHmgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:23:35 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:23:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:23:35 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:23:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:23:35 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:35 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Deleted allocations for instance 3f123d4e-1aec-4aa1-8717-f31305a62a5d
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dceb6968-1b3a-460a-b4ec-0c4703428a74]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:23:35 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49572197531b3fda7c0e699167df4e97b908aabe --force-share --output=json" returned: 0 in 0.172s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "49572197531b3fda7c0e699167df4e97b908aabe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "49572197531b3fda7c0e699167df4e97b908aabe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49572197531b3fda7c0e699167df4e97b908aabe --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f40d690-f7f4-4bba-8a29-9df97e7634d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f] added
Aug 01 18:23:36 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG nova.objects.instance [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'numa_topology' on Instance uuid 3f123d4e-1aec-4aa1-8717-f31305a62a5d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8aa637f-1fe6-49b3-853f-4a317b51496e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[177bfcc3-3eb0-41e3-a831-d544591a3f8e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cXhLHmgE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cXhLHmgE" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51490ed-aef2-485c-b68b-6d918adea922]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cXhLHmgE'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49572197531b3fda7c0e699167df4e97b908aabe --force-share --output=json" returned: 0 in 0.163s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/49572197531b3fda7c0e699167df4e97b908aabe,backing_fmt=raw /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb3cb78-e5fe-4994-8104-7c4595f8d986]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/49572197531b3fda7c0e699167df4e97b908aabe,backing_fmt=raw /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk 1073741824" returned: 0 in 0.062s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "49572197531b3fda7c0e699167df4e97b908aabe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49572197531b3fda7c0e699167df4e97b908aabe --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d33f2b-b52f-40ae-9e15-2426b481e492]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:36 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:36 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d14b5f-ba2d-42b9-b8e3-6511edcf6ca8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f, portal: 172.16.0.220,3260]
Aug 01 18:23:36 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f, portal: 172.16.0.220,3260] successful.
Aug 01 18:23:36 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2f0b18-70e4-43ad-a48c-eb1bd62832d1]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49572197531b3fda7c0e699167df4e97b908aabe --force-share --output=json" returned: 0 in 0.163s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4a6941-06ab-4415-9413-3a7689c66700]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:36 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:36 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:36 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:36 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.506s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] HCTL ('34', '-', '-', 0) found on session 5 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG nova.network.neutron [req-ffb6f98e-88a2-415a-9069-98a26acc6a4e req-5139e359-6376-4e6b-b2ef-84df1f9dd9d3 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Updated VIF entry in instance network info cache for port b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG nova.network.neutron [req-ffb6f98e-88a2-415a-9069-98a26acc6a4e req-5139e359-6376-4e6b-b2ef-84df1f9dd9d3 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Updating instance_info_cache with network_info: [{"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[de456e5d-33bc-43fb-a5bb-64e6106a325d]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Searching for a device in session 5 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cXhLHmgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ffb6f98e-88a2-415a-9069-98a26acc6a4e req-5139e359-6376-4e6b-b2ef-84df1f9dd9d3 service nova] Releasing lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Cannot resize image /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG nova.objects.instance [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lazy-loading 'migration_context' on Instance uuid e298ac85-ebe3-4aa1-ae1e-91134e13e230 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Ensure instance console log exists: /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.644s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4ead6a65-a9f4-4f55-8159-cfd7aa1f4aca tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.122s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG nova.network.neutron [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Successfully updated port: 10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquired lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG nova.network.neutron [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG nova.compute.manager [req-b90f49cf-b907-4b85-b365-158197b9961c req-529b90e5-94a4-4e55-937d-a155d3f7606f service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Received event network-changed-10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG nova.compute.manager [req-b90f49cf-b907-4b85-b365-158197b9961c req-529b90e5-94a4-4e55-937d-a155d3f7606f service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Refreshing instance network info cache due to event network-changed-10176957-b4a6-4052-9a16-21152c8c3da5. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b90f49cf-b907-4b85-b365-158197b9961c req-529b90e5-94a4-4e55-937d-a155d3f7606f service nova] Acquiring lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:36 user nova-compute[72150]: DEBUG nova.network.neutron [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.network.neutron [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Updating instance_info_cache with network_info: [{"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Releasing lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.compute.manager [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Instance network_info: |[{"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b90f49cf-b907-4b85-b365-158197b9961c req-529b90e5-94a4-4e55-937d-a155d3f7606f service nova] Acquired lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.network.neutron [req-b90f49cf-b907-4b85-b365-158197b9961c req-529b90e5-94a4-4e55-937d-a155d3f7606f service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Refreshing network info cache for port 10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Start _get_guest_xml network_info=[{"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:23:29Z,direct_url=<?>,disk_format='qcow2',id=77f1cc65-b096-4fb4-9a06-228694cfa68c,min_disk=0,min_ram=0,name='tempest-scenario-img--1394164085',owner='96498272792348f3a3c36ee8544100f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:23:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '77f1cc65-b096-4fb4-9a06-228694cfa68c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:23:37 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:23:37 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:23:29Z,direct_url=<?>,disk_format='qcow2',id=77f1cc65-b096-4fb4-9a06-228694cfa68c,min_disk=0,min_ram=0,name='tempest-scenario-img--1394164085',owner='96498272792348f3a3c36ee8544100f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:23:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-994333634',display_name='tempest-TestMinimumBasicScenario-server-994333634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-994333634',id=10,image_ref='77f1cc65-b096-4fb4-9a06-228694cfa68c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbsn8B14gNBI86YJLjn/1VQez4DBB7aV+emX4GIXXc8vb1FExIR+LmGYrOj/H27n+sU8ppSkdq7Qd+qISkUEu9gB+bpJa5naC6wPuaKhrVxha5Jkg1IxeczFB5ECbdm1A==',key_name='tempest-TestMinimumBasicScenario-1137783295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96498272792348f3a3c36ee8544100f2',ramdisk_id='',reservation_id='r-c4g57isj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77f1cc65-b096-4fb4-9a06-228694cfa68c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-879365140',owner_user_name='tempest-TestMinimumBasicScenario-879365140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:35Z,user_data=None,user_id='3d89a05b857d43c48f0767eb073a2f37',uuid=e298ac85-ebe3-4aa1-ae1e-91134e13e230,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Converting VIF {"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:4e:93,bridge_name='br-int',has_traffic_filtering=True,id=10176957-b4a6-4052-9a16-21152c8c3da5,network=Network(e3a4003a-4248-4265-b270-f289b1c2810f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10176957-b4') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.objects.instance [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lazy-loading 'pci_devices' on Instance uuid e298ac85-ebe3-4aa1-ae1e-91134e13e230 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:23:37 user nova-compute[72150]:   <uuid>e298ac85-ebe3-4aa1-ae1e-91134e13e230</uuid>
Aug 01 18:23:37 user nova-compute[72150]:   <name>instance-0000000a</name>
Aug 01 18:23:37 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:23:37 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:23:37 user nova-compute[72150]:   <metadata>
Aug 01 18:23:37 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:23:37 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:23:37 user nova-compute[72150]:       <nova:name>tempest-TestMinimumBasicScenario-server-994333634</nova:name>
Aug 01 18:23:37 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:23:37</nova:creationTime>
Aug 01 18:23:37 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:23:37 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:23:37 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:23:37 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:23:37 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:23:37 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:23:37 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:23:37 user nova-compute[72150]:       <nova:owner>
Aug 01 18:23:37 user nova-compute[72150]:         <nova:user uuid="3d89a05b857d43c48f0767eb073a2f37">tempest-TestMinimumBasicScenario-879365140-project-member</nova:user>
Aug 01 18:23:37 user nova-compute[72150]:         <nova:project uuid="96498272792348f3a3c36ee8544100f2">tempest-TestMinimumBasicScenario-879365140</nova:project>
Aug 01 18:23:37 user nova-compute[72150]:       </nova:owner>
Aug 01 18:23:37 user nova-compute[72150]:       <nova:root type="image" uuid="77f1cc65-b096-4fb4-9a06-228694cfa68c"/>
Aug 01 18:23:37 user nova-compute[72150]:       <nova:ports>
Aug 01 18:23:37 user nova-compute[72150]:         <nova:port uuid="10176957-b4a6-4052-9a16-21152c8c3da5">
Aug 01 18:23:37 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 18:23:37 user nova-compute[72150]:         </nova:port>
Aug 01 18:23:37 user nova-compute[72150]:       </nova:ports>
Aug 01 18:23:37 user nova-compute[72150]:     </nova:instance>
Aug 01 18:23:37 user nova-compute[72150]:   </metadata>
Aug 01 18:23:37 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:23:37 user nova-compute[72150]:     <system>
Aug 01 18:23:37 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:23:37 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:23:37 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:23:37 user nova-compute[72150]:       <entry name="serial">e298ac85-ebe3-4aa1-ae1e-91134e13e230</entry>
Aug 01 18:23:37 user nova-compute[72150]:       <entry name="uuid">e298ac85-ebe3-4aa1-ae1e-91134e13e230</entry>
Aug 01 18:23:37 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:23:37 user nova-compute[72150]:     </system>
Aug 01 18:23:37 user nova-compute[72150]:   </sysinfo>
Aug 01 18:23:37 user nova-compute[72150]:   <os>
Aug 01 18:23:37 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:23:37 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:23:37 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:23:37 user nova-compute[72150]:   </os>
Aug 01 18:23:37 user nova-compute[72150]:   <features>
Aug 01 18:23:37 user nova-compute[72150]:     <acpi/>
Aug 01 18:23:37 user nova-compute[72150]:     <apic/>
Aug 01 18:23:37 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:23:37 user nova-compute[72150]:   </features>
Aug 01 18:23:37 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:23:37 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:23:37 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:23:37 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:23:37 user nova-compute[72150]:   </clock>
Aug 01 18:23:37 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:23:37 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:23:37 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:23:37 user nova-compute[72150]:   </cpu>
Aug 01 18:23:37 user nova-compute[72150]:   <devices>
Aug 01 18:23:37 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:23:37 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:23:37 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk"/>
Aug 01 18:23:37 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:23:37 user nova-compute[72150]:     </disk>
Aug 01 18:23:37 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:23:37 user nova-compute[72150]:       <mac address="fa:16:3e:c1:4e:93"/>
Aug 01 18:23:37 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:23:37 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:23:37 user nova-compute[72150]:       <target dev="tap10176957-b4"/>
Aug 01 18:23:37 user nova-compute[72150]:     </interface>
Aug 01 18:23:37 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:23:37 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/console.log" append="off"/>
Aug 01 18:23:37 user nova-compute[72150]:     </serial>
Aug 01 18:23:37 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:23:37 user nova-compute[72150]:     <video>
Aug 01 18:23:37 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:23:37 user nova-compute[72150]:     </video>
Aug 01 18:23:37 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:23:37 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:23:37 user nova-compute[72150]:     </rng>
Aug 01 18:23:37 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:23:37 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:23:37 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:23:37 user nova-compute[72150]:     </memballoon>
Aug 01 18:23:37 user nova-compute[72150]:   </devices>
Aug 01 18:23:37 user nova-compute[72150]: </domain>
Aug 01 18:23:37 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-994333634',display_name='tempest-TestMinimumBasicScenario-server-994333634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-994333634',id=10,image_ref='77f1cc65-b096-4fb4-9a06-228694cfa68c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbsn8B14gNBI86YJLjn/1VQez4DBB7aV+emX4GIXXc8vb1FExIR+LmGYrOj/H27n+sU8ppSkdq7Qd+qISkUEu9gB+bpJa5naC6wPuaKhrVxha5Jkg1IxeczFB5ECbdm1A==',key_name='tempest-TestMinimumBasicScenario-1137783295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96498272792348f3a3c36ee8544100f2',ramdisk_id='',reservation_id='r-c4g57isj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77f1cc65-b096-4fb4-9a06-228694cfa68c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-879365140',owner_user_name='tempest-TestMinimumBasicScenario-879365140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:35Z,user_data=None,user_id='3d89a05b857d43c48f0767eb073a2f37',uuid=e298ac85-ebe3-4aa1-ae1e-91134e13e230,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Converting VIF {"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:4e:93,bridge_name='br-int',has_traffic_filtering=True,id=10176957-b4a6-4052-9a16-21152c8c3da5,network=Network(e3a4003a-4248-4265-b270-f289b1c2810f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10176957-b4') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_vif [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:4e:93,bridge_name='br-int',has_traffic_filtering=True,id=10176957-b4a6-4052-9a16-21152c8c3da5,network=Network(e3a4003a-4248-4265-b270-f289b1c2810f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10176957-b4') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10176957-b4, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap10176957-b4, col_values=(('external_ids', {'iface-id': '10176957-b4a6-4052-9a16-21152c8c3da5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:4e:93', 'vm-uuid': 'e298ac85-ebe3-4aa1-ae1e-91134e13e230'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:37 user nova-compute[72150]: INFO os_vif [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:4e:93,bridge_name='br-int',has_traffic_filtering=True,id=10176957-b4a6-4052-9a16-21152c8c3da5,network=Network(e3a4003a-4248-4265-b270-f289b1c2810f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10176957-b4')
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.548s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] <== connect_volume: return (1550ms) {'type': 'block', 'scsi_wwn': '23638633435386539', 'path': '/dev/sdc'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638633435386539', 'path': '/dev/sdc'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'acUrAZfO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:23:37 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:23:37 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:23:37 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] No VIF found with MAC fa:16:3e:c1:4e:93, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[79481920-92ea-4b33-9f8e-80bb14c51c88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:23:37 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d1523a-f7ab-4011-8d2b-2d3fca0679fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9] added
Aug 01 18:23:37 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7050c7-2429-478d-9c7b-65737ad94cee]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5815be22-9ce1-492d-9fa2-880a131eeadf]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v acUrAZfO {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v acUrAZfO" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[28161612-a682-456c-ae62-e7e483902062]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'acUrAZfO'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bc3dc7-4284-47cc-8b72-f9e13c801fec]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[13740a6f-cad3-4885-b982-0f0fef8f5f5e]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:37 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:37 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:37 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:37 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf8468b-8ac3-4056-a6b8-3cc5f7807416]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9, portal: 172.16.0.220,3260]
Aug 01 18:23:37 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9, portal: 172.16.0.220,3260] successful.
Aug 01 18:23:37 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fc7f40-9567-46d8-a10d-3fec8e004b06]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c177136-2d37-4ca5-be47-01e79d443770]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:37 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:37 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:23:37 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:37 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:37 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:23:37 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] HCTL ('35', '-', '-', 0) found on session 6 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3518f1ec-3c7a-4ed7-a7a0-5e3b3b85b203]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Searching for a device in session 6 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'acUrAZfO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.network.neutron [req-b90f49cf-b907-4b85-b365-158197b9961c req-529b90e5-94a4-4e55-937d-a155d3f7606f service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Updated VIF entry in instance network info cache for port 10176957-b4a6-4052-9a16-21152c8c3da5. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG nova.network.neutron [req-b90f49cf-b907-4b85-b365-158197b9961c req-529b90e5-94a4-4e55-937d-a155d3f7606f service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Updating instance_info_cache with network_info: [{"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b90f49cf-b907-4b85-b365-158197b9961c req-529b90e5-94a4-4e55-937d-a155d3f7606f service nova] Releasing lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26332653931346165', 'path': '/dev/sdd'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332653931346165', 'path': '/dev/sdd'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456768924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456768924',id=8,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUYRtnDS+kkO/Rh+VblNErZcbUsvPJke7jxaucFFzSO+Mb+KhBtRbF8QGnbCQ2PxB7iMKA8+jh+37ApV2oMjhrqq3DJgiwkaMbl7zQh8FMnQn8cSlzLcvdfhF5zShzGYw==',key_name='tempest-keypair-1384803495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6276f231fd7d45098b6a469e59fe4a22',ramdisk_id='',reservation_id='r-nwls9cju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1387804727',owner_user_name='tempest-TaggedBootDevicesTest-1387804727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315bf50b017b4f9fbe8bfe987fcea8a3',uuid=56ad8a5d-4046-463d-9259-67014867ebfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "address": "fa:16:3e:92:3a:b2", "network": {"id": "e17eb56a-a429-4b1b-a469-106a0e453e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-502389898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e74d56b-c0", "ovs_interfaceid": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converting VIF {"id": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "address": "fa:16:3e:92:3a:b2", "network": {"id": "e17eb56a-a429-4b1b-a469-106a0e453e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-502389898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e74d56b-c0", "ovs_interfaceid": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:3a:b2,bridge_name='br-int',has_traffic_filtering=True,id=7e74d56b-c054-4c2e-8f0f-6502341a1fac,network=Network(e17eb56a-a429-4b1b-a469-106a0e453e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e74d56b-c0') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456768924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456768924',id=8,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUYRtnDS+kkO/Rh+VblNErZcbUsvPJke7jxaucFFzSO+Mb+KhBtRbF8QGnbCQ2PxB7iMKA8+jh+37ApV2oMjhrqq3DJgiwkaMbl7zQh8FMnQn8cSlzLcvdfhF5zShzGYw==',key_name='tempest-keypair-1384803495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6276f231fd7d45098b6a469e59fe4a22',ramdisk_id='',reservation_id='r-nwls9cju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1387804727',owner_user_name='tempest-TaggedBootDevicesTest-1387804727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315bf50b017b4f9fbe8bfe987fcea8a3',uuid=56ad8a5d-4046-463d-9259-67014867ebfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "address": "fa:16:3e:b7:55:d4", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2976671-7a", "ovs_interfaceid": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converting VIF {"id": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "address": "fa:16:3e:b7:55:d4", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2976671-7a", "ovs_interfaceid": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:55:d4,bridge_name='br-int',has_traffic_filtering=True,id=d2976671-7ae2-4b1a-a3eb-dc87ba628494,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2976671-7a') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456768924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456768924',id=8,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUYRtnDS+kkO/Rh+VblNErZcbUsvPJke7jxaucFFzSO+Mb+KhBtRbF8QGnbCQ2PxB7iMKA8+jh+37ApV2oMjhrqq3DJgiwkaMbl7zQh8FMnQn8cSlzLcvdfhF5zShzGYw==',key_name='tempest-keypair-1384803495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6276f231fd7d45098b6a469e59fe4a22',ramdisk_id='',reservation_id='r-nwls9cju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1387804727',owner_user_name='tempest-TaggedBootDevicesTest-1387804727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315bf50b017b4f9fbe8bfe987fcea8a3',uuid=56ad8a5d-4046-463d-9259-67014867ebfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "address": "fa:16:3e:4d:a2:31", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11da1cb-a4", "ovs_interfaceid": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converting VIF {"id": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "address": "fa:16:3e:4d:a2:31", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11da1cb-a4", "ovs_interfaceid": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a2:31,bridge_name='br-int',has_traffic_filtering=True,id=d11da1cb-a45e-468e-949d-48d3bdc0628b,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd11da1cb-a4') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456768924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456768924',id=8,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUYRtnDS+kkO/Rh+VblNErZcbUsvPJke7jxaucFFzSO+Mb+KhBtRbF8QGnbCQ2PxB7iMKA8+jh+37ApV2oMjhrqq3DJgiwkaMbl7zQh8FMnQn8cSlzLcvdfhF5zShzGYw==',key_name='tempest-keypair-1384803495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6276f231fd7d45098b6a469e59fe4a22',ramdisk_id='',reservation_id='r-nwls9cju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1387804727',owner_user_name='tempest-TaggedBootDevicesTest-1387804727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315bf50b017b4f9fbe8bfe987fcea8a3',uuid=56ad8a5d-4046-463d-9259-67014867ebfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "624f99f7-d827-4106-9ffc-f57b26c45b5c", "address": "fa:16:3e:6e:78:7e", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624f99f7-d8", "ovs_interfaceid": "624f99f7-d827-4106-9ffc-f57b26c45b5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converting VIF {"id": "624f99f7-d827-4106-9ffc-f57b26c45b5c", "address": "fa:16:3e:6e:78:7e", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624f99f7-d8", "ovs_interfaceid": "624f99f7-d827-4106-9ffc-f57b26c45b5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:78:7e,bridge_name='br-int',has_traffic_filtering=True,id=624f99f7-d827-4106-9ffc-f57b26c45b5c,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624f99f7-d8') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456768924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456768924',id=8,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUYRtnDS+kkO/Rh+VblNErZcbUsvPJke7jxaucFFzSO+Mb+KhBtRbF8QGnbCQ2PxB7iMKA8+jh+37ApV2oMjhrqq3DJgiwkaMbl7zQh8FMnQn8cSlzLcvdfhF5zShzGYw==',key_name='tempest-keypair-1384803495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6276f231fd7d45098b6a469e59fe4a22',ramdisk_id='',reservation_id='r-nwls9cju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1387804727',owner_user_name='tempest-TaggedBootDevicesTest-1387804727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315bf50b017b4f9fbe8bfe987fcea8a3',uuid=56ad8a5d-4046-463d-9259-67014867ebfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "address": "fa:16:3e:53:16:5f", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5fca36-38", "ovs_interfaceid": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converting VIF {"id": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "address": "fa:16:3e:53:16:5f", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5fca36-38", "ovs_interfaceid": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:16:5f,bridge_name='br-int',has_traffic_filtering=True,id=9b5fca36-3823-421c-9e7e-bcfb0a4c00ab,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b5fca36-38') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456768924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456768924',id=8,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUYRtnDS+kkO/Rh+VblNErZcbUsvPJke7jxaucFFzSO+Mb+KhBtRbF8QGnbCQ2PxB7iMKA8+jh+37ApV2oMjhrqq3DJgiwkaMbl7zQh8FMnQn8cSlzLcvdfhF5zShzGYw==',key_name='tempest-keypair-1384803495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6276f231fd7d45098b6a469e59fe4a22',ramdisk_id='',reservation_id='r-nwls9cju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1387804727',owner_user_name='tempest-TaggedBootDevicesTest-1387804727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315bf50b017b4f9fbe8bfe987fcea8a3',uuid=56ad8a5d-4046-463d-9259-67014867ebfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af62c1f6-4440-4109-92b3-80721228f311", "address": "fa:16:3e:0a:89:2e", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf62c1f6-44", "ovs_interfaceid": "af62c1f6-4440-4109-92b3-80721228f311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converting VIF {"id": "af62c1f6-4440-4109-92b3-80721228f311", "address": "fa:16:3e:0a:89:2e", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf62c1f6-44", "ovs_interfaceid": "af62c1f6-4440-4109-92b3-80721228f311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:89:2e,bridge_name='br-int',has_traffic_filtering=True,id=af62c1f6-4440-4109-92b3-80721228f311,network=Network(29a56d4f-d6b7-48c1-b20f-e2e684773d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf62c1f6-44') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456768924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456768924',id=8,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUYRtnDS+kkO/Rh+VblNErZcbUsvPJke7jxaucFFzSO+Mb+KhBtRbF8QGnbCQ2PxB7iMKA8+jh+37ApV2oMjhrqq3DJgiwkaMbl7zQh8FMnQn8cSlzLcvdfhF5zShzGYw==',key_name='tempest-keypair-1384803495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6276f231fd7d45098b6a469e59fe4a22',ramdisk_id='',reservation_id='r-nwls9cju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1387804727',owner_user_name='tempest-TaggedBootDevicesTest-1387804727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315bf50b017b4f9fbe8bfe987fcea8a3',uuid=56ad8a5d-4046-463d-9259-67014867ebfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "address": "fa:16:3e:1b:a3:2f", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ea9e27-a7", "ovs_interfaceid": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converting VIF {"id": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "address": "fa:16:3e:1b:a3:2f", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ea9e27-a7", "ovs_interfaceid": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a3:2f,bridge_name='br-int',has_traffic_filtering=True,id=13ea9e27-a7e5-4afa-bda3-87c95c480373,network=Network(29a56d4f-d6b7-48c1-b20f-e2e684773d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ea9e27-a7') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.objects.instance [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lazy-loading 'pci_devices' on Instance uuid 56ad8a5d-4046-463d-9259-67014867ebfe {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:23:38 user nova-compute[72150]:   <uuid>56ad8a5d-4046-463d-9259-67014867ebfe</uuid>
Aug 01 18:23:38 user nova-compute[72150]:   <name>instance-00000008</name>
Aug 01 18:23:38 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:23:38 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:23:38 user nova-compute[72150]:   <metadata>
Aug 01 18:23:38 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:23:38 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:23:38 user nova-compute[72150]:       <nova:name>tempest-device-tagging-server-1456768924</nova:name>
Aug 01 18:23:38 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:23:34</nova:creationTime>
Aug 01 18:23:38 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:23:38 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:23:38 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:23:38 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:23:38 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:23:38 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:23:38 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:23:38 user nova-compute[72150]:       <nova:owner>
Aug 01 18:23:38 user nova-compute[72150]:         <nova:user uuid="315bf50b017b4f9fbe8bfe987fcea8a3">tempest-TaggedBootDevicesTest-1387804727-project-member</nova:user>
Aug 01 18:23:38 user nova-compute[72150]:         <nova:project uuid="6276f231fd7d45098b6a469e59fe4a22">tempest-TaggedBootDevicesTest-1387804727</nova:project>
Aug 01 18:23:38 user nova-compute[72150]:       </nova:owner>
Aug 01 18:23:38 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:23:38 user nova-compute[72150]:       <nova:ports>
Aug 01 18:23:38 user nova-compute[72150]:         <nova:port uuid="7e74d56b-c054-4c2e-8f0f-6502341a1fac">
Aug 01 18:23:38 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 18:23:38 user nova-compute[72150]:         </nova:port>
Aug 01 18:23:38 user nova-compute[72150]:         <nova:port uuid="d2976671-7ae2-4b1a-a3eb-dc87ba628494">
Aug 01 18:23:38 user nova-compute[72150]:           <nova:ip type="fixed" address="10.1.1.91" ipVersion="4"/>
Aug 01 18:23:38 user nova-compute[72150]:         </nova:port>
Aug 01 18:23:38 user nova-compute[72150]:         <nova:port uuid="d11da1cb-a45e-468e-949d-48d3bdc0628b">
Aug 01 18:23:38 user nova-compute[72150]:           <nova:ip type="fixed" address="10.1.1.162" ipVersion="4"/>
Aug 01 18:23:38 user nova-compute[72150]:         </nova:port>
Aug 01 18:23:38 user nova-compute[72150]:         <nova:port uuid="624f99f7-d827-4106-9ffc-f57b26c45b5c">
Aug 01 18:23:38 user nova-compute[72150]:           <nova:ip type="fixed" address="10.1.1.167" ipVersion="4"/>
Aug 01 18:23:38 user nova-compute[72150]:         </nova:port>
Aug 01 18:23:38 user nova-compute[72150]:         <nova:port uuid="9b5fca36-3823-421c-9e7e-bcfb0a4c00ab">
Aug 01 18:23:38 user nova-compute[72150]:           <nova:ip type="fixed" address="10.1.1.206" ipVersion="4"/>
Aug 01 18:23:38 user nova-compute[72150]:         </nova:port>
Aug 01 18:23:38 user nova-compute[72150]:         <nova:port uuid="af62c1f6-4440-4109-92b3-80721228f311">
Aug 01 18:23:38 user nova-compute[72150]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 01 18:23:38 user nova-compute[72150]:         </nova:port>
Aug 01 18:23:38 user nova-compute[72150]:         <nova:port uuid="13ea9e27-a7e5-4afa-bda3-87c95c480373">
Aug 01 18:23:38 user nova-compute[72150]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 01 18:23:38 user nova-compute[72150]:         </nova:port>
Aug 01 18:23:38 user nova-compute[72150]:       </nova:ports>
Aug 01 18:23:38 user nova-compute[72150]:     </nova:instance>
Aug 01 18:23:38 user nova-compute[72150]:   </metadata>
Aug 01 18:23:38 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:23:38 user nova-compute[72150]:     <system>
Aug 01 18:23:38 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:23:38 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:23:38 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:23:38 user nova-compute[72150]:       <entry name="serial">56ad8a5d-4046-463d-9259-67014867ebfe</entry>
Aug 01 18:23:38 user nova-compute[72150]:       <entry name="uuid">56ad8a5d-4046-463d-9259-67014867ebfe</entry>
Aug 01 18:23:38 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:23:38 user nova-compute[72150]:     </system>
Aug 01 18:23:38 user nova-compute[72150]:   </sysinfo>
Aug 01 18:23:38 user nova-compute[72150]:   <os>
Aug 01 18:23:38 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:23:38 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:23:38 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:23:38 user nova-compute[72150]:   </os>
Aug 01 18:23:38 user nova-compute[72150]:   <features>
Aug 01 18:23:38 user nova-compute[72150]:     <acpi/>
Aug 01 18:23:38 user nova-compute[72150]:     <apic/>
Aug 01 18:23:38 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:23:38 user nova-compute[72150]:   </features>
Aug 01 18:23:38 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:23:38 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:23:38 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:23:38 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:23:38 user nova-compute[72150]:   </clock>
Aug 01 18:23:38 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:23:38 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:23:38 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:23:38 user nova-compute[72150]:   </cpu>
Aug 01 18:23:38 user nova-compute[72150]:   <devices>
Aug 01 18:23:38 user nova-compute[72150]:     <disk type="file" device="cdrom">
Aug 01 18:23:38 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 18:23:38 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/56ad8a5d-4046-463d-9259-67014867ebfe/disk.config"/>
Aug 01 18:23:38 user nova-compute[72150]:       <target dev="hda" bus="ide"/>
Aug 01 18:23:38 user nova-compute[72150]:     </disk>
Aug 01 18:23:38 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:23:38 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:23:38 user nova-compute[72150]:       <source dev="/dev/sdb"/>
Aug 01 18:23:38 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:23:38 user nova-compute[72150]:       <serial>b4616a37-17ef-4d3d-a9c8-02871bd0b134</serial>
Aug 01 18:23:38 user nova-compute[72150]:     </disk>
Aug 01 18:23:38 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:23:38 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:23:38 user nova-compute[72150]:       <source dev="/dev/sdc"/>
Aug 01 18:23:38 user nova-compute[72150]:       <target dev="vdb" bus="virtio"/>
Aug 01 18:23:38 user nova-compute[72150]:       <serial>ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f</serial>
Aug 01 18:23:38 user nova-compute[72150]:     </disk>
Aug 01 18:23:38 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:23:38 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:23:38 user nova-compute[72150]:       <source dev="/dev/sdd"/>
Aug 01 18:23:38 user nova-compute[72150]:       <target dev="vdc" bus="virtio"/>
Aug 01 18:23:38 user nova-compute[72150]:       <serial>8274439e-c3d8-41cc-af90-e53d3ae158a9</serial>
Aug 01 18:23:38 user nova-compute[72150]:     </disk>
Aug 01 18:23:38 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:23:38 user nova-compute[72150]:       <mac address="fa:16:3e:92:3a:b2"/>
Aug 01 18:23:38 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:23:38 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:23:38 user nova-compute[72150]:       <target dev="tap7e74d56b-c0"/>
Aug 01 18:23:38 user nova-compute[72150]:     </interface>
Aug 01 18:23:38 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:23:38 user nova-compute[72150]:       <mac address="fa:16:3e:b7:55:d4"/>
Aug 01 18:23:38 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:23:38 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:23:38 user nova-compute[72150]:       <target dev="tapd2976671-7a"/>
Aug 01 18:23:38 user nova-compute[72150]:     </interface>
Aug 01 18:23:38 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:23:38 user nova-compute[72150]:       <mac address="fa:16:3e:4d:a2:31"/>
Aug 01 18:23:38 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:23:38 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:23:38 user nova-compute[72150]:       <target dev="tapd11da1cb-a4"/>
Aug 01 18:23:38 user nova-compute[72150]:     </interface>
Aug 01 18:23:38 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:23:38 user nova-compute[72150]:       <mac address="fa:16:3e:6e:78:7e"/>
Aug 01 18:23:38 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:23:38 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:23:38 user nova-compute[72150]:       <target dev="tap624f99f7-d8"/>
Aug 01 18:23:38 user nova-compute[72150]:     </interface>
Aug 01 18:23:38 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:23:38 user nova-compute[72150]:       <mac address="fa:16:3e:53:16:5f"/>
Aug 01 18:23:38 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:23:38 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:23:38 user nova-compute[72150]:       <target dev="tap9b5fca36-38"/>
Aug 01 18:23:38 user nova-compute[72150]:     </interface>
Aug 01 18:23:38 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:23:38 user nova-compute[72150]:       <mac address="fa:16:3e:0a:89:2e"/>
Aug 01 18:23:38 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:23:38 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:23:38 user nova-compute[72150]:       <target dev="tapaf62c1f6-44"/>
Aug 01 18:23:38 user nova-compute[72150]:     </interface>
Aug 01 18:23:38 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:23:38 user nova-compute[72150]:       <mac address="fa:16:3e:1b:a3:2f"/>
Aug 01 18:23:38 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:23:38 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:23:38 user nova-compute[72150]:       <target dev="tap13ea9e27-a7"/>
Aug 01 18:23:38 user nova-compute[72150]:     </interface>
Aug 01 18:23:38 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:23:38 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/56ad8a5d-4046-463d-9259-67014867ebfe/console.log" append="off"/>
Aug 01 18:23:38 user nova-compute[72150]:     </serial>
Aug 01 18:23:38 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:23:38 user nova-compute[72150]:     <video>
Aug 01 18:23:38 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:23:38 user nova-compute[72150]:     </video>
Aug 01 18:23:38 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:23:38 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:23:38 user nova-compute[72150]:     </rng>
Aug 01 18:23:38 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:23:38 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:23:38 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:23:38 user nova-compute[72150]:     </memballoon>
Aug 01 18:23:38 user nova-compute[72150]:   </devices>
Aug 01 18:23:38 user nova-compute[72150]: </domain>
Aug 01 18:23:38 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456768924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456768924',id=8,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUYRtnDS+kkO/Rh+VblNErZcbUsvPJke7jxaucFFzSO+Mb+KhBtRbF8QGnbCQ2PxB7iMKA8+jh+37ApV2oMjhrqq3DJgiwkaMbl7zQh8FMnQn8cSlzLcvdfhF5zShzGYw==',key_name='tempest-keypair-1384803495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6276f231fd7d45098b6a469e59fe4a22',ramdisk_id='',reservation_id='r-nwls9cju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1387804727',owner_user_name='tempest-TaggedBootDevicesTest-1387804727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315bf50b017b4f9fbe8bfe987fcea8a3',uuid=56ad8a5d-4046-463d-9259-67014867ebfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "address": "fa:16:3e:92:3a:b2", "network": {"id": "e17eb56a-a429-4b1b-a469-106a0e453e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-502389898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e74d56b-c0", "ovs_interfaceid": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converting VIF {"id": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "address": "fa:16:3e:92:3a:b2", "network": {"id": "e17eb56a-a429-4b1b-a469-106a0e453e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-502389898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e74d56b-c0", "ovs_interfaceid": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:3a:b2,bridge_name='br-int',has_traffic_filtering=True,id=7e74d56b-c054-4c2e-8f0f-6502341a1fac,network=Network(e17eb56a-a429-4b1b-a469-106a0e453e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e74d56b-c0') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG os_vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:3a:b2,bridge_name='br-int',has_traffic_filtering=True,id=7e74d56b-c054-4c2e-8f0f-6502341a1fac,network=Network(e17eb56a-a429-4b1b-a469-106a0e453e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e74d56b-c0') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e74d56b-c0, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e74d56b-c0, col_values=(('external_ids', {'iface-id': '7e74d56b-c054-4c2e-8f0f-6502341a1fac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:3a:b2', 'vm-uuid': '56ad8a5d-4046-463d-9259-67014867ebfe'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:38 user nova-compute[72150]: INFO os_vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:3a:b2,bridge_name='br-int',has_traffic_filtering=True,id=7e74d56b-c054-4c2e-8f0f-6502341a1fac,network=Network(e17eb56a-a429-4b1b-a469-106a0e453e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e74d56b-c0')
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456768924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456768924',id=8,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUYRtnDS+kkO/Rh+VblNErZcbUsvPJke7jxaucFFzSO+Mb+KhBtRbF8QGnbCQ2PxB7iMKA8+jh+37ApV2oMjhrqq3DJgiwkaMbl7zQh8FMnQn8cSlzLcvdfhF5zShzGYw==',key_name='tempest-keypair-1384803495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6276f231fd7d45098b6a469e59fe4a22',ramdisk_id='',reservation_id='r-nwls9cju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1387804727',owner_user_name='tempest-TaggedBootDevicesTest-1387804727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315bf50b017b4f9fbe8bfe987fcea8a3',uuid=56ad8a5d-4046-463d-9259-67014867ebfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "address": "fa:16:3e:b7:55:d4", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2976671-7a", "ovs_interfaceid": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converting VIF {"id": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "address": "fa:16:3e:b7:55:d4", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2976671-7a", "ovs_interfaceid": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:55:d4,bridge_name='br-int',has_traffic_filtering=True,id=d2976671-7ae2-4b1a-a3eb-dc87ba628494,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2976671-7a') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG os_vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:55:d4,bridge_name='br-int',has_traffic_filtering=True,id=d2976671-7ae2-4b1a-a3eb-dc87ba628494,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2976671-7a') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2976671-7a, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2976671-7a, col_values=(('external_ids', {'iface-id': 'd2976671-7ae2-4b1a-a3eb-dc87ba628494', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:55:d4', 'vm-uuid': '56ad8a5d-4046-463d-9259-67014867ebfe'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:23:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: INFO os_vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:55:d4,bridge_name='br-int',has_traffic_filtering=True,id=d2976671-7ae2-4b1a-a3eb-dc87ba628494,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2976671-7a')
Aug 01 18:23:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456768924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456768924',id=8,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUYRtnDS+kkO/Rh+VblNErZcbUsvPJke7jxaucFFzSO+Mb+KhBtRbF8QGnbCQ2PxB7iMKA8+jh+37ApV2oMjhrqq3DJgiwkaMbl7zQh8FMnQn8cSlzLcvdfhF5zShzGYw==',key_name='tempest-keypair-1384803495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6276f231fd7d45098b6a469e59fe4a22',ramdisk_id='',reservation_id='r-nwls9cju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1387804727',owner_user_name='tempest-TaggedBootDevicesTest-1387804727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315bf50b017b4f9fbe8bfe987fcea8a3',uuid=56ad8a5d-4046-463d-9259-67014867ebfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "address": "fa:16:3e:4d:a2:31", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11da1cb-a4", "ovs_interfaceid": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converting VIF {"id": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "address": "fa:16:3e:4d:a2:31", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11da1cb-a4", "ovs_interfaceid": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a2:31,bridge_name='br-int',has_traffic_filtering=True,id=d11da1cb-a45e-468e-949d-48d3bdc0628b,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd11da1cb-a4') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a2:31,bridge_name='br-int',has_traffic_filtering=True,id=d11da1cb-a45e-468e-949d-48d3bdc0628b,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd11da1cb-a4') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd11da1cb-a4, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd11da1cb-a4, col_values=(('external_ids', {'iface-id': 'd11da1cb-a45e-468e-949d-48d3bdc0628b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:a2:31', 'vm-uuid': '56ad8a5d-4046-463d-9259-67014867ebfe'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: INFO os_vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a2:31,bridge_name='br-int',has_traffic_filtering=True,id=d11da1cb-a45e-468e-949d-48d3bdc0628b,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd11da1cb-a4')
Aug 01 18:23:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456768924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456768924',id=8,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUYRtnDS+kkO/Rh+VblNErZcbUsvPJke7jxaucFFzSO+Mb+KhBtRbF8QGnbCQ2PxB7iMKA8+jh+37ApV2oMjhrqq3DJgiwkaMbl7zQh8FMnQn8cSlzLcvdfhF5zShzGYw==',key_name='tempest-keypair-1384803495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6276f231fd7d45098b6a469e59fe4a22',ramdisk_id='',reservation_id='r-nwls9cju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1387804727',owner_user_name='tempest-TaggedBootDevicesTest-1387804727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315bf50b017b4f9fbe8bfe987fcea8a3',uuid=56ad8a5d-4046-463d-9259-67014867ebfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "624f99f7-d827-4106-9ffc-f57b26c45b5c", "address": "fa:16:3e:6e:78:7e", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624f99f7-d8", "ovs_interfaceid": "624f99f7-d827-4106-9ffc-f57b26c45b5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converting VIF {"id": "624f99f7-d827-4106-9ffc-f57b26c45b5c", "address": "fa:16:3e:6e:78:7e", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624f99f7-d8", "ovs_interfaceid": "624f99f7-d827-4106-9ffc-f57b26c45b5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:78:7e,bridge_name='br-int',has_traffic_filtering=True,id=624f99f7-d827-4106-9ffc-f57b26c45b5c,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624f99f7-d8') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:78:7e,bridge_name='br-int',has_traffic_filtering=True,id=624f99f7-d827-4106-9ffc-f57b26c45b5c,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624f99f7-d8') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap624f99f7-d8, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap624f99f7-d8, col_values=(('external_ids', {'iface-id': '624f99f7-d827-4106-9ffc-f57b26c45b5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:78:7e', 'vm-uuid': '56ad8a5d-4046-463d-9259-67014867ebfe'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: INFO os_vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:78:7e,bridge_name='br-int',has_traffic_filtering=True,id=624f99f7-d827-4106-9ffc-f57b26c45b5c,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624f99f7-d8')
Aug 01 18:23:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456768924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456768924',id=8,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUYRtnDS+kkO/Rh+VblNErZcbUsvPJke7jxaucFFzSO+Mb+KhBtRbF8QGnbCQ2PxB7iMKA8+jh+37ApV2oMjhrqq3DJgiwkaMbl7zQh8FMnQn8cSlzLcvdfhF5zShzGYw==',key_name='tempest-keypair-1384803495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6276f231fd7d45098b6a469e59fe4a22',ramdisk_id='',reservation_id='r-nwls9cju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1387804727',owner_user_name='tempest-TaggedBootDevicesTest-1387804727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315bf50b017b4f9fbe8bfe987fcea8a3',uuid=56ad8a5d-4046-463d-9259-67014867ebfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "address": "fa:16:3e:53:16:5f", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5fca36-38", "ovs_interfaceid": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converting VIF {"id": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "address": "fa:16:3e:53:16:5f", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5fca36-38", "ovs_interfaceid": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:16:5f,bridge_name='br-int',has_traffic_filtering=True,id=9b5fca36-3823-421c-9e7e-bcfb0a4c00ab,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b5fca36-38') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:16:5f,bridge_name='br-int',has_traffic_filtering=True,id=9b5fca36-3823-421c-9e7e-bcfb0a4c00ab,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b5fca36-38') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b5fca36-38, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b5fca36-38, col_values=(('external_ids', {'iface-id': '9b5fca36-3823-421c-9e7e-bcfb0a4c00ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:16:5f', 'vm-uuid': '56ad8a5d-4046-463d-9259-67014867ebfe'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItrwdYDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:23:39 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:23:39 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:23:39 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: INFO os_vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:16:5f,bridge_name='br-int',has_traffic_filtering=True,id=9b5fca36-3823-421c-9e7e-bcfb0a4c00ab,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b5fca36-38')
Aug 01 18:23:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456768924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456768924',id=8,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUYRtnDS+kkO/Rh+VblNErZcbUsvPJke7jxaucFFzSO+Mb+KhBtRbF8QGnbCQ2PxB7iMKA8+jh+37ApV2oMjhrqq3DJgiwkaMbl7zQh8FMnQn8cSlzLcvdfhF5zShzGYw==',key_name='tempest-keypair-1384803495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6276f231fd7d45098b6a469e59fe4a22',ramdisk_id='',reservation_id='r-nwls9cju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1387804727',owner_user_name='tempest-TaggedBootDevicesTest-1387804727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315bf50b017b4f9fbe8bfe987fcea8a3',uuid=56ad8a5d-4046-463d-9259-67014867ebfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af62c1f6-4440-4109-92b3-80721228f311", "address": "fa:16:3e:0a:89:2e", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf62c1f6-44", "ovs_interfaceid": "af62c1f6-4440-4109-92b3-80721228f311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converting VIF {"id": "af62c1f6-4440-4109-92b3-80721228f311", "address": "fa:16:3e:0a:89:2e", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf62c1f6-44", "ovs_interfaceid": "af62c1f6-4440-4109-92b3-80721228f311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:89:2e,bridge_name='br-int',has_traffic_filtering=True,id=af62c1f6-4440-4109-92b3-80721228f311,network=Network(29a56d4f-d6b7-48c1-b20f-e2e684773d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf62c1f6-44') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:89:2e,bridge_name='br-int',has_traffic_filtering=True,id=af62c1f6-4440-4109-92b3-80721228f311,network=Network(29a56d4f-d6b7-48c1-b20f-e2e684773d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf62c1f6-44') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf62c1f6-44, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf62c1f6-44, col_values=(('external_ids', {'iface-id': 'af62c1f6-4440-4109-92b3-80721228f311', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:89:2e', 'vm-uuid': '56ad8a5d-4046-463d-9259-67014867ebfe'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG nova.compute.manager [req-95ff3c71-a32a-420e-aa48-507028eccf0a req-ab8a293a-d613-475b-96c5-9547a79a87f3 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Received event network-vif-plugged-10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-95ff3c71-a32a-420e-aa48-507028eccf0a req-ab8a293a-d613-475b-96c5-9547a79a87f3 service nova] Acquiring lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-95ff3c71-a32a-420e-aa48-507028eccf0a req-ab8a293a-d613-475b-96c5-9547a79a87f3 service nova] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-95ff3c71-a32a-420e-aa48-507028eccf0a req-ab8a293a-d613-475b-96c5-9547a79a87f3 service nova] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG nova.compute.manager [req-95ff3c71-a32a-420e-aa48-507028eccf0a req-ab8a293a-d613-475b-96c5-9547a79a87f3 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] No waiting events found dispatching network-vif-plugged-10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:39 user nova-compute[72150]: WARNING nova.compute.manager [req-95ff3c71-a32a-420e-aa48-507028eccf0a req-ab8a293a-d613-475b-96c5-9547a79a87f3 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Received unexpected event network-vif-plugged-10176957-b4a6-4052-9a16-21152c8c3da5 for instance with vm_state building and task_state spawning.
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce778cf-ceaa-415a-82e6-3e3dfd51c773]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:23:39 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c0ba76-1b6d-49be-98cf-78b9b4000287]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60] added
Aug 01 18:23:39 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3776cac-2f78-4243-a8e0-bf176064c1da]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[88687ab7-a1ea-4702-8358-beb29a0587ba]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ItrwdYDf {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: INFO os_vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:89:2e,bridge_name='br-int',has_traffic_filtering=True,id=af62c1f6-4440-4109-92b3-80721228f311,network=Network(29a56d4f-d6b7-48c1-b20f-e2e684773d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf62c1f6-44')
Aug 01 18:23:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456768924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456768924',id=8,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUYRtnDS+kkO/Rh+VblNErZcbUsvPJke7jxaucFFzSO+Mb+KhBtRbF8QGnbCQ2PxB7iMKA8+jh+37ApV2oMjhrqq3DJgiwkaMbl7zQh8FMnQn8cSlzLcvdfhF5zShzGYw==',key_name='tempest-keypair-1384803495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6276f231fd7d45098b6a469e59fe4a22',ramdisk_id='',reservation_id='r-nwls9cju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1387804727',owner_user_name='tempest-TaggedBootDevicesTest-1387804727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315bf50b017b4f9fbe8bfe987fcea8a3',uuid=56ad8a5d-4046-463d-9259-67014867ebfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "address": "fa:16:3e:1b:a3:2f", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ea9e27-a7", "ovs_interfaceid": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converting VIF {"id": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "address": "fa:16:3e:1b:a3:2f", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ea9e27-a7", "ovs_interfaceid": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a3:2f,bridge_name='br-int',has_traffic_filtering=True,id=13ea9e27-a7e5-4afa-bda3-87c95c480373,network=Network(29a56d4f-d6b7-48c1-b20f-e2e684773d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ea9e27-a7') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a3:2f,bridge_name='br-int',has_traffic_filtering=True,id=13ea9e27-a7e5-4afa-bda3-87c95c480373,network=Network(29a56d4f-d6b7-48c1-b20f-e2e684773d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ea9e27-a7') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ItrwdYDf" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c3f3a9-b85a-4c69-9b09-86b040e82f21]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ItrwdYDf'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13ea9e27-a7, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13ea9e27-a7, col_values=(('external_ids', {'iface-id': '13ea9e27-a7e5-4afa-bda3-87c95c480373', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:a3:2f', 'vm-uuid': '56ad8a5d-4046-463d-9259-67014867ebfe'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[219a01d2-50af-4d8c-8b72-965a072b1657]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[31edec8a-78bd-473c-a896-1f5c83856a17]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:39 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:39 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:23:39 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:39 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:39 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:23:39 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: INFO os_vif [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a3:2f,bridge_name='br-int',has_traffic_filtering=True,id=13ea9e27-a7e5-4afa-bda3-87c95c480373,network=Network(29a56d4f-d6b7-48c1-b20f-e2e684773d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ea9e27-a7')
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8af34e8-9be7-4cb1-a02e-642c787ebbf0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60, portal: 172.16.0.220,3260]
Aug 01 18:23:39 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60, portal: 172.16.0.220,3260] successful.
Aug 01 18:23:39 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e8a204-d5ab-4c89-b50f-b1abebe52626]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] No BDM found with device name hda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] No VIF found with MAC fa:16:3e:92:3a:b2, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] No VIF found with MAC fa:16:3e:53:16:5f, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:23:39 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Using config drive
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f962d15-1ef5-41c3-8a69-9aac0b9d00e1]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:39 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:39 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:23:39 user nova-compute[72150]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 (non-flash)
Aug 01 18:23:39 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:39 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:39 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:23:39 user nova-compute[72150]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 (non-flash)
Aug 01 18:23:39 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfb08c7-8c4b-4ffe-847f-af8f340c7695]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItrwdYDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Creating config drive at /opt/stack/data/nova/instances/56ad8a5d-4046-463d-9259-67014867ebfe/disk.config
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/56ad8a5d-4046-463d-9259-67014867ebfe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb2ar3k4d {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/56ad8a5d-4046-463d-9259-67014867ebfe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb2ar3k4d" returned: 0 in 0.070s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:23:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23838383338366332', 'path': '/dev/sde'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:23:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838383338366332', 'path': '/dev/sde'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:23:40 user nova-compute[72150]: DEBUG nova.objects.instance [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lazy-loading 'flavor' on Instance uuid c3811375-bcd1-46ac-b552-7ff1588a3667 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:23:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:23:40 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:23:40 user nova-compute[72150]:   <source dev="/dev/sde"/>
Aug 01 18:23:40 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:23:40 user nova-compute[72150]:   <serial>6555d10c-408e-4e93-8df2-ab6b69855a60</serial>
Aug 01 18:23:40 user nova-compute[72150]: </disk>
Aug 01 18:23:40 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:23:41 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914221.2736416, e298ac85-ebe3-4aa1-ae1e-91134e13e230 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:23:41 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] VM Resumed (Lifecycle Event)
Aug 01 18:23:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:23:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:23:41 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Instance spawned successfully.
Aug 01 18:23:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:23:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:23:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:23:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:23:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] No VIF found with MAC fa:16:3e:9e:ba:be, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:23:41 user nova-compute[72150]: DEBUG nova.compute.manager [req-936313fa-41ab-4d90-9eaf-a4d858a1ea36 req-e6567937-6c90-4d89-8290-e7b770cdc2c4 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Received event network-vif-plugged-10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-936313fa-41ab-4d90-9eaf-a4d858a1ea36 req-e6567937-6c90-4d89-8290-e7b770cdc2c4 service nova] Acquiring lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-936313fa-41ab-4d90-9eaf-a4d858a1ea36 req-e6567937-6c90-4d89-8290-e7b770cdc2c4 service nova] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-936313fa-41ab-4d90-9eaf-a4d858a1ea36 req-e6567937-6c90-4d89-8290-e7b770cdc2c4 service nova] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:41 user nova-compute[72150]: DEBUG nova.compute.manager [req-936313fa-41ab-4d90-9eaf-a4d858a1ea36 req-e6567937-6c90-4d89-8290-e7b770cdc2c4 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] No waiting events found dispatching network-vif-plugged-10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:41 user nova-compute[72150]: WARNING nova.compute.manager [req-936313fa-41ab-4d90-9eaf-a4d858a1ea36 req-e6567937-6c90-4d89-8290-e7b770cdc2c4 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Received unexpected event network-vif-plugged-10176957-b4a6-4052-9a16-21152c8c3da5 for instance with vm_state building and task_state spawning.
Aug 01 18:23:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:23:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:23:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:23:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:23:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:23:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:23:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:23:41 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:23:41 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914221.2752848, e298ac85-ebe3-4aa1-ae1e-91134e13e230 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:23:41 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] VM Started (Lifecycle Event)
Aug 01 18:23:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:23:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:23:41 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:23:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-73bcf882-4330-4fa7-8945-5a388e970491 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "c3811375-bcd1-46ac-b552-7ff1588a3667" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.945s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:41 user nova-compute[72150]: INFO nova.compute.manager [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Took 6.61 seconds to spawn the instance on the hypervisor.
Aug 01 18:23:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:23:41 user nova-compute[72150]: INFO nova.compute.manager [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Took 7.94 seconds to build instance.
Aug 01 18:23:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-fa927d5b-6920-4a81-9665-ca1f44aad36d tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.048s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG nova.compute.manager [req-fc4146ac-ab5c-4bae-9dbb-12ad4e885932 req-bc9a669b-c52f-4d01-a758-26da821ae15a service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-plugged-d2976671-7ae2-4b1a-a3eb-dc87ba628494 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fc4146ac-ab5c-4bae-9dbb-12ad4e885932 req-bc9a669b-c52f-4d01-a758-26da821ae15a service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fc4146ac-ab5c-4bae-9dbb-12ad4e885932 req-bc9a669b-c52f-4d01-a758-26da821ae15a service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fc4146ac-ab5c-4bae-9dbb-12ad4e885932 req-bc9a669b-c52f-4d01-a758-26da821ae15a service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG nova.compute.manager [req-fc4146ac-ab5c-4bae-9dbb-12ad4e885932 req-bc9a669b-c52f-4d01-a758-26da821ae15a service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-plugged-d2976671-7ae2-4b1a-a3eb-dc87ba628494 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:42 user nova-compute[72150]: WARNING nova.compute.manager [req-fc4146ac-ab5c-4bae-9dbb-12ad4e885932 req-bc9a669b-c52f-4d01-a758-26da821ae15a service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received unexpected event network-vif-plugged-d2976671-7ae2-4b1a-a3eb-dc87ba628494 for instance with vm_state building and task_state spawning.
Aug 01 18:23:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Acquiring lock "c3811375-bcd1-46ac-b552-7ff1588a3667" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "c3811375-bcd1-46ac-b552-7ff1588a3667" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Acquiring lock "c3811375-bcd1-46ac-b552-7ff1588a3667-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "c3811375-bcd1-46ac-b552-7ff1588a3667-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "c3811375-bcd1-46ac-b552-7ff1588a3667-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:42 user nova-compute[72150]: INFO nova.compute.manager [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Terminating instance
Aug 01 18:23:42 user nova-compute[72150]: DEBUG nova.compute.manager [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG nova.compute.manager [req-ad0dd4be-88b2-4ca3-b82e-9457328304ed req-c0abf27f-8a7f-4792-9c8d-b821e2252ed0 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-plugged-d11da1cb-a45e-468e-949d-48d3bdc0628b {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ad0dd4be-88b2-4ca3-b82e-9457328304ed req-c0abf27f-8a7f-4792-9c8d-b821e2252ed0 service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ad0dd4be-88b2-4ca3-b82e-9457328304ed req-c0abf27f-8a7f-4792-9c8d-b821e2252ed0 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ad0dd4be-88b2-4ca3-b82e-9457328304ed req-c0abf27f-8a7f-4792-9c8d-b821e2252ed0 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG nova.compute.manager [req-ad0dd4be-88b2-4ca3-b82e-9457328304ed req-c0abf27f-8a7f-4792-9c8d-b821e2252ed0 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-plugged-d11da1cb-a45e-468e-949d-48d3bdc0628b {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:42 user nova-compute[72150]: WARNING nova.compute.manager [req-ad0dd4be-88b2-4ca3-b82e-9457328304ed req-c0abf27f-8a7f-4792-9c8d-b821e2252ed0 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received unexpected event network-vif-plugged-d11da1cb-a45e-468e-949d-48d3bdc0628b for instance with vm_state building and task_state spawning.
Aug 01 18:23:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:43 user nova-compute[72150]: DEBUG nova.compute.manager [req-f9bd3357-b811-4159-9753-18f81cc047fd req-65081149-6452-49ad-89ac-ebb2590b62b2 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-plugged-7e74d56b-c054-4c2e-8f0f-6502341a1fac {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f9bd3357-b811-4159-9753-18f81cc047fd req-65081149-6452-49ad-89ac-ebb2590b62b2 service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f9bd3357-b811-4159-9753-18f81cc047fd req-65081149-6452-49ad-89ac-ebb2590b62b2 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f9bd3357-b811-4159-9753-18f81cc047fd req-65081149-6452-49ad-89ac-ebb2590b62b2 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:43 user nova-compute[72150]: DEBUG nova.compute.manager [req-f9bd3357-b811-4159-9753-18f81cc047fd req-65081149-6452-49ad-89ac-ebb2590b62b2 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-plugged-7e74d56b-c054-4c2e-8f0f-6502341a1fac {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:43 user nova-compute[72150]: WARNING nova.compute.manager [req-f9bd3357-b811-4159-9753-18f81cc047fd req-65081149-6452-49ad-89ac-ebb2590b62b2 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received unexpected event network-vif-plugged-7e74d56b-c054-4c2e-8f0f-6502341a1fac for instance with vm_state building and task_state spawning.
Aug 01 18:23:43 user nova-compute[72150]: DEBUG nova.compute.manager [req-f9bd3357-b811-4159-9753-18f81cc047fd req-65081149-6452-49ad-89ac-ebb2590b62b2 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-plugged-7e74d56b-c054-4c2e-8f0f-6502341a1fac {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f9bd3357-b811-4159-9753-18f81cc047fd req-65081149-6452-49ad-89ac-ebb2590b62b2 service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f9bd3357-b811-4159-9753-18f81cc047fd req-65081149-6452-49ad-89ac-ebb2590b62b2 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f9bd3357-b811-4159-9753-18f81cc047fd req-65081149-6452-49ad-89ac-ebb2590b62b2 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:43 user nova-compute[72150]: DEBUG nova.compute.manager [req-f9bd3357-b811-4159-9753-18f81cc047fd req-65081149-6452-49ad-89ac-ebb2590b62b2 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-plugged-7e74d56b-c054-4c2e-8f0f-6502341a1fac {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:43 user nova-compute[72150]: WARNING nova.compute.manager [req-f9bd3357-b811-4159-9753-18f81cc047fd req-65081149-6452-49ad-89ac-ebb2590b62b2 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received unexpected event network-vif-plugged-7e74d56b-c054-4c2e-8f0f-6502341a1fac for instance with vm_state building and task_state spawning.
Aug 01 18:23:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:44 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Instance destroyed successfully.
Aug 01 18:23:44 user nova-compute[72150]: DEBUG nova.objects.instance [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lazy-loading 'resources' on Instance uuid c3811375-bcd1-46ac-b552-7ff1588a3667 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:21:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-270748278',display_name='tempest-DeleteServersTestJSON-server-270748278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-270748278',id=2,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:21:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b7f76aef75642d0bffa978550d6935d',ramdisk_id='',reservation_id='r-cg3vb0p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-998275787',owner_user_name='tempest-DeleteServersTestJSON-998275787-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:21:47Z,user_data=None,user_id='66f8d97f88cf445391decc1771f0e0d9',uuid=c3811375-bcd1-46ac-b552-7ff1588a3667,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a68eacb-ee1f-4cf8-a15f-668e9a3da691", "address": "fa:16:3e:9e:ba:be", "network": {"id": "f3e4e91a-ba2c-4e94-9f12-bac4dc4607ad", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1636291956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7f76aef75642d0bffa978550d6935d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68eacb-ee", "ovs_interfaceid": "1a68eacb-ee1f-4cf8-a15f-668e9a3da691", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Converting VIF {"id": "1a68eacb-ee1f-4cf8-a15f-668e9a3da691", "address": "fa:16:3e:9e:ba:be", "network": {"id": "f3e4e91a-ba2c-4e94-9f12-bac4dc4607ad", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1636291956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b7f76aef75642d0bffa978550d6935d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a68eacb-ee", "ovs_interfaceid": "1a68eacb-ee1f-4cf8-a15f-668e9a3da691", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:ba:be,bridge_name='br-int',has_traffic_filtering=True,id=1a68eacb-ee1f-4cf8-a15f-668e9a3da691,network=Network(f3e4e91a-ba2c-4e94-9f12-bac4dc4607ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a68eacb-ee') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG os_vif [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:ba:be,bridge_name='br-int',has_traffic_filtering=True,id=1a68eacb-ee1f-4cf8-a15f-668e9a3da691,network=Network(f3e4e91a-ba2c-4e94-9f12-bac4dc4607ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a68eacb-ee') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a68eacb-ee, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:44 user nova-compute[72150]: INFO os_vif [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:ba:be,bridge_name='br-int',has_traffic_filtering=True,id=1a68eacb-ee1f-4cf8-a15f-668e9a3da691,network=Network(f3e4e91a-ba2c-4e94-9f12-bac4dc4607ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a68eacb-ee')
Aug 01 18:23:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItrwdYDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:23:44 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:23:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[26186daa-bd6f-4d2a-b662-1f1c91aa817c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d99fe72-41ba-43aa-ba82-37776881a6e2]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:44 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:44 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:23:44 user nova-compute[72150]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 (non-flash)
Aug 01 18:23:44 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:44 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:44 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:23:44 user nova-compute[72150]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 (non-flash)
Aug 01 18:23:44 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c208670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60'): ({'sde'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Removing single pathed devices sde {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b21e47-328b-41fb-b0a3-686a33bc14b5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f088bad-fa44-4bf1-87c2-da6e2a6662c5]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Flushing IO for device /dev/sde {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd9a5a6-0caf-45ce-bbd5-6ec1d48c9697]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cc61b9-afa7-4b04-a47f-251248fc6f7f]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] SCSI volumes sde have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4488c3f-5b15-4114-ac2c-1faf093f0e21]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63ccb2b-ca04-43fb-bea6-ed5bc59e857d]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60, portal: 172.16.0.220,3260]
Aug 01 18:23:44 user nova-compute[72150]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60, portal: 172.16.0.220,3260] successful.
Aug 01 18:23:44 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6555d10c-408e-4e93-8df2-ab6b69855a60 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a23419-f46d-4250-b33a-81d7417226bf]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] <== disconnect_volume: return (355ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:23:44 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Deleting instance files /opt/stack/data/nova/instances/c3811375-bcd1-46ac-b552-7ff1588a3667_del
Aug 01 18:23:44 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Deletion of /opt/stack/data/nova/instances/c3811375-bcd1-46ac-b552-7ff1588a3667_del complete
Aug 01 18:23:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914209.6274233, 3f123d4e-1aec-4aa1-8717-f31305a62a5d => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:23:44 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] VM Stopped (Lifecycle Event)
Aug 01 18:23:44 user nova-compute[72150]: DEBUG nova.compute.manager [None req-acd98bc6-c54c-4790-b695-ac339350c3de None None] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:23:44 user nova-compute[72150]: INFO nova.compute.manager [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Took 2.01 seconds to destroy the instance on the hypervisor.
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-8a5b0265-8e1d-4a0e-80e6-75def152836d req-b42dd2ed-76dc-4571-98c7-7d7698605734 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-plugged-d2976671-7ae2-4b1a-a3eb-dc87ba628494 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8a5b0265-8e1d-4a0e-80e6-75def152836d req-b42dd2ed-76dc-4571-98c7-7d7698605734 service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8a5b0265-8e1d-4a0e-80e6-75def152836d req-b42dd2ed-76dc-4571-98c7-7d7698605734 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8a5b0265-8e1d-4a0e-80e6-75def152836d req-b42dd2ed-76dc-4571-98c7-7d7698605734 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-8a5b0265-8e1d-4a0e-80e6-75def152836d req-b42dd2ed-76dc-4571-98c7-7d7698605734 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-plugged-d2976671-7ae2-4b1a-a3eb-dc87ba628494 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:44 user nova-compute[72150]: WARNING nova.compute.manager [req-8a5b0265-8e1d-4a0e-80e6-75def152836d req-b42dd2ed-76dc-4571-98c7-7d7698605734 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received unexpected event network-vif-plugged-d2976671-7ae2-4b1a-a3eb-dc87ba628494 for instance with vm_state building and task_state spawning.
Aug 01 18:23:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-plugged-d11da1cb-a45e-468e-949d-48d3bdc0628b {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-plugged-d11da1cb-a45e-468e-949d-48d3bdc0628b {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:44 user nova-compute[72150]: WARNING nova.compute.manager [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received unexpected event network-vif-plugged-d11da1cb-a45e-468e-949d-48d3bdc0628b for instance with vm_state building and task_state spawning.
Aug 01 18:23:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-plugged-624f99f7-d827-4106-9ffc-f57b26c45b5c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-plugged-624f99f7-d827-4106-9ffc-f57b26c45b5c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:44 user nova-compute[72150]: WARNING nova.compute.manager [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received unexpected event network-vif-plugged-624f99f7-d827-4106-9ffc-f57b26c45b5c for instance with vm_state building and task_state spawning.
Aug 01 18:23:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-plugged-624f99f7-d827-4106-9ffc-f57b26c45b5c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-plugged-624f99f7-d827-4106-9ffc-f57b26c45b5c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:44 user nova-compute[72150]: WARNING nova.compute.manager [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received unexpected event network-vif-plugged-624f99f7-d827-4106-9ffc-f57b26c45b5c for instance with vm_state building and task_state spawning.
Aug 01 18:23:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-plugged-9b5fca36-3823-421c-9e7e-bcfb0a4c00ab {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-plugged-9b5fca36-3823-421c-9e7e-bcfb0a4c00ab {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:44 user nova-compute[72150]: WARNING nova.compute.manager [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received unexpected event network-vif-plugged-9b5fca36-3823-421c-9e7e-bcfb0a4c00ab for instance with vm_state building and task_state spawning.
Aug 01 18:23:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-plugged-9b5fca36-3823-421c-9e7e-bcfb0a4c00ab {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-plugged-9b5fca36-3823-421c-9e7e-bcfb0a4c00ab {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:44 user nova-compute[72150]: WARNING nova.compute.manager [req-08f024e4-4a59-4424-b9e6-efe3bc440b23 req-3901276c-1f3d-4f8e-a7e3-4300009b69d9 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received unexpected event network-vif-plugged-9b5fca36-3823-421c-9e7e-bcfb0a4c00ab for instance with vm_state building and task_state spawning.
Aug 01 18:23:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Received event network-vif-unplugged-1a68eacb-ee1f-4cf8-a15f-668e9a3da691 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] Acquiring lock "c3811375-bcd1-46ac-b552-7ff1588a3667-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] Lock "c3811375-bcd1-46ac-b552-7ff1588a3667-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] Lock "c3811375-bcd1-46ac-b552-7ff1588a3667-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] No waiting events found dispatching network-vif-unplugged-1a68eacb-ee1f-4cf8-a15f-668e9a3da691 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Received event network-vif-unplugged-1a68eacb-ee1f-4cf8-a15f-668e9a3da691 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:23:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Received event network-vif-plugged-1a68eacb-ee1f-4cf8-a15f-668e9a3da691 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] Acquiring lock "c3811375-bcd1-46ac-b552-7ff1588a3667-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] Lock "c3811375-bcd1-46ac-b552-7ff1588a3667-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] Lock "c3811375-bcd1-46ac-b552-7ff1588a3667-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] No waiting events found dispatching network-vif-plugged-1a68eacb-ee1f-4cf8-a15f-668e9a3da691 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:45 user nova-compute[72150]: WARNING nova.compute.manager [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Received unexpected event network-vif-plugged-1a68eacb-ee1f-4cf8-a15f-668e9a3da691 for instance with vm_state active and task_state deleting.
Aug 01 18:23:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-plugged-af62c1f6-4440-4109-92b3-80721228f311 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-plugged-af62c1f6-4440-4109-92b3-80721228f311 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:45 user nova-compute[72150]: WARNING nova.compute.manager [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received unexpected event network-vif-plugged-af62c1f6-4440-4109-92b3-80721228f311 for instance with vm_state building and task_state spawning.
Aug 01 18:23:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-plugged-af62c1f6-4440-4109-92b3-80721228f311 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-plugged-af62c1f6-4440-4109-92b3-80721228f311 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:45 user nova-compute[72150]: WARNING nova.compute.manager [req-3f976057-dfb3-4b95-871f-87de9335b293 req-9d0c8b7b-c2d4-454d-97f4-b51a5aed6c14 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received unexpected event network-vif-plugged-af62c1f6-4440-4109-92b3-80721228f311 for instance with vm_state building and task_state spawning.
Aug 01 18:23:45 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:45 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Took 0.88 seconds to deallocate network for instance.
Aug 01 18:23:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:23:46 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Creating image(s)
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Did not create local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Ensure instance console log exists: /opt/stack/data/nova/instances/39ed0e93-df10-4f34-b13a-66a1825d21b9/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Start _get_guest_xml network_info=[{"id": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "address": "fa:16:3e:dc:77:d0", "network": {"id": "f9631fa1-8ca7-453e-a8c2-a550baa29167", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2010840575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a977ce-d7", "ovs_interfaceid": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77546d5a-e74c-4058-9008-a09a455ba8d0", "address": "fa:16:3e:87:f5:13", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77546d5a-e7", "ovs_interfaceid": "77546d5a-e74c-4058-9008-a09a455ba8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fab43aac-fc06-4876-8c52-6f3e5a492217", "address": "fa:16:3e:9c:44:4d", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab43aac-fc", "ovs_interfaceid": "fab43aac-fc06-4876-8c52-6f3e5a492217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "541680e9-0c34-47e2-b297-b3365281b90a", "address": "fa:16:3e:7f:67:77", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541680e9-0c", "ovs_interfaceid": "541680e9-0c34-47e2-b297-b3365281b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "address": "fa:16:3e:a8:fc:df", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6546d6-8f", "ovs_interfaceid": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "650c8b02-2525-403f-88d4-450a0903b33c", "address": "fa:16:3e:72:45:67", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650c8b02-25", "ovs_interfaceid": "650c8b02-2525-403f-88d4-450a0903b33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c024ac3e-43d1-4453-8715-9b49c747fb08", "address": "fa:16:3e:c3:8d:39", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc024ac3e-43", "ovs_interfaceid": "c024ac3e-43d1-4453-8715-9b49c747fb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '293becc9-c8e4-4721-9a4b-6022026a79bb', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEgXxFPk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '39ed0e93-df10-4f34-b13a-66a1825d21b9', 'attached_at': '', 'detached_at': '', 'volume_id': '4265b021-38ab-4756-9284-466525908b84', 'serial': '4265b021-38ab-4756-9284-466525908b84'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '47f11ea0-9d7d-4674-8694-cb2bca90eab2', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryBPznhu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '39ed0e93-df10-4f34-b13a-66a1825d21b9', 'attached_at': '', 'detached_at': '', 'volume_id': '12312153-e821-4e64-820f-7db2a4b28ea6', 'serial': '12312153-e821-4e64-820f-7db2a4b28ea6'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': 'ea432378-ba11-4c9f-96e0-352c1bd2ce46', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qIRExtkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '39ed0e93-df10-4f34-b13a-66a1825d21b9', 'attached_at': '', 'detached_at': '', 'volume_id': '5a5cada3-ff99-466b-8de0-0ffa99d75534', 'serial': '5a5cada3-ff99-466b-8de0-0ffa99d75534'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:46 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:23:46 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEgXxFPk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:23:46 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:23:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:23:46 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:23:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:23:46 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d205f3e8-581e-454a-a252-2b4e6edd423c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:23:46 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e244b8-8eb7-49d5-a65b-eb95de3ed657]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84] added
Aug 01 18:23:46 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c36824-de9e-4097-8844-177bd766b51c]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cce98a-077a-4457-8855-47cb2835b438]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MEgXxFPk {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MEgXxFPk" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacd25e7-cd5e-4a10-92b9-b56560b05252]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MEgXxFPk'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae56b9c7-2f99-4f9a-851e-9b14bd41755a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed56407c-2e49-448f-bf2e-338298d7bee0]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:46 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:46 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:23:46 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:46 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:46 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:23:46 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ea69a0-a34c-4618-959b-e613db7896fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84, portal: 172.16.0.220,3260]
Aug 01 18:23:46 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84, portal: 172.16.0.220,3260] successful.
Aug 01 18:23:46 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c80b94-b685-47b5-9ccd-6fd114308ea0]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9a457b-c754-4ad4-a358-7dc4ca07d550]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:46 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:46 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:23:46 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:23:46 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:46 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:46 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:23:46 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:23:46 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] HCTL ('36', '-', '-', 0) found on session 8 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7935e2-4a8a-491a-85a3-618cff54a991]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Searching for a device in session 8 and hctl ['36', '*', '*', 0] yield: None {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:23:46 user nova-compute[72150]: INFO nova.compute.manager [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Took 1.16 seconds to detach 1 volumes for instance.
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.compute.manager [req-869e769d-125b-4394-b7b9-56c9dca00caf req-a136fc1e-c70a-46ef-8e55-7375f679aa36 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-plugged-13ea9e27-a7e5-4afa-bda3-87c95c480373 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-869e769d-125b-4394-b7b9-56c9dca00caf req-a136fc1e-c70a-46ef-8e55-7375f679aa36 service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-869e769d-125b-4394-b7b9-56c9dca00caf req-a136fc1e-c70a-46ef-8e55-7375f679aa36 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-869e769d-125b-4394-b7b9-56c9dca00caf req-a136fc1e-c70a-46ef-8e55-7375f679aa36 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.compute.manager [req-869e769d-125b-4394-b7b9-56c9dca00caf req-a136fc1e-c70a-46ef-8e55-7375f679aa36 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-plugged-13ea9e27-a7e5-4afa-bda3-87c95c480373 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:46 user nova-compute[72150]: WARNING nova.compute.manager [req-869e769d-125b-4394-b7b9-56c9dca00caf req-a136fc1e-c70a-46ef-8e55-7375f679aa36 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received unexpected event network-vif-plugged-13ea9e27-a7e5-4afa-bda3-87c95c480373 for instance with vm_state building and task_state spawning.
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.compute.manager [req-869e769d-125b-4394-b7b9-56c9dca00caf req-a136fc1e-c70a-46ef-8e55-7375f679aa36 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-plugged-13ea9e27-a7e5-4afa-bda3-87c95c480373 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-869e769d-125b-4394-b7b9-56c9dca00caf req-a136fc1e-c70a-46ef-8e55-7375f679aa36 service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-869e769d-125b-4394-b7b9-56c9dca00caf req-a136fc1e-c70a-46ef-8e55-7375f679aa36 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-869e769d-125b-4394-b7b9-56c9dca00caf req-a136fc1e-c70a-46ef-8e55-7375f679aa36 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG nova.compute.manager [req-869e769d-125b-4394-b7b9-56c9dca00caf req-a136fc1e-c70a-46ef-8e55-7375f679aa36 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-plugged-13ea9e27-a7e5-4afa-bda3-87c95c480373 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:46 user nova-compute[72150]: WARNING nova.compute.manager [req-869e769d-125b-4394-b7b9-56c9dca00caf req-a136fc1e-c70a-46ef-8e55-7375f679aa36 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received unexpected event network-vif-plugged-13ea9e27-a7e5-4afa-bda3-87c95c480373 for instance with vm_state building and task_state spawning.
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-c1779722-cd83-4079-9ef2-e80be11a6797 req-f32fab08-5049-4a7d-892c-bc0da41ff866 service nova] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Received event network-vif-deleted-1a68eacb-ee1f-4cf8-a15f-668e9a3da691 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914227.1034474, 56ad8a5d-4046-463d-9259-67014867ebfe => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:23:47 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] VM Resumed (Lifecycle Event)
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:23:47 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Instance spawned successfully.
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Acquiring lock "interface-554b19ce-2ea6-4494-bdd9-a02444ca920e-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "interface-554b19ce-2ea6-4494-bdd9-a02444ca920e-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.objects.instance [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lazy-loading 'flavor' on Instance uuid 554b19ce-2ea6-4494-bdd9-a02444ca920e {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:23:47 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914227.104994, 56ad8a5d-4046-463d-9259-67014867ebfe => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:23:47 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] VM Started (Lifecycle Event)
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:23:47 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:47 user nova-compute[72150]: INFO nova.compute.manager [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Took 13.03 seconds to spawn the instance on the hypervisor.
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:23:47 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Deleted allocations for instance c3811375-bcd1-46ac-b552-7ff1588a3667
Aug 01 18:23:47 user nova-compute[72150]: INFO nova.compute.manager [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Took 46.82 seconds to build instance.
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.objects.instance [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lazy-loading 'pci_requests' on Instance uuid 554b19ce-2ea6-4494-bdd9-a02444ca920e {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-708760a0-2b84-4f25-bbc5-a676c7e2ad94 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "56ad8a5d-4046-463d-9259-67014867ebfe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.941s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.network.neutron [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-55f0ea69-eeca-474c-95d2-c469053d3662 tempest-DeleteServersTestJSON-998275787 tempest-DeleteServersTestJSON-998275787-project-member] Lock "c3811375-bcd1-46ac-b552-7ff1588a3667" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.793s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-81e707a9-53dd-40a2-8fd1-4dcd87c36918 req-e94e5440-badc-4481-a041-8cd218b5d749 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Received event network-changed-ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-81e707a9-53dd-40a2-8fd1-4dcd87c36918 req-e94e5440-badc-4481-a041-8cd218b5d749 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Refreshing instance network info cache due to event network-changed-ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-81e707a9-53dd-40a2-8fd1-4dcd87c36918 req-e94e5440-badc-4481-a041-8cd218b5d749 service nova] Acquiring lock "refresh_cache-554b19ce-2ea6-4494-bdd9-a02444ca920e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-81e707a9-53dd-40a2-8fd1-4dcd87c36918 req-e94e5440-badc-4481-a041-8cd218b5d749 service nova] Acquired lock "refresh_cache-554b19ce-2ea6-4494-bdd9-a02444ca920e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.network.neutron [req-81e707a9-53dd-40a2-8fd1-4dcd87c36918 req-e94e5440-badc-4481-a041-8cd218b5d749 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Refreshing network info cache for port ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Searching for a device in session 8 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEgXxFPk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26664326138663263', 'path': '/dev/sde'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664326138663263', 'path': '/dev/sde'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.policy [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82554fe6d3e8493dad052be11ea1f30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914ef466b8524705868c2049eef686d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryBPznhu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:23:47 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:23:47 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:23:47 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb22ddbb-ded3-44ad-8fbb-bfb1c33c0285]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:23:47 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[35707447-f030-4cb5-ad8e-7590f53b99c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6] added
Aug 01 18:23:47 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a25258-541e-4d66-aa2d-9bb9dbacbc58]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ae6f21-0137-422f-8ac4-cba522e4f8b5]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ryBPznhu {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ryBPznhu" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[84964c87-3e6d-4501-8631-a7c081a2368e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ryBPznhu'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f9e601-b476-4544-b19e-f94eb5a472dd]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d386972-e743-4d96-b75e-4937a45a4c93]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:47 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:47 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:23:47 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:23:47 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:47 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:47 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:23:47 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:23:47 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[adec54c9-d863-422f-9d1b-5391df515824]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6, portal: 172.16.0.220,3260]
Aug 01 18:23:47 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6, portal: 172.16.0.220,3260] successful.
Aug 01 18:23:47 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb520671-6b14-428b-a3a6-889d63f90d85]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[04560925-d261-43b6-bab7-8c6948e8dac3]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:47 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:47 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:23:47 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:23:47 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:23:47 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:47 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:47 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:23:47 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:23:47 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:23:47 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e42d41-7f12-4784-b96e-ab003e4592b9]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:23:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryBPznhu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:23:48 user nova-compute[72150]: DEBUG nova.network.neutron [req-81e707a9-53dd-40a2-8fd1-4dcd87c36918 req-e94e5440-badc-4481-a041-8cd218b5d749 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Updated VIF entry in instance network info cache for port ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:23:48 user nova-compute[72150]: DEBUG nova.network.neutron [req-81e707a9-53dd-40a2-8fd1-4dcd87c36918 req-e94e5440-badc-4481-a041-8cd218b5d749 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Updating instance_info_cache with network_info: [{"id": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "address": "fa:16:3e:16:e2:2d", "network": {"id": "b006b5b5-51ee-476d-93d1-0f7c510088da", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1317073326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdd368e-4d", "ovs_interfaceid": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-81e707a9-53dd-40a2-8fd1-4dcd87c36918 req-e94e5440-badc-4481-a041-8cd218b5d749 service nova] Releasing lock "refresh_cache-554b19ce-2ea6-4494-bdd9-a02444ca920e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:48 user nova-compute[72150]: DEBUG nova.network.neutron [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Successfully created port: b3e91864-9951-4277-aa80-80fd19c4f3bd {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:23:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:23:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23464383965636665', 'path': '/dev/sdf'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:23:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464383965636665', 'path': '/dev/sdf'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qIRExtkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:23:49 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:23:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:23:49 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:23:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:23:49 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:23:49 user nova-compute[72150]: DEBUG nova.network.neutron [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Successfully updated port: b3e91864-9951-4277-aa80-80fd19c4f3bd {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Acquiring lock "refresh_cache-554b19ce-2ea6-4494-bdd9-a02444ca920e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Acquired lock "refresh_cache-554b19ce-2ea6-4494-bdd9-a02444ca920e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG nova.network.neutron [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[12abd8d7-b075-4f8b-93ec-69025a207a79]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:23:49 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG nova.compute.manager [req-5dd25e85-ca0b-45f4-a0ac-12c1806f3119 req-42cfbd56-5d55-4fe7-9c78-3004c53d22e0 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Received event network-changed-b3e91864-9951-4277-aa80-80fd19c4f3bd {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG nova.compute.manager [req-5dd25e85-ca0b-45f4-a0ac-12c1806f3119 req-42cfbd56-5d55-4fe7-9c78-3004c53d22e0 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Refreshing instance network info cache due to event network-changed-b3e91864-9951-4277-aa80-80fd19c4f3bd. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5dd25e85-ca0b-45f4-a0ac-12c1806f3119 req-42cfbd56-5d55-4fe7-9c78-3004c53d22e0 service nova] Acquiring lock "refresh_cache-554b19ce-2ea6-4494-bdd9-a02444ca920e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.068s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5783a966-d7ac-4229-b4f5-da331e0edfa4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534] added
Aug 01 18:23:49 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb7407e-2b5e-46f4-85d8-952e60efb2a0]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[365f369a-e4ec-4e83-8d7b-ef10c1ef9fa9]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qIRExtkr {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qIRExtkr" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa3120a-2414-42e4-8587-e9a9873972d6]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qIRExtkr'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[952d4ebb-3a2e-494b-ae3f-1670f6f323ec]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa175ed-30fc-4cb9-a3de-1c665a9a2cf3]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:49 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:49 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:23:49 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:23:49 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:23:49 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:49 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:49 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:23:49 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:23:49 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:23:49 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08397e2-c04b-4283-8751-f8a3e763dfc1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534, portal: 172.16.0.220,3260]
Aug 01 18:23:49 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534, portal: 172.16.0.220,3260] successful.
Aug 01 18:23:49 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb38376-a6d9-4383-bc8a-7a7baf2681f7]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c035330-7c69-4d99-928f-282e1799efb4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:23:49 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:49 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:49 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:23:49 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:23:49 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:23:49 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:23:49 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:23:49 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:23:49 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:23:49 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:23:49 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:23:49 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.833s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] HCTL ('38', '-', '-', 0) found on session 10 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:23:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[59be5782-7b94-4be9-baaf-a77de3717343]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qIRExtkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "9a4c69c1-6d13-4428-9460-be5988aa0b16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:23:50 user nova-compute[72150]: INFO nova.compute.claims [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Claim successful on node user
Aug 01 18:23:50 user nova-compute[72150]: DEBUG nova.network.neutron [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Updating instance_info_cache with network_info: [{"id": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "address": "fa:16:3e:16:e2:2d", "network": {"id": "b006b5b5-51ee-476d-93d1-0f7c510088da", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1317073326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdd368e-4d", "ovs_interfaceid": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "address": "fa:16:3e:e5:61:f3", "network": {"id": "f7037297-1133-40b9-a92f-ae5d7e9c70a3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1106927103", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e91864-99", "ovs_interfaceid": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Releasing lock "refresh_cache-554b19ce-2ea6-4494-bdd9-a02444ca920e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5dd25e85-ca0b-45f4-a0ac-12c1806f3119 req-42cfbd56-5d55-4fe7-9c78-3004c53d22e0 service nova] Acquired lock "refresh_cache-554b19ce-2ea6-4494-bdd9-a02444ca920e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG nova.network.neutron [req-5dd25e85-ca0b-45f4-a0ac-12c1806f3119 req-42cfbd56-5d55-4fe7-9c78-3004c53d22e0 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Refreshing network info cache for port b3e91864-9951-4277-aa80-80fd19c4f3bd {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:21:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-394626827',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-394626827',id=4,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGka8LdSLmSpjhTZLxRAxtcPMCKQajuZ77ZSdnGv3Wn3uuB5MQyyWWolkbZ67FX8/Xq0MR4R0cch8xeVC596/BP8zPK2w+Y90ycK77u4iqCmTXKKtZgqFB/uHq/hsiFKmg==',key_name='tempest-keypair-1974078877',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='914ef466b8524705868c2049eef686d6',ramdisk_id='',reservation_id='r-tmr2ov96',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1401298341',owner_user_name='tempest-TaggedAttachmentsTest-1401298341-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82554fe6d3e8493dad052be11ea1f30b',uuid=554b19ce-2ea6-4494-bdd9-a02444ca920e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "address": "fa:16:3e:e5:61:f3", "network": {"id": "f7037297-1133-40b9-a92f-ae5d7e9c70a3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1106927103", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e91864-99", "ovs_interfaceid": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Converting VIF {"id": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "address": "fa:16:3e:e5:61:f3", "network": {"id": "f7037297-1133-40b9-a92f-ae5d7e9c70a3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1106927103", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e91864-99", "ovs_interfaceid": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:61:f3,bridge_name='br-int',has_traffic_filtering=True,id=b3e91864-9951-4277-aa80-80fd19c4f3bd,network=Network(f7037297-1133-40b9-a92f-ae5d7e9c70a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e91864-99') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG os_vif [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:61:f3,bridge_name='br-int',has_traffic_filtering=True,id=b3e91864-9951-4277-aa80-80fd19c4f3bd,network=Network(f7037297-1133-40b9-a92f-ae5d7e9c70a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e91864-99') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3e91864-99, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3e91864-99, col_values=(('external_ids', {'iface-id': 'b3e91864-9951-4277-aa80-80fd19c4f3bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:61:f3', 'vm-uuid': '554b19ce-2ea6-4494-bdd9-a02444ca920e'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:50 user nova-compute[72150]: INFO os_vif [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:61:f3,bridge_name='br-int',has_traffic_filtering=True,id=b3e91864-9951-4277-aa80-80fd19c4f3bd,network=Network(f7037297-1133-40b9-a92f-ae5d7e9c70a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e91864-99')
Aug 01 18:23:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:21:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-394626827',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-394626827',id=4,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGka8LdSLmSpjhTZLxRAxtcPMCKQajuZ77ZSdnGv3Wn3uuB5MQyyWWolkbZ67FX8/Xq0MR4R0cch8xeVC596/BP8zPK2w+Y90ycK77u4iqCmTXKKtZgqFB/uHq/hsiFKmg==',key_name='tempest-keypair-1974078877',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='914ef466b8524705868c2049eef686d6',ramdisk_id='',reservation_id='r-tmr2ov96',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1401298341',owner_user_name='tempest-TaggedAttachmentsTest-1401298341-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82554fe6d3e8493dad052be11ea1f30b',uuid=554b19ce-2ea6-4494-bdd9-a02444ca920e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "address": "fa:16:3e:e5:61:f3", "network": {"id": "f7037297-1133-40b9-a92f-ae5d7e9c70a3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1106927103", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e91864-99", "ovs_interfaceid": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Converting VIF {"id": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "address": "fa:16:3e:e5:61:f3", "network": {"id": "f7037297-1133-40b9-a92f-ae5d7e9c70a3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1106927103", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e91864-99", "ovs_interfaceid": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:61:f3,bridge_name='br-int',has_traffic_filtering=True,id=b3e91864-9951-4277-aa80-80fd19c4f3bd,network=Network(f7037297-1133-40b9-a92f-ae5d7e9c70a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e91864-99') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] attach device xml: <interface type="ethernet">
Aug 01 18:23:50 user nova-compute[72150]:   <mac address="fa:16:3e:e5:61:f3"/>
Aug 01 18:23:50 user nova-compute[72150]:   <model type="virtio"/>
Aug 01 18:23:50 user nova-compute[72150]:   <mtu size="1442"/>
Aug 01 18:23:50 user nova-compute[72150]:   <target dev="tapb3e91864-99"/>
Aug 01 18:23:50 user nova-compute[72150]: </interface>
Aug 01 18:23:50 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.875s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] <== connect_volume: return (1876ms) {'type': 'block', 'scsi_wwn': '23136303033316266', 'path': '/dev/sdg'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:23:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136303033316266', 'path': '/dev/sdg'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2014007240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2014007240',id=9,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ECeSPUMc++nSJlRUYvQf+7gQpST58K1TxWzhrTnrq13Jdlj7i5BJx01qhEK9DQjreJB1IajiL6K96JXmqZJ3UXS2MQQ5P0dRpaOGmLVmrEYZTyKLGY8SqcMnKBMPZPw==',key_name='tempest-keypair-57552355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b60b336a42e94d27b1079bbf8732eb7d',ramdisk_id='',reservation_id='r-0402eoyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1666899254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1666899254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f62806f8d5534c86a3a1808daa5edbb4',uuid=39ed0e93-df10-4f34-b13a-66a1825d21b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "address": "fa:16:3e:dc:77:d0", "network": {"id": "f9631fa1-8ca7-453e-a8c2-a550baa29167", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2010840575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a977ce-d7", "ovs_interfaceid": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converting VIF {"id": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "address": "fa:16:3e:dc:77:d0", "network": {"id": "f9631fa1-8ca7-453e-a8c2-a550baa29167", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2010840575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a977ce-d7", "ovs_interfaceid": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:77:d0,bridge_name='br-int',has_traffic_filtering=True,id=39a977ce-d734-4852-838b-6dfbb51c0bf8,network=Network(f9631fa1-8ca7-453e-a8c2-a550baa29167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a977ce-d7') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2014007240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2014007240',id=9,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ECeSPUMc++nSJlRUYvQf+7gQpST58K1TxWzhrTnrq13Jdlj7i5BJx01qhEK9DQjreJB1IajiL6K96JXmqZJ3UXS2MQQ5P0dRpaOGmLVmrEYZTyKLGY8SqcMnKBMPZPw==',key_name='tempest-keypair-57552355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b60b336a42e94d27b1079bbf8732eb7d',ramdisk_id='',reservation_id='r-0402eoyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1666899254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1666899254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f62806f8d5534c86a3a1808daa5edbb4',uuid=39ed0e93-df10-4f34-b13a-66a1825d21b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77546d5a-e74c-4058-9008-a09a455ba8d0", "address": "fa:16:3e:87:f5:13", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77546d5a-e7", "ovs_interfaceid": "77546d5a-e74c-4058-9008-a09a455ba8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converting VIF {"id": "77546d5a-e74c-4058-9008-a09a455ba8d0", "address": "fa:16:3e:87:f5:13", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77546d5a-e7", "ovs_interfaceid": "77546d5a-e74c-4058-9008-a09a455ba8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f5:13,bridge_name='br-int',has_traffic_filtering=True,id=77546d5a-e74c-4058-9008-a09a455ba8d0,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77546d5a-e7') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2014007240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2014007240',id=9,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ECeSPUMc++nSJlRUYvQf+7gQpST58K1TxWzhrTnrq13Jdlj7i5BJx01qhEK9DQjreJB1IajiL6K96JXmqZJ3UXS2MQQ5P0dRpaOGmLVmrEYZTyKLGY8SqcMnKBMPZPw==',key_name='tempest-keypair-57552355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b60b336a42e94d27b1079bbf8732eb7d',ramdisk_id='',reservation_id='r-0402eoyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1666899254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1666899254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f62806f8d5534c86a3a1808daa5edbb4',uuid=39ed0e93-df10-4f34-b13a-66a1825d21b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fab43aac-fc06-4876-8c52-6f3e5a492217", "address": "fa:16:3e:9c:44:4d", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab43aac-fc", "ovs_interfaceid": "fab43aac-fc06-4876-8c52-6f3e5a492217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converting VIF {"id": "fab43aac-fc06-4876-8c52-6f3e5a492217", "address": "fa:16:3e:9c:44:4d", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab43aac-fc", "ovs_interfaceid": "fab43aac-fc06-4876-8c52-6f3e5a492217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:44:4d,bridge_name='br-int',has_traffic_filtering=True,id=fab43aac-fc06-4876-8c52-6f3e5a492217,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfab43aac-fc') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2014007240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2014007240',id=9,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ECeSPUMc++nSJlRUYvQf+7gQpST58K1TxWzhrTnrq13Jdlj7i5BJx01qhEK9DQjreJB1IajiL6K96JXmqZJ3UXS2MQQ5P0dRpaOGmLVmrEYZTyKLGY8SqcMnKBMPZPw==',key_name='tempest-keypair-57552355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b60b336a42e94d27b1079bbf8732eb7d',ramdisk_id='',reservation_id='r-0402eoyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1666899254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1666899254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f62806f8d5534c86a3a1808daa5edbb4',uuid=39ed0e93-df10-4f34-b13a-66a1825d21b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "541680e9-0c34-47e2-b297-b3365281b90a", "address": "fa:16:3e:7f:67:77", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541680e9-0c", "ovs_interfaceid": "541680e9-0c34-47e2-b297-b3365281b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converting VIF {"id": "541680e9-0c34-47e2-b297-b3365281b90a", "address": "fa:16:3e:7f:67:77", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541680e9-0c", "ovs_interfaceid": "541680e9-0c34-47e2-b297-b3365281b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:67:77,bridge_name='br-int',has_traffic_filtering=True,id=541680e9-0c34-47e2-b297-b3365281b90a,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap541680e9-0c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2014007240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2014007240',id=9,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ECeSPUMc++nSJlRUYvQf+7gQpST58K1TxWzhrTnrq13Jdlj7i5BJx01qhEK9DQjreJB1IajiL6K96JXmqZJ3UXS2MQQ5P0dRpaOGmLVmrEYZTyKLGY8SqcMnKBMPZPw==',key_name='tempest-keypair-57552355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b60b336a42e94d27b1079bbf8732eb7d',ramdisk_id='',reservation_id='r-0402eoyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1666899254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1666899254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f62806f8d5534c86a3a1808daa5edbb4',uuid=39ed0e93-df10-4f34-b13a-66a1825d21b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "address": "fa:16:3e:a8:fc:df", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6546d6-8f", "ovs_interfaceid": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converting VIF {"id": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "address": "fa:16:3e:a8:fc:df", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6546d6-8f", "ovs_interfaceid": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fc:df,bridge_name='br-int',has_traffic_filtering=True,id=1e6546d6-8fa5-4298-851b-3fb6efa9420c,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e6546d6-8f') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2014007240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2014007240',id=9,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ECeSPUMc++nSJlRUYvQf+7gQpST58K1TxWzhrTnrq13Jdlj7i5BJx01qhEK9DQjreJB1IajiL6K96JXmqZJ3UXS2MQQ5P0dRpaOGmLVmrEYZTyKLGY8SqcMnKBMPZPw==',key_name='tempest-keypair-57552355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b60b336a42e94d27b1079bbf8732eb7d',ramdisk_id='',reservation_id='r-0402eoyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1666899254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1666899254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f62806f8d5534c86a3a1808daa5edbb4',uuid=39ed0e93-df10-4f34-b13a-66a1825d21b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "650c8b02-2525-403f-88d4-450a0903b33c", "address": "fa:16:3e:72:45:67", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650c8b02-25", "ovs_interfaceid": "650c8b02-2525-403f-88d4-450a0903b33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converting VIF {"id": "650c8b02-2525-403f-88d4-450a0903b33c", "address": "fa:16:3e:72:45:67", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650c8b02-25", "ovs_interfaceid": "650c8b02-2525-403f-88d4-450a0903b33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:45:67,bridge_name='br-int',has_traffic_filtering=True,id=650c8b02-2525-403f-88d4-450a0903b33c,network=Network(2738102a-fe12-412d-9dc2-a1ce7a79997a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap650c8b02-25') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2014007240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2014007240',id=9,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ECeSPUMc++nSJlRUYvQf+7gQpST58K1TxWzhrTnrq13Jdlj7i5BJx01qhEK9DQjreJB1IajiL6K96JXmqZJ3UXS2MQQ5P0dRpaOGmLVmrEYZTyKLGY8SqcMnKBMPZPw==',key_name='tempest-keypair-57552355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b60b336a42e94d27b1079bbf8732eb7d',ramdisk_id='',reservation_id='r-0402eoyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1666899254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1666899254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f62806f8d5534c86a3a1808daa5edbb4',uuid=39ed0e93-df10-4f34-b13a-66a1825d21b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c024ac3e-43d1-4453-8715-9b49c747fb08", "address": "fa:16:3e:c3:8d:39", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc024ac3e-43", "ovs_interfaceid": "c024ac3e-43d1-4453-8715-9b49c747fb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converting VIF {"id": "c024ac3e-43d1-4453-8715-9b49c747fb08", "address": "fa:16:3e:c3:8d:39", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc024ac3e-43", "ovs_interfaceid": "c024ac3e-43d1-4453-8715-9b49c747fb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:8d:39,bridge_name='br-int',has_traffic_filtering=True,id=c024ac3e-43d1-4453-8715-9b49c747fb08,network=Network(2738102a-fe12-412d-9dc2-a1ce7a79997a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc024ac3e-43') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.objects.instance [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lazy-loading 'pci_devices' on Instance uuid 39ed0e93-df10-4f34-b13a-66a1825d21b9 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:23:51 user nova-compute[72150]:   <uuid>39ed0e93-df10-4f34-b13a-66a1825d21b9</uuid>
Aug 01 18:23:51 user nova-compute[72150]:   <name>instance-00000009</name>
Aug 01 18:23:51 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:23:51 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:23:51 user nova-compute[72150]:   <metadata>
Aug 01 18:23:51 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:23:51 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:23:51 user nova-compute[72150]:       <nova:name>tempest-device-tagging-server-2014007240</nova:name>
Aug 01 18:23:51 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:23:46</nova:creationTime>
Aug 01 18:23:51 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:23:51 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:23:51 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:23:51 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:23:51 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:23:51 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:23:51 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:23:51 user nova-compute[72150]:       <nova:owner>
Aug 01 18:23:51 user nova-compute[72150]:         <nova:user uuid="f62806f8d5534c86a3a1808daa5edbb4">tempest-TaggedBootDevicesTest_v242-1666899254-project-member</nova:user>
Aug 01 18:23:51 user nova-compute[72150]:         <nova:project uuid="b60b336a42e94d27b1079bbf8732eb7d">tempest-TaggedBootDevicesTest_v242-1666899254</nova:project>
Aug 01 18:23:51 user nova-compute[72150]:       </nova:owner>
Aug 01 18:23:51 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:23:51 user nova-compute[72150]:       <nova:ports>
Aug 01 18:23:51 user nova-compute[72150]:         <nova:port uuid="39a977ce-d734-4852-838b-6dfbb51c0bf8">
Aug 01 18:23:51 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 18:23:51 user nova-compute[72150]:         </nova:port>
Aug 01 18:23:51 user nova-compute[72150]:         <nova:port uuid="77546d5a-e74c-4058-9008-a09a455ba8d0">
Aug 01 18:23:51 user nova-compute[72150]:           <nova:ip type="fixed" address="10.1.1.181" ipVersion="4"/>
Aug 01 18:23:51 user nova-compute[72150]:         </nova:port>
Aug 01 18:23:51 user nova-compute[72150]:         <nova:port uuid="fab43aac-fc06-4876-8c52-6f3e5a492217">
Aug 01 18:23:51 user nova-compute[72150]:           <nova:ip type="fixed" address="10.1.1.139" ipVersion="4"/>
Aug 01 18:23:51 user nova-compute[72150]:         </nova:port>
Aug 01 18:23:51 user nova-compute[72150]:         <nova:port uuid="541680e9-0c34-47e2-b297-b3365281b90a">
Aug 01 18:23:51 user nova-compute[72150]:           <nova:ip type="fixed" address="10.1.1.61" ipVersion="4"/>
Aug 01 18:23:51 user nova-compute[72150]:         </nova:port>
Aug 01 18:23:51 user nova-compute[72150]:         <nova:port uuid="1e6546d6-8fa5-4298-851b-3fb6efa9420c">
Aug 01 18:23:51 user nova-compute[72150]:           <nova:ip type="fixed" address="10.1.1.37" ipVersion="4"/>
Aug 01 18:23:51 user nova-compute[72150]:         </nova:port>
Aug 01 18:23:51 user nova-compute[72150]:         <nova:port uuid="650c8b02-2525-403f-88d4-450a0903b33c">
Aug 01 18:23:51 user nova-compute[72150]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 01 18:23:51 user nova-compute[72150]:         </nova:port>
Aug 01 18:23:51 user nova-compute[72150]:         <nova:port uuid="c024ac3e-43d1-4453-8715-9b49c747fb08">
Aug 01 18:23:51 user nova-compute[72150]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 01 18:23:51 user nova-compute[72150]:         </nova:port>
Aug 01 18:23:51 user nova-compute[72150]:       </nova:ports>
Aug 01 18:23:51 user nova-compute[72150]:     </nova:instance>
Aug 01 18:23:51 user nova-compute[72150]:   </metadata>
Aug 01 18:23:51 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:23:51 user nova-compute[72150]:     <system>
Aug 01 18:23:51 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:23:51 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:23:51 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:23:51 user nova-compute[72150]:       <entry name="serial">39ed0e93-df10-4f34-b13a-66a1825d21b9</entry>
Aug 01 18:23:51 user nova-compute[72150]:       <entry name="uuid">39ed0e93-df10-4f34-b13a-66a1825d21b9</entry>
Aug 01 18:23:51 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:23:51 user nova-compute[72150]:     </system>
Aug 01 18:23:51 user nova-compute[72150]:   </sysinfo>
Aug 01 18:23:51 user nova-compute[72150]:   <os>
Aug 01 18:23:51 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:23:51 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:23:51 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:23:51 user nova-compute[72150]:   </os>
Aug 01 18:23:51 user nova-compute[72150]:   <features>
Aug 01 18:23:51 user nova-compute[72150]:     <acpi/>
Aug 01 18:23:51 user nova-compute[72150]:     <apic/>
Aug 01 18:23:51 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:23:51 user nova-compute[72150]:   </features>
Aug 01 18:23:51 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:23:51 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:23:51 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:23:51 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:23:51 user nova-compute[72150]:   </clock>
Aug 01 18:23:51 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:23:51 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:23:51 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:23:51 user nova-compute[72150]:   </cpu>
Aug 01 18:23:51 user nova-compute[72150]:   <devices>
Aug 01 18:23:51 user nova-compute[72150]:     <disk type="file" device="cdrom">
Aug 01 18:23:51 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 18:23:51 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/39ed0e93-df10-4f34-b13a-66a1825d21b9/disk.config"/>
Aug 01 18:23:51 user nova-compute[72150]:       <target dev="hda" bus="ide"/>
Aug 01 18:23:51 user nova-compute[72150]:     </disk>
Aug 01 18:23:51 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:23:51 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:23:51 user nova-compute[72150]:       <source dev="/dev/sde"/>
Aug 01 18:23:51 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:23:51 user nova-compute[72150]:       <serial>4265b021-38ab-4756-9284-466525908b84</serial>
Aug 01 18:23:51 user nova-compute[72150]:     </disk>
Aug 01 18:23:51 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:23:51 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:23:51 user nova-compute[72150]:       <source dev="/dev/sdf"/>
Aug 01 18:23:51 user nova-compute[72150]:       <target dev="vdb" bus="virtio"/>
Aug 01 18:23:51 user nova-compute[72150]:       <serial>12312153-e821-4e64-820f-7db2a4b28ea6</serial>
Aug 01 18:23:51 user nova-compute[72150]:     </disk>
Aug 01 18:23:51 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:23:51 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:23:51 user nova-compute[72150]:       <source dev="/dev/sdg"/>
Aug 01 18:23:51 user nova-compute[72150]:       <target dev="vdc" bus="virtio"/>
Aug 01 18:23:51 user nova-compute[72150]:       <serial>5a5cada3-ff99-466b-8de0-0ffa99d75534</serial>
Aug 01 18:23:51 user nova-compute[72150]:     </disk>
Aug 01 18:23:51 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:23:51 user nova-compute[72150]:       <mac address="fa:16:3e:dc:77:d0"/>
Aug 01 18:23:51 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:23:51 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:23:51 user nova-compute[72150]:       <target dev="tap39a977ce-d7"/>
Aug 01 18:23:51 user nova-compute[72150]:     </interface>
Aug 01 18:23:51 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:23:51 user nova-compute[72150]:       <mac address="fa:16:3e:87:f5:13"/>
Aug 01 18:23:51 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:23:51 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:23:51 user nova-compute[72150]:       <target dev="tap77546d5a-e7"/>
Aug 01 18:23:51 user nova-compute[72150]:     </interface>
Aug 01 18:23:51 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:23:51 user nova-compute[72150]:       <mac address="fa:16:3e:9c:44:4d"/>
Aug 01 18:23:51 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:23:51 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:23:51 user nova-compute[72150]:       <target dev="tapfab43aac-fc"/>
Aug 01 18:23:51 user nova-compute[72150]:     </interface>
Aug 01 18:23:51 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:23:51 user nova-compute[72150]:       <mac address="fa:16:3e:7f:67:77"/>
Aug 01 18:23:51 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:23:51 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:23:51 user nova-compute[72150]:       <target dev="tap541680e9-0c"/>
Aug 01 18:23:51 user nova-compute[72150]:     </interface>
Aug 01 18:23:51 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:23:51 user nova-compute[72150]:       <mac address="fa:16:3e:a8:fc:df"/>
Aug 01 18:23:51 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:23:51 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:23:51 user nova-compute[72150]:       <target dev="tap1e6546d6-8f"/>
Aug 01 18:23:51 user nova-compute[72150]:     </interface>
Aug 01 18:23:51 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:23:51 user nova-compute[72150]:       <mac address="fa:16:3e:72:45:67"/>
Aug 01 18:23:51 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:23:51 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:23:51 user nova-compute[72150]:       <target dev="tap650c8b02-25"/>
Aug 01 18:23:51 user nova-compute[72150]:     </interface>
Aug 01 18:23:51 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:23:51 user nova-compute[72150]:       <mac address="fa:16:3e:c3:8d:39"/>
Aug 01 18:23:51 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:23:51 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:23:51 user nova-compute[72150]:       <target dev="tapc024ac3e-43"/>
Aug 01 18:23:51 user nova-compute[72150]:     </interface>
Aug 01 18:23:51 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:23:51 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/39ed0e93-df10-4f34-b13a-66a1825d21b9/console.log" append="off"/>
Aug 01 18:23:51 user nova-compute[72150]:     </serial>
Aug 01 18:23:51 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:23:51 user nova-compute[72150]:     <video>
Aug 01 18:23:51 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:23:51 user nova-compute[72150]:     </video>
Aug 01 18:23:51 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:23:51 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:23:51 user nova-compute[72150]:     </rng>
Aug 01 18:23:51 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:23:51 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:23:51 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:23:51 user nova-compute[72150]:     </memballoon>
Aug 01 18:23:51 user nova-compute[72150]:   </devices>
Aug 01 18:23:51 user nova-compute[72150]: </domain>
Aug 01 18:23:51 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2014007240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2014007240',id=9,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ECeSPUMc++nSJlRUYvQf+7gQpST58K1TxWzhrTnrq13Jdlj7i5BJx01qhEK9DQjreJB1IajiL6K96JXmqZJ3UXS2MQQ5P0dRpaOGmLVmrEYZTyKLGY8SqcMnKBMPZPw==',key_name='tempest-keypair-57552355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b60b336a42e94d27b1079bbf8732eb7d',ramdisk_id='',reservation_id='r-0402eoyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1666899254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1666899254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f62806f8d5534c86a3a1808daa5edbb4',uuid=39ed0e93-df10-4f34-b13a-66a1825d21b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "address": "fa:16:3e:dc:77:d0", "network": {"id": "f9631fa1-8ca7-453e-a8c2-a550baa29167", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2010840575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a977ce-d7", "ovs_interfaceid": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converting VIF {"id": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "address": "fa:16:3e:dc:77:d0", "network": {"id": "f9631fa1-8ca7-453e-a8c2-a550baa29167", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2010840575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a977ce-d7", "ovs_interfaceid": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:77:d0,bridge_name='br-int',has_traffic_filtering=True,id=39a977ce-d734-4852-838b-6dfbb51c0bf8,network=Network(f9631fa1-8ca7-453e-a8c2-a550baa29167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a977ce-d7') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG os_vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:77:d0,bridge_name='br-int',has_traffic_filtering=True,id=39a977ce-d734-4852-838b-6dfbb51c0bf8,network=Network(f9631fa1-8ca7-453e-a8c2-a550baa29167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a977ce-d7') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-e3c13efd-2ccb-4536-b991-150af59506a7 req-b3d735fc-abe0-42ec-b10f-3e1339b61782 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Received event network-vif-plugged-b3e91864-9951-4277-aa80-80fd19c4f3bd {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e3c13efd-2ccb-4536-b991-150af59506a7 req-b3d735fc-abe0-42ec-b10f-3e1339b61782 service nova] Acquiring lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e3c13efd-2ccb-4536-b991-150af59506a7 req-b3d735fc-abe0-42ec-b10f-3e1339b61782 service nova] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e3c13efd-2ccb-4536-b991-150af59506a7 req-b3d735fc-abe0-42ec-b10f-3e1339b61782 service nova] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-e3c13efd-2ccb-4536-b991-150af59506a7 req-b3d735fc-abe0-42ec-b10f-3e1339b61782 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] No waiting events found dispatching network-vif-plugged-b3e91864-9951-4277-aa80-80fd19c4f3bd {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:51 user nova-compute[72150]: WARNING nova.compute.manager [req-e3c13efd-2ccb-4536-b991-150af59506a7 req-b3d735fc-abe0-42ec-b10f-3e1339b61782 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Received unexpected event network-vif-plugged-b3e91864-9951-4277-aa80-80fd19c4f3bd for instance with vm_state active and task_state None.
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39a977ce-d7, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap39a977ce-d7, col_values=(('external_ids', {'iface-id': '39a977ce-d734-4852-838b-6dfbb51c0bf8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:77:d0', 'vm-uuid': '39ed0e93-df10-4f34-b13a-66a1825d21b9'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: INFO os_vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:77:d0,bridge_name='br-int',has_traffic_filtering=True,id=39a977ce-d734-4852-838b-6dfbb51c0bf8,network=Network(f9631fa1-8ca7-453e-a8c2-a550baa29167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a977ce-d7')
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2014007240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2014007240',id=9,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ECeSPUMc++nSJlRUYvQf+7gQpST58K1TxWzhrTnrq13Jdlj7i5BJx01qhEK9DQjreJB1IajiL6K96JXmqZJ3UXS2MQQ5P0dRpaOGmLVmrEYZTyKLGY8SqcMnKBMPZPw==',key_name='tempest-keypair-57552355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b60b336a42e94d27b1079bbf8732eb7d',ramdisk_id='',reservation_id='r-0402eoyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1666899254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1666899254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f62806f8d5534c86a3a1808daa5edbb4',uuid=39ed0e93-df10-4f34-b13a-66a1825d21b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77546d5a-e74c-4058-9008-a09a455ba8d0", "address": "fa:16:3e:87:f5:13", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77546d5a-e7", "ovs_interfaceid": "77546d5a-e74c-4058-9008-a09a455ba8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converting VIF {"id": "77546d5a-e74c-4058-9008-a09a455ba8d0", "address": "fa:16:3e:87:f5:13", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77546d5a-e7", "ovs_interfaceid": "77546d5a-e74c-4058-9008-a09a455ba8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f5:13,bridge_name='br-int',has_traffic_filtering=True,id=77546d5a-e74c-4058-9008-a09a455ba8d0,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77546d5a-e7') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG os_vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f5:13,bridge_name='br-int',has_traffic_filtering=True,id=77546d5a-e74c-4058-9008-a09a455ba8d0,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77546d5a-e7') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77546d5a-e7, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77546d5a-e7, col_values=(('external_ids', {'iface-id': '77546d5a-e74c-4058-9008-a09a455ba8d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:f5:13', 'vm-uuid': '39ed0e93-df10-4f34-b13a-66a1825d21b9'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: INFO os_vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f5:13,bridge_name='br-int',has_traffic_filtering=True,id=77546d5a-e74c-4058-9008-a09a455ba8d0,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77546d5a-e7')
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2014007240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2014007240',id=9,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ECeSPUMc++nSJlRUYvQf+7gQpST58K1TxWzhrTnrq13Jdlj7i5BJx01qhEK9DQjreJB1IajiL6K96JXmqZJ3UXS2MQQ5P0dRpaOGmLVmrEYZTyKLGY8SqcMnKBMPZPw==',key_name='tempest-keypair-57552355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b60b336a42e94d27b1079bbf8732eb7d',ramdisk_id='',reservation_id='r-0402eoyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1666899254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1666899254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f62806f8d5534c86a3a1808daa5edbb4',uuid=39ed0e93-df10-4f34-b13a-66a1825d21b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fab43aac-fc06-4876-8c52-6f3e5a492217", "address": "fa:16:3e:9c:44:4d", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab43aac-fc", "ovs_interfaceid": "fab43aac-fc06-4876-8c52-6f3e5a492217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converting VIF {"id": "fab43aac-fc06-4876-8c52-6f3e5a492217", "address": "fa:16:3e:9c:44:4d", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab43aac-fc", "ovs_interfaceid": "fab43aac-fc06-4876-8c52-6f3e5a492217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:44:4d,bridge_name='br-int',has_traffic_filtering=True,id=fab43aac-fc06-4876-8c52-6f3e5a492217,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfab43aac-fc') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG os_vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:44:4d,bridge_name='br-int',has_traffic_filtering=True,id=fab43aac-fc06-4876-8c52-6f3e5a492217,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfab43aac-fc') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.neutron [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfab43aac-fc, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfab43aac-fc, col_values=(('external_ids', {'iface-id': 'fab43aac-fc06-4876-8c52-6f3e5a492217', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:44:4d', 'vm-uuid': '39ed0e93-df10-4f34-b13a-66a1825d21b9'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] No BDM found with device name hda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] No VIF found with MAC fa:16:3e:16:e2:2d, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:23:51 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: INFO os_vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:44:4d,bridge_name='br-int',has_traffic_filtering=True,id=fab43aac-fc06-4876-8c52-6f3e5a492217,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfab43aac-fc')
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2014007240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2014007240',id=9,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ECeSPUMc++nSJlRUYvQf+7gQpST58K1TxWzhrTnrq13Jdlj7i5BJx01qhEK9DQjreJB1IajiL6K96JXmqZJ3UXS2MQQ5P0dRpaOGmLVmrEYZTyKLGY8SqcMnKBMPZPw==',key_name='tempest-keypair-57552355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b60b336a42e94d27b1079bbf8732eb7d',ramdisk_id='',reservation_id='r-0402eoyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1666899254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1666899254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f62806f8d5534c86a3a1808daa5edbb4',uuid=39ed0e93-df10-4f34-b13a-66a1825d21b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "541680e9-0c34-47e2-b297-b3365281b90a", "address": "fa:16:3e:7f:67:77", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541680e9-0c", "ovs_interfaceid": "541680e9-0c34-47e2-b297-b3365281b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converting VIF {"id": "541680e9-0c34-47e2-b297-b3365281b90a", "address": "fa:16:3e:7f:67:77", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541680e9-0c", "ovs_interfaceid": "541680e9-0c34-47e2-b297-b3365281b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:67:77,bridge_name='br-int',has_traffic_filtering=True,id=541680e9-0c34-47e2-b297-b3365281b90a,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap541680e9-0c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG os_vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:67:77,bridge_name='br-int',has_traffic_filtering=True,id=541680e9-0c34-47e2-b297-b3365281b90a,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap541680e9-0c') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap541680e9-0c, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap541680e9-0c, col_values=(('external_ids', {'iface-id': '541680e9-0c34-47e2-b297-b3365281b90a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:67:77', 'vm-uuid': '39ed0e93-df10-4f34-b13a-66a1825d21b9'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:23:51 user nova-compute[72150]:   <nova:package version="0.0.0"/>
Aug 01 18:23:51 user nova-compute[72150]:   <nova:name>tempest-device-tagging-server-394626827</nova:name>
Aug 01 18:23:51 user nova-compute[72150]:   <nova:creationTime>2023-08-01 18:23:51</nova:creationTime>
Aug 01 18:23:51 user nova-compute[72150]:   <nova:flavor name="m1.tiny">
Aug 01 18:23:51 user nova-compute[72150]:     <nova:memory>512</nova:memory>
Aug 01 18:23:51 user nova-compute[72150]:     <nova:disk>1</nova:disk>
Aug 01 18:23:51 user nova-compute[72150]:     <nova:swap>0</nova:swap>
Aug 01 18:23:51 user nova-compute[72150]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:23:51 user nova-compute[72150]:     <nova:vcpus>1</nova:vcpus>
Aug 01 18:23:51 user nova-compute[72150]:   </nova:flavor>
Aug 01 18:23:51 user nova-compute[72150]:   <nova:owner>
Aug 01 18:23:51 user nova-compute[72150]:     <nova:user uuid="82554fe6d3e8493dad052be11ea1f30b">tempest-TaggedAttachmentsTest-1401298341-project-member</nova:user>
Aug 01 18:23:51 user nova-compute[72150]:     <nova:project uuid="914ef466b8524705868c2049eef686d6">tempest-TaggedAttachmentsTest-1401298341</nova:project>
Aug 01 18:23:51 user nova-compute[72150]:   </nova:owner>
Aug 01 18:23:51 user nova-compute[72150]:   <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:23:51 user nova-compute[72150]:   <nova:ports>
Aug 01 18:23:51 user nova-compute[72150]:     <nova:port uuid="ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a">
Aug 01 18:23:51 user nova-compute[72150]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 18:23:51 user nova-compute[72150]:     </nova:port>
Aug 01 18:23:51 user nova-compute[72150]:     <nova:port uuid="b3e91864-9951-4277-aa80-80fd19c4f3bd">
Aug 01 18:23:51 user nova-compute[72150]:       <nova:ip type="fixed" address="10.10.10.167" ipVersion="4"/>
Aug 01 18:23:51 user nova-compute[72150]:     </nova:port>
Aug 01 18:23:51 user nova-compute[72150]:   </nova:ports>
Aug 01 18:23:51 user nova-compute[72150]: </nova:instance>
Aug 01 18:23:51 user nova-compute[72150]:  {{(pid=72150) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-86fe80a2-7263-42d0-8994-f94fc2862e5e tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "interface-554b19ce-2ea6-4494-bdd9-a02444ca920e-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.335s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: INFO os_vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:67:77,bridge_name='br-int',has_traffic_filtering=True,id=541680e9-0c34-47e2-b297-b3365281b90a,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap541680e9-0c')
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2014007240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2014007240',id=9,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ECeSPUMc++nSJlRUYvQf+7gQpST58K1TxWzhrTnrq13Jdlj7i5BJx01qhEK9DQjreJB1IajiL6K96JXmqZJ3UXS2MQQ5P0dRpaOGmLVmrEYZTyKLGY8SqcMnKBMPZPw==',key_name='tempest-keypair-57552355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b60b336a42e94d27b1079bbf8732eb7d',ramdisk_id='',reservation_id='r-0402eoyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1666899254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1666899254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f62806f8d5534c86a3a1808daa5edbb4',uuid=39ed0e93-df10-4f34-b13a-66a1825d21b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "address": "fa:16:3e:a8:fc:df", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6546d6-8f", "ovs_interfaceid": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converting VIF {"id": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "address": "fa:16:3e:a8:fc:df", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6546d6-8f", "ovs_interfaceid": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fc:df,bridge_name='br-int',has_traffic_filtering=True,id=1e6546d6-8fa5-4298-851b-3fb6efa9420c,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e6546d6-8f') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG os_vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fc:df,bridge_name='br-int',has_traffic_filtering=True,id=1e6546d6-8fa5-4298-851b-3fb6efa9420c,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e6546d6-8f') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:23:51 user nova-compute[72150]: INFO nova.virt.block_device [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Booting with volume 99176d6f-ea51-4322-b763-9a4f8a154d17 at /dev/vda
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e6546d6-8f, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e6546d6-8f, col_values=(('external_ids', {'iface-id': '1e6546d6-8fa5-4298-851b-3fb6efa9420c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:fc:df', 'vm-uuid': '39ed0e93-df10-4f34-b13a-66a1825d21b9'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.neutron [req-5dd25e85-ca0b-45f4-a0ac-12c1806f3119 req-42cfbd56-5d55-4fe7-9c78-3004c53d22e0 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Updated VIF entry in instance network info cache for port b3e91864-9951-4277-aa80-80fd19c4f3bd. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.neutron [req-5dd25e85-ca0b-45f4-a0ac-12c1806f3119 req-42cfbd56-5d55-4fe7-9c78-3004c53d22e0 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Updating instance_info_cache with network_info: [{"id": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "address": "fa:16:3e:16:e2:2d", "network": {"id": "b006b5b5-51ee-476d-93d1-0f7c510088da", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1317073326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdd368e-4d", "ovs_interfaceid": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "address": "fa:16:3e:e5:61:f3", "network": {"id": "f7037297-1133-40b9-a92f-ae5d7e9c70a3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1106927103", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e91864-99", "ovs_interfaceid": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5dd25e85-ca0b-45f4-a0ac-12c1806f3119 req-42cfbd56-5d55-4fe7-9c78-3004c53d22e0 service nova] Releasing lock "refresh_cache-554b19ce-2ea6-4494-bdd9-a02444ca920e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: INFO os_vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fc:df,bridge_name='br-int',has_traffic_filtering=True,id=1e6546d6-8fa5-4298-851b-3fb6efa9420c,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e6546d6-8f')
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2014007240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2014007240',id=9,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ECeSPUMc++nSJlRUYvQf+7gQpST58K1TxWzhrTnrq13Jdlj7i5BJx01qhEK9DQjreJB1IajiL6K96JXmqZJ3UXS2MQQ5P0dRpaOGmLVmrEYZTyKLGY8SqcMnKBMPZPw==',key_name='tempest-keypair-57552355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b60b336a42e94d27b1079bbf8732eb7d',ramdisk_id='',reservation_id='r-0402eoyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1666899254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1666899254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f62806f8d5534c86a3a1808daa5edbb4',uuid=39ed0e93-df10-4f34-b13a-66a1825d21b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "650c8b02-2525-403f-88d4-450a0903b33c", "address": "fa:16:3e:72:45:67", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650c8b02-25", "ovs_interfaceid": "650c8b02-2525-403f-88d4-450a0903b33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converting VIF {"id": "650c8b02-2525-403f-88d4-450a0903b33c", "address": "fa:16:3e:72:45:67", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650c8b02-25", "ovs_interfaceid": "650c8b02-2525-403f-88d4-450a0903b33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:45:67,bridge_name='br-int',has_traffic_filtering=True,id=650c8b02-2525-403f-88d4-450a0903b33c,network=Network(2738102a-fe12-412d-9dc2-a1ce7a79997a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap650c8b02-25') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG os_vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:45:67,bridge_name='br-int',has_traffic_filtering=True,id=650c8b02-2525-403f-88d4-450a0903b33c,network=Network(2738102a-fe12-412d-9dc2-a1ce7a79997a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap650c8b02-25') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap650c8b02-25, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap650c8b02-25, col_values=(('external_ids', {'iface-id': '650c8b02-2525-403f-88d4-450a0903b33c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:45:67', 'vm-uuid': '39ed0e93-df10-4f34-b13a-66a1825d21b9'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG os_brick.utils [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: INFO os_vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:45:67,bridge_name='br-int',has_traffic_filtering=True,id=650c8b02-2525-403f-88d4-450a0903b33c,network=Network(2738102a-fe12-412d-9dc2-a1ce7a79997a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap650c8b02-25')
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2014007240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2014007240',id=9,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ECeSPUMc++nSJlRUYvQf+7gQpST58K1TxWzhrTnrq13Jdlj7i5BJx01qhEK9DQjreJB1IajiL6K96JXmqZJ3UXS2MQQ5P0dRpaOGmLVmrEYZTyKLGY8SqcMnKBMPZPw==',key_name='tempest-keypair-57552355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b60b336a42e94d27b1079bbf8732eb7d',ramdisk_id='',reservation_id='r-0402eoyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1666899254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1666899254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f62806f8d5534c86a3a1808daa5edbb4',uuid=39ed0e93-df10-4f34-b13a-66a1825d21b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c024ac3e-43d1-4453-8715-9b49c747fb08", "address": "fa:16:3e:c3:8d:39", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc024ac3e-43", "ovs_interfaceid": "c024ac3e-43d1-4453-8715-9b49c747fb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converting VIF {"id": "c024ac3e-43d1-4453-8715-9b49c747fb08", "address": "fa:16:3e:c3:8d:39", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc024ac3e-43", "ovs_interfaceid": "c024ac3e-43d1-4453-8715-9b49c747fb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:8d:39,bridge_name='br-int',has_traffic_filtering=True,id=c024ac3e-43d1-4453-8715-9b49c747fb08,network=Network(2738102a-fe12-412d-9dc2-a1ce7a79997a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc024ac3e-43') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG os_vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:8d:39,bridge_name='br-int',has_traffic_filtering=True,id=c024ac3e-43d1-4453-8715-9b49c747fb08,network=Network(2738102a-fe12-412d-9dc2-a1ce7a79997a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc024ac3e-43') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da250c1-ba44-4801-af56-9cad90f478ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc024ac3e-43, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc024ac3e-43, col_values=(('external_ids', {'iface-id': 'c024ac3e-43d1-4453-8715-9b49c747fb08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:8d:39', 'vm-uuid': '39ed0e93-df10-4f34-b13a-66a1825d21b9'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cad3bc-5d7f-4453-8c74-241dca1c711c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea35cdae-639a-4694-ac5a-37f668c72bcb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71bf7d8-6af0-4cbe-8248-6715780abd58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.policy [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e312b378dd2b43798193756afb51e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cec5474a64d46c2bfc92435c677abf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:23:51 user nova-compute[72150]: INFO os_vif [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:8d:39,bridge_name='br-int',has_traffic_filtering=True,id=c024ac3e-43d1-4453-8715-9b49c747fb08,network=Network(2738102a-fe12-412d-9dc2-a1ce7a79997a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc024ac3e-43')
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:23:51 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9899b3-a379-487c-b7ad-2aade7626c51]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG os_brick.utils [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] <== get_connector_properties: return (206ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Updating existing volume attachment record: d83350ad-5721-4a65-af5f-c720eb9436d8 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-d4043ea6-cdd8-45ca-bb0a-d6bd52eff34e req-38a0e6d7-5c9b-4676-89ca-ceb5a1f3f170 service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Received event network-changed-60b7ef01-f473-4729-8863-446ced3b583a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-d4043ea6-cdd8-45ca-bb0a-d6bd52eff34e req-38a0e6d7-5c9b-4676-89ca-ceb5a1f3f170 service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Refreshing instance network info cache due to event network-changed-60b7ef01-f473-4729-8863-446ced3b583a. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d4043ea6-cdd8-45ca-bb0a-d6bd52eff34e req-38a0e6d7-5c9b-4676-89ca-ceb5a1f3f170 service nova] Acquiring lock "refresh_cache-161fa35c-1f33-4ea7-94a9-c3b78952155e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d4043ea6-cdd8-45ca-bb0a-d6bd52eff34e req-38a0e6d7-5c9b-4676-89ca-ceb5a1f3f170 service nova] Acquired lock "refresh_cache-161fa35c-1f33-4ea7-94a9-c3b78952155e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.network.neutron [req-d4043ea6-cdd8-45ca-bb0a-d6bd52eff34e req-38a0e6d7-5c9b-4676-89ca-ceb5a1f3f170 service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Refreshing network info cache for port 60b7ef01-f473-4729-8863-446ced3b583a {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] No BDM found with device name hda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] No VIF found with MAC fa:16:3e:dc:77:d0, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:23:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] No VIF found with MAC fa:16:3e:a8:fc:df, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:23:51 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Using config drive
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Acquiring lock "554b19ce-2ea6-4494-bdd9-a02444ca920e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG nova.objects.instance [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lazy-loading 'flavor' on Instance uuid 554b19ce-2ea6-4494-bdd9-a02444ca920e {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:23:52 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Creating config drive at /opt/stack/data/nova/instances/39ed0e93-df10-4f34-b13a-66a1825d21b9/disk.config
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/39ed0e93-df10-4f34-b13a-66a1825d21b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnnpk9ilj {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/39ed0e93-df10-4f34-b13a-66a1825d21b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnnpk9ilj" returned: 0 in 0.078s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.177s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Acquiring lock "554b19ce-2ea6-4494-bdd9-a02444ca920e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:52 user nova-compute[72150]: INFO nova.compute.manager [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Attaching volume 89bb3718-add8-4070-a931-b0f5fe01e20a to /dev/vdb
Aug 01 18:23:52 user nova-compute[72150]: DEBUG nova.network.neutron [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Successfully created port: 3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG os_brick.utils [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG nova.network.neutron [req-d4043ea6-cdd8-45ca-bb0a-d6bd52eff34e req-38a0e6d7-5c9b-4676-89ca-ceb5a1f3f170 service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Updated VIF entry in instance network info cache for port 60b7ef01-f473-4729-8863-446ced3b583a. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG nova.network.neutron [req-d4043ea6-cdd8-45ca-bb0a-d6bd52eff34e req-38a0e6d7-5c9b-4676-89ca-ceb5a1f3f170 service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Updating instance_info_cache with network_info: [{"id": "60b7ef01-f473-4729-8863-446ced3b583a", "address": "fa:16:3e:fb:db:7f", "network": {"id": "1d6b993c-de21-483f-9a8a-609bf15eb582", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1811936764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac43f7be3cd43368a5c03411059c933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b7ef01-f4", "ovs_interfaceid": "60b7ef01-f473-4729-8863-446ced3b583a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[56804f2e-d8b8-49b2-ba8a-39a83c7eb3cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d4043ea6-cdd8-45ca-bb0a-d6bd52eff34e req-38a0e6d7-5c9b-4676-89ca-ceb5a1f3f170 service nova] Releasing lock "refresh_cache-161fa35c-1f33-4ea7-94a9-c3b78952155e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[312a5b4d-dcf0-43ea-9339-81fe82fcb0dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77daa1f-877b-4edf-b20f-2c507295f584]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3de4b24-b396-4ef6-bff3-e29b71eb7c37]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:23:52 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:23:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba7cfd0-c29e-4d19-99ff-00e3af61b3d7]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG os_brick.utils [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:23:52 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Updating existing volume attachment record: 049b7a86-7cad-4049-a68c-6519f12a8b91 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:23:53 user nova-compute[72150]: DEBUG nova.compute.manager [req-75c53629-d576-4e17-bdc1-46229368ec43 req-1907ccd1-f7d5-4393-914e-e72d7ec45763 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Received event network-vif-plugged-b3e91864-9951-4277-aa80-80fd19c4f3bd {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-75c53629-d576-4e17-bdc1-46229368ec43 req-1907ccd1-f7d5-4393-914e-e72d7ec45763 service nova] Acquiring lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-75c53629-d576-4e17-bdc1-46229368ec43 req-1907ccd1-f7d5-4393-914e-e72d7ec45763 service nova] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-75c53629-d576-4e17-bdc1-46229368ec43 req-1907ccd1-f7d5-4393-914e-e72d7ec45763 service nova] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:53 user nova-compute[72150]: DEBUG nova.compute.manager [req-75c53629-d576-4e17-bdc1-46229368ec43 req-1907ccd1-f7d5-4393-914e-e72d7ec45763 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] No waiting events found dispatching network-vif-plugged-b3e91864-9951-4277-aa80-80fd19c4f3bd {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:53 user nova-compute[72150]: WARNING nova.compute.manager [req-75c53629-d576-4e17-bdc1-46229368ec43 req-1907ccd1-f7d5-4393-914e-e72d7ec45763 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Received unexpected event network-vif-plugged-b3e91864-9951-4277-aa80-80fd19c4f3bd for instance with vm_state active and task_state None.
Aug 01 18:23:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG nova.network.neutron [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Successfully updated port: 3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "refresh_cache-9a4c69c1-6d13-4428-9460-be5988aa0b16" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquired lock "refresh_cache-9a4c69c1-6d13-4428-9460-be5988aa0b16" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG nova.network.neutron [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG nova.compute.manager [req-dd99ea9b-9270-48f9-a6be-2682504b7a26 req-c18c7181-fd00-4db6-a0ab-0d6aceb8e2e7 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Received event network-changed-3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG nova.compute.manager [req-dd99ea9b-9270-48f9-a6be-2682504b7a26 req-c18c7181-fd00-4db6-a0ab-0d6aceb8e2e7 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Refreshing instance network info cache due to event network-changed-3383d1ec-873d-4660-a685-3d71c2e0092c. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-dd99ea9b-9270-48f9-a6be-2682504b7a26 req-c18c7181-fd00-4db6-a0ab-0d6aceb8e2e7 service nova] Acquiring lock "refresh_cache-9a4c69c1-6d13-4428-9460-be5988aa0b16" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG nova.network.neutron [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG nova.compute.manager [req-1176f5d4-1df0-4a0a-b074-4263a7dddb8a req-e0dbd29d-de15-43df-9d88-ec18c4cf64da service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-plugged-39a977ce-d734-4852-838b-6dfbb51c0bf8 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1176f5d4-1df0-4a0a-b074-4263a7dddb8a req-e0dbd29d-de15-43df-9d88-ec18c4cf64da service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1176f5d4-1df0-4a0a-b074-4263a7dddb8a req-e0dbd29d-de15-43df-9d88-ec18c4cf64da service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1176f5d4-1df0-4a0a-b074-4263a7dddb8a req-e0dbd29d-de15-43df-9d88-ec18c4cf64da service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG nova.compute.manager [req-1176f5d4-1df0-4a0a-b074-4263a7dddb8a req-e0dbd29d-de15-43df-9d88-ec18c4cf64da service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-plugged-39a977ce-d734-4852-838b-6dfbb51c0bf8 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:54 user nova-compute[72150]: WARNING nova.compute.manager [req-1176f5d4-1df0-4a0a-b074-4263a7dddb8a req-e0dbd29d-de15-43df-9d88-ec18c4cf64da service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received unexpected event network-vif-plugged-39a977ce-d734-4852-838b-6dfbb51c0bf8 for instance with vm_state building and task_state spawning.
Aug 01 18:23:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG nova.network.neutron [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Updating instance_info_cache with network_info: [{"id": "3383d1ec-873d-4660-a685-3d71c2e0092c", "address": "fa:16:3e:ab:5f:8a", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3383d1ec-87", "ovs_interfaceid": "3383d1ec-873d-4660-a685-3d71c2e0092c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Releasing lock "refresh_cache-9a4c69c1-6d13-4428-9460-be5988aa0b16" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Instance network_info: |[{"id": "3383d1ec-873d-4660-a685-3d71c2e0092c", "address": "fa:16:3e:ab:5f:8a", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3383d1ec-87", "ovs_interfaceid": "3383d1ec-873d-4660-a685-3d71c2e0092c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-dd99ea9b-9270-48f9-a6be-2682504b7a26 req-c18c7181-fd00-4db6-a0ab-0d6aceb8e2e7 service nova] Acquired lock "refresh_cache-9a4c69c1-6d13-4428-9460-be5988aa0b16" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:54 user nova-compute[72150]: DEBUG nova.network.neutron [req-dd99ea9b-9270-48f9-a6be-2682504b7a26 req-c18c7181-fd00-4db6-a0ab-0d6aceb8e2e7 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Refreshing network info cache for port 3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:55 user nova-compute[72150]: DEBUG nova.compute.manager [req-18beaad7-a84b-48a8-801f-48cac9c414a0 req-1e9429b3-889e-4412-a37c-9ec683f55221 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-plugged-fab43aac-fc06-4876-8c52-6f3e5a492217 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-18beaad7-a84b-48a8-801f-48cac9c414a0 req-1e9429b3-889e-4412-a37c-9ec683f55221 service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-18beaad7-a84b-48a8-801f-48cac9c414a0 req-1e9429b3-889e-4412-a37c-9ec683f55221 service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-18beaad7-a84b-48a8-801f-48cac9c414a0 req-1e9429b3-889e-4412-a37c-9ec683f55221 service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:55 user nova-compute[72150]: DEBUG nova.compute.manager [req-18beaad7-a84b-48a8-801f-48cac9c414a0 req-1e9429b3-889e-4412-a37c-9ec683f55221 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-plugged-fab43aac-fc06-4876-8c52-6f3e5a492217 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:55 user nova-compute[72150]: WARNING nova.compute.manager [req-18beaad7-a84b-48a8-801f-48cac9c414a0 req-1e9429b3-889e-4412-a37c-9ec683f55221 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received unexpected event network-vif-plugged-fab43aac-fc06-4876-8c52-6f3e5a492217 for instance with vm_state building and task_state spawning.
Aug 01 18:23:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:55 user nova-compute[72150]: DEBUG nova.network.neutron [req-dd99ea9b-9270-48f9-a6be-2682504b7a26 req-c18c7181-fd00-4db6-a0ab-0d6aceb8e2e7 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Updated VIF entry in instance network info cache for port 3383d1ec-873d-4660-a685-3d71c2e0092c. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:23:55 user nova-compute[72150]: DEBUG nova.network.neutron [req-dd99ea9b-9270-48f9-a6be-2682504b7a26 req-c18c7181-fd00-4db6-a0ab-0d6aceb8e2e7 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Updating instance_info_cache with network_info: [{"id": "3383d1ec-873d-4660-a685-3d71c2e0092c", "address": "fa:16:3e:ab:5f:8a", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3383d1ec-87", "ovs_interfaceid": "3383d1ec-873d-4660-a685-3d71c2e0092c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:23:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-dd99ea9b-9270-48f9-a6be-2682504b7a26 req-c18c7181-fd00-4db6-a0ab-0d6aceb8e2e7 service nova] Releasing lock "refresh_cache-9a4c69c1-6d13-4428-9460-be5988aa0b16" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:23:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-f6bedcec-50a3-4e1f-9671-ea2871317cf1 req-a4144557-9d8b-467e-a68e-99a4720b9b9d service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-plugged-1e6546d6-8fa5-4298-851b-3fb6efa9420c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f6bedcec-50a3-4e1f-9671-ea2871317cf1 req-a4144557-9d8b-467e-a68e-99a4720b9b9d service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f6bedcec-50a3-4e1f-9671-ea2871317cf1 req-a4144557-9d8b-467e-a68e-99a4720b9b9d service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f6bedcec-50a3-4e1f-9671-ea2871317cf1 req-a4144557-9d8b-467e-a68e-99a4720b9b9d service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-f6bedcec-50a3-4e1f-9671-ea2871317cf1 req-a4144557-9d8b-467e-a68e-99a4720b9b9d service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-plugged-1e6546d6-8fa5-4298-851b-3fb6efa9420c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:56 user nova-compute[72150]: WARNING nova.compute.manager [req-f6bedcec-50a3-4e1f-9671-ea2871317cf1 req-a4144557-9d8b-467e-a68e-99a4720b9b9d service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received unexpected event network-vif-plugged-1e6546d6-8fa5-4298-851b-3fb6efa9420c for instance with vm_state building and task_state spawning.
Aug 01 18:23:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-plugged-39a977ce-d734-4852-838b-6dfbb51c0bf8 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-plugged-39a977ce-d734-4852-838b-6dfbb51c0bf8 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:56 user nova-compute[72150]: WARNING nova.compute.manager [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received unexpected event network-vif-plugged-39a977ce-d734-4852-838b-6dfbb51c0bf8 for instance with vm_state building and task_state spawning.
Aug 01 18:23:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-plugged-77546d5a-e74c-4058-9008-a09a455ba8d0 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-plugged-77546d5a-e74c-4058-9008-a09a455ba8d0 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:56 user nova-compute[72150]: WARNING nova.compute.manager [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received unexpected event network-vif-plugged-77546d5a-e74c-4058-9008-a09a455ba8d0 for instance with vm_state building and task_state spawning.
Aug 01 18:23:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-plugged-77546d5a-e74c-4058-9008-a09a455ba8d0 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-plugged-77546d5a-e74c-4058-9008-a09a455ba8d0 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:56 user nova-compute[72150]: WARNING nova.compute.manager [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received unexpected event network-vif-plugged-77546d5a-e74c-4058-9008-a09a455ba8d0 for instance with vm_state building and task_state spawning.
Aug 01 18:23:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-plugged-541680e9-0c34-47e2-b297-b3365281b90a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-plugged-541680e9-0c34-47e2-b297-b3365281b90a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:56 user nova-compute[72150]: WARNING nova.compute.manager [req-66d5c5db-bda8-4d5b-9160-180aed652190 req-9970a0cc-ee13-4faf-949c-c55b5c65e83a service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received unexpected event network-vif-plugged-541680e9-0c34-47e2-b297-b3365281b90a for instance with vm_state building and task_state spawning.
Aug 01 18:23:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-f946d6dd-e0f5-45e4-8665-7905029520d9 req-7dd0c4ee-abd8-4883-9228-0866293b065c service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-plugged-fab43aac-fc06-4876-8c52-6f3e5a492217 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f946d6dd-e0f5-45e4-8665-7905029520d9 req-7dd0c4ee-abd8-4883-9228-0866293b065c service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f946d6dd-e0f5-45e4-8665-7905029520d9 req-7dd0c4ee-abd8-4883-9228-0866293b065c service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f946d6dd-e0f5-45e4-8665-7905029520d9 req-7dd0c4ee-abd8-4883-9228-0866293b065c service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-f946d6dd-e0f5-45e4-8665-7905029520d9 req-7dd0c4ee-abd8-4883-9228-0866293b065c service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-plugged-fab43aac-fc06-4876-8c52-6f3e5a492217 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:57 user nova-compute[72150]: WARNING nova.compute.manager [req-f946d6dd-e0f5-45e4-8665-7905029520d9 req-7dd0c4ee-abd8-4883-9228-0866293b065c service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received unexpected event network-vif-plugged-fab43aac-fc06-4876-8c52-6f3e5a492217 for instance with vm_state building and task_state spawning.
Aug 01 18:23:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-plugged-1e6546d6-8fa5-4298-851b-3fb6efa9420c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-plugged-1e6546d6-8fa5-4298-851b-3fb6efa9420c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:58 user nova-compute[72150]: WARNING nova.compute.manager [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received unexpected event network-vif-plugged-1e6546d6-8fa5-4298-851b-3fb6efa9420c for instance with vm_state building and task_state spawning.
Aug 01 18:23:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-plugged-650c8b02-2525-403f-88d4-450a0903b33c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-plugged-650c8b02-2525-403f-88d4-450a0903b33c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:58 user nova-compute[72150]: WARNING nova.compute.manager [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received unexpected event network-vif-plugged-650c8b02-2525-403f-88d4-450a0903b33c for instance with vm_state building and task_state spawning.
Aug 01 18:23:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-plugged-650c8b02-2525-403f-88d4-450a0903b33c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-plugged-650c8b02-2525-403f-88d4-450a0903b33c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:58 user nova-compute[72150]: WARNING nova.compute.manager [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received unexpected event network-vif-plugged-650c8b02-2525-403f-88d4-450a0903b33c for instance with vm_state building and task_state spawning.
Aug 01 18:23:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-plugged-c024ac3e-43d1-4453-8715-9b49c747fb08 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-plugged-c024ac3e-43d1-4453-8715-9b49c747fb08 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:58 user nova-compute[72150]: WARNING nova.compute.manager [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received unexpected event network-vif-plugged-c024ac3e-43d1-4453-8715-9b49c747fb08 for instance with vm_state building and task_state spawning.
Aug 01 18:23:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-plugged-c024ac3e-43d1-4453-8715-9b49c747fb08 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-plugged-c024ac3e-43d1-4453-8715-9b49c747fb08 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:58 user nova-compute[72150]: WARNING nova.compute.manager [req-5b7b2562-0818-4cb2-bd93-d62e56f68b89 req-527daa74-fef9-434b-a851-db1611123066 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received unexpected event network-vif-plugged-c024ac3e-43d1-4453-8715-9b49c747fb08 for instance with vm_state building and task_state spawning.
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Acquiring lock "161fa35c-1f33-4ea7-94a9-c3b78952155e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "161fa35c-1f33-4ea7-94a9-c3b78952155e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG nova.objects.instance [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lazy-loading 'flavor' on Instance uuid 161fa35c-1f33-4ea7-94a9-c3b78952155e {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "161fa35c-1f33-4ea7-94a9-c3b78952155e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-202f1c67-88f9-468a-bd07-3beee1180d7c req-a6849aed-4c4e-4938-9808-4bc5172420f8 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-plugged-541680e9-0c34-47e2-b297-b3365281b90a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-202f1c67-88f9-468a-bd07-3beee1180d7c req-a6849aed-4c4e-4938-9808-4bc5172420f8 service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-202f1c67-88f9-468a-bd07-3beee1180d7c req-a6849aed-4c4e-4938-9808-4bc5172420f8 service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-202f1c67-88f9-468a-bd07-3beee1180d7c req-a6849aed-4c4e-4938-9808-4bc5172420f8 service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-202f1c67-88f9-468a-bd07-3beee1180d7c req-a6849aed-4c4e-4938-9808-4bc5172420f8 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-plugged-541680e9-0c34-47e2-b297-b3365281b90a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:23:58 user nova-compute[72150]: WARNING nova.compute.manager [req-202f1c67-88f9-468a-bd07-3beee1180d7c req-a6849aed-4c4e-4938-9808-4bc5172420f8 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received unexpected event network-vif-plugged-541680e9-0c34-47e2-b297-b3365281b90a for instance with vm_state building and task_state spawning.
Aug 01 18:23:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Acquiring lock "161fa35c-1f33-4ea7-94a9-c3b78952155e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "161fa35c-1f33-4ea7-94a9-c3b78952155e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:58 user nova-compute[72150]: INFO nova.compute.manager [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Attaching volume 32fc1c5d-95d3-4bcb-9edf-d822745f233d to /dev/sdc
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Acquiring lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.objects.instance [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lazy-loading 'flavor' on Instance uuid ad033976-bfc8-46b9-89bf-f752ae0cdf01 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914224.073147, c3811375-bcd1-46ac-b552-7ff1588a3667 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:23:59 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] VM Stopped (Lifecycle Event)
Aug 01 18:23:59 user nova-compute[72150]: DEBUG os_brick.utils [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ca25fce5-8e9d-4e7b-95e6-4aa637e3dc76 None None] [instance: c3811375-bcd1-46ac-b552-7ff1588a3667] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df897b3-41e1-4f78-90f2-6e36ad7acddc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cbe29d-d7ed-487a-a12c-5ffac7daca1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7431e2b4-9115-43f6-9edf-810b622b4f9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4ac262-8f2c-4958-838e-71968cddf175]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:23:59 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:23:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd412e1-de62-4af7-ba21-c42909eeee18]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG os_brick.utils [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Updating existing volume attachment record: ef61f88a-99c5-42b3-a763-8dcc48211005 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Acquiring lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:23:59 user nova-compute[72150]: INFO nova.compute.manager [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Attaching volume afc8f281-a010-4b93-82cc-3f0aeb2aa78f to /dev/vdb
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914239.4361017, 39ed0e93-df10-4f34-b13a-66a1825d21b9 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:23:59 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] VM Resumed (Lifecycle Event)
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:23:59 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Instance spawned successfully.
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:23:59 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914239.4381666, 39ed0e93-df10-4f34-b13a-66a1825d21b9 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:23:59 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] VM Started (Lifecycle Event)
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:23:59 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:23:59 user nova-compute[72150]: INFO nova.compute.manager [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Took 13.58 seconds to spawn the instance on the hypervisor.
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:23:59 user nova-compute[72150]: INFO nova.compute.manager [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Took 51.77 seconds to build instance.
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-07c32ddc-257c-4462-9bbe-9a3e574082af req-98c6aa9e-f749-4290-881a-c8ef9a552a98 service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Received event network-changed-8509ce7f-8cec-4926-a30d-5900fbddac8a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-07c32ddc-257c-4462-9bbe-9a3e574082af req-98c6aa9e-f749-4290-881a-c8ef9a552a98 service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Refreshing instance network info cache due to event network-changed-8509ce7f-8cec-4926-a30d-5900fbddac8a. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-07c32ddc-257c-4462-9bbe-9a3e574082af req-98c6aa9e-f749-4290-881a-c8ef9a552a98 service nova] Acquiring lock "refresh_cache-ad033976-bfc8-46b9-89bf-f752ae0cdf01" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-07c32ddc-257c-4462-9bbe-9a3e574082af req-98c6aa9e-f749-4290-881a-c8ef9a552a98 service nova] Acquired lock "refresh_cache-ad033976-bfc8-46b9-89bf-f752ae0cdf01" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG nova.network.neutron [req-07c32ddc-257c-4462-9bbe-9a3e574082af req-98c6aa9e-f749-4290-881a-c8ef9a552a98 service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Refreshing network info cache for port 8509ce7f-8cec-4926-a30d-5900fbddac8a {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:23:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-425b4c30-d8ce-423e-b044-cf786fe599ea tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 51.903s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:00 user nova-compute[72150]: DEBUG nova.network.neutron [req-07c32ddc-257c-4462-9bbe-9a3e574082af req-98c6aa9e-f749-4290-881a-c8ef9a552a98 service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Updated VIF entry in instance network info cache for port 8509ce7f-8cec-4926-a30d-5900fbddac8a. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:24:00 user nova-compute[72150]: DEBUG nova.network.neutron [req-07c32ddc-257c-4462-9bbe-9a3e574082af req-98c6aa9e-f749-4290-881a-c8ef9a552a98 service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Updating instance_info_cache with network_info: [{"id": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "address": "fa:16:3e:86:2e:4d", "network": {"id": "64d2a931-7450-40f4-827a-e54a5db845a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-125648202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b8e37a30724a0186d9b7f126a46b0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8509ce7f-8c", "ovs_interfaceid": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:24:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-07c32ddc-257c-4462-9bbe-9a3e574082af req-98c6aa9e-f749-4290-881a-c8ef9a552a98 service nova] Releasing lock "refresh_cache-ad033976-bfc8-46b9-89bf-f752ae0cdf01" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:24:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:03 user nova-compute[72150]: DEBUG os_brick.utils [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:24:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:03 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e1489f-7d2f-4187-8a23-b540850fe778]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:03 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c35977-28ab-4fe9-ab22-2eae562fb542]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:03 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b188c72e-7070-4749-9aaf-7b611b02a14c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:03 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4457cff3-bbb0-4cbc-9d5e-a714de3ed5ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:24:03 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:24:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:24:03 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:24:03 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6cb83c-b55f-4d36-9cf7-ff17cdd15ec8]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:03 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:24:03 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:24:03 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:24:03 user nova-compute[72150]: DEBUG os_brick.utils [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:24:03 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Updating existing volume attachment record: 689e18d8-a90b-4f81-8dd4-1751bc3f80c0 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:24:04 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Creating image(s)
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Did not create local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Ensure instance console log exists: /opt/stack/data/nova/instances/9a4c69c1-6d13-4428-9460-be5988aa0b16/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Start _get_guest_xml network_info=[{"id": "3383d1ec-873d-4660-a685-3d71c2e0092c", "address": "fa:16:3e:ab:5f:8a", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3383d1ec-87", "ovs_interfaceid": "3383d1ec-873d-4660-a685-3d71c2e0092c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd83350ad-5721-4a65-af5f-c720eb9436d8', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWXaJRkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9a4c69c1-6d13-4428-9460-be5988aa0b16', 'attached_at': '', 'detached_at': '', 'volume_id': '99176d6f-ea51-4322-b763-9a4f8a154d17', 'serial': '99176d6f-ea51-4322-b763-9a4f8a154d17'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:24:04 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:24:04 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWXaJRkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:24:04 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:24:04 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:24:04 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:24:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBaZxhJj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:24:04 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cab954-1de6-4fe9-8eaf-7efc0dc96d38]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:24:04 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[316053f8-940e-4aaf-96e4-5d4e25707fe6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17] added
Aug 01 18:24:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d95f314-71b8-4d6d-bc3b-3167cc7d30d1]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bc91c3-a64c-4dc0-afa2-4292378e171e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oWXaJRkr {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oWXaJRkr" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3be378-f5c2-45cb-9cd5-b5584423a143]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oWXaJRkr'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb6b1a3-0ffe-43bd-b1dc-413e3c46ca7f]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[129c768c-690c-4d63-8adb-1c288cfc9a18]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:04 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:04 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:04 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:04 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:04 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:04 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:04 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:04 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:04 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:04 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[714918d0-be2e-4cf0-b755-4aa7ca885c18]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17, portal: 172.16.0.220,3260]
Aug 01 18:24:04 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17, portal: 172.16.0.220,3260] successful.
Aug 01 18:24:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e2c840-ba1b-47ec-9d2d-717d2d1793bc]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ab5e27-1e2b-4e76-a3ac-72bd7379eb70]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:04 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:04 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:04 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:04 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:04 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:04 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:04 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:04 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:04 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:04 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:04 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:04 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] HCTL ('39', '-', '-', 0) found on session 11 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[48db9cf4-e0ea-465c-acaf-4845c1b4bbdb]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Searching for a device in session 11 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:24:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWXaJRkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '23834306331633534', 'path': '/dev/sdh'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834306331633534', 'path': '/dev/sdh'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.435s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:24:05 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:24:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:24:05 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:24:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdb9e1a-43f6-4d11-9508-5748f1cc01d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:24:05 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:23:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1283435186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1283435186',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+Nn4jIkP7o81KAVSuEafYwZ26XCjfE3kKImFLpIJCuWu6CIp77lxBWVyFrwhzih2blhaPYtQDdQOnjy77eqEv5UzljWf90RHtb08BFC6XddfTDCcic8R7KEtRpk3mn7g==',key_name='tempest-keypair-1383383211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cec5474a64d46c2bfc92435c677abf2',ramdisk_id='',reservation_id='r-wxny26dq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1421721381',owner_user_name='tempest-ServerActionsV293TestJSON-1421721381-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e312b378dd2b43798193756afb51e343',uuid=9a4c69c1-6d13-4428-9460-be5988aa0b16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3383d1ec-873d-4660-a685-3d71c2e0092c", "address": "fa:16:3e:ab:5f:8a", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3383d1ec-87", "ovs_interfaceid": "3383d1ec-873d-4660-a685-3d71c2e0092c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Converting VIF {"id": "3383d1ec-873d-4660-a685-3d71c2e0092c", "address": "fa:16:3e:ab:5f:8a", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3383d1ec-87", "ovs_interfaceid": "3383d1ec-873d-4660-a685-3d71c2e0092c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:5f:8a,bridge_name='br-int',has_traffic_filtering=True,id=3383d1ec-873d-4660-a685-3d71c2e0092c,network=Network(ac6e56c1-0122-4bc2-b6b2-a76d80894c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3383d1ec-87') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG nova.objects.instance [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a4c69c1-6d13-4428-9460-be5988aa0b16 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f524ed0-6331-4efc-82ec-105db06add8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a] added
Aug 01 18:24:05 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:24:05 user nova-compute[72150]:   <uuid>9a4c69c1-6d13-4428-9460-be5988aa0b16</uuid>
Aug 01 18:24:05 user nova-compute[72150]:   <name>instance-0000000b</name>
Aug 01 18:24:05 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:24:05 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:24:05 user nova-compute[72150]:   <metadata>
Aug 01 18:24:05 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:24:05 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:24:05 user nova-compute[72150]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1283435186</nova:name>
Aug 01 18:24:05 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:24:04</nova:creationTime>
Aug 01 18:24:05 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:24:05 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:24:05 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:24:05 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:24:05 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:24:05 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:24:05 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:24:05 user nova-compute[72150]:       <nova:owner>
Aug 01 18:24:05 user nova-compute[72150]:         <nova:user uuid="e312b378dd2b43798193756afb51e343">tempest-ServerActionsV293TestJSON-1421721381-project-member</nova:user>
Aug 01 18:24:05 user nova-compute[72150]:         <nova:project uuid="4cec5474a64d46c2bfc92435c677abf2">tempest-ServerActionsV293TestJSON-1421721381</nova:project>
Aug 01 18:24:05 user nova-compute[72150]:       </nova:owner>
Aug 01 18:24:05 user nova-compute[72150]:       <nova:ports>
Aug 01 18:24:05 user nova-compute[72150]:         <nova:port uuid="3383d1ec-873d-4660-a685-3d71c2e0092c">
Aug 01 18:24:05 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 18:24:05 user nova-compute[72150]:         </nova:port>
Aug 01 18:24:05 user nova-compute[72150]:       </nova:ports>
Aug 01 18:24:05 user nova-compute[72150]:     </nova:instance>
Aug 01 18:24:05 user nova-compute[72150]:   </metadata>
Aug 01 18:24:05 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:24:05 user nova-compute[72150]:     <system>
Aug 01 18:24:05 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:24:05 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:24:05 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:24:05 user nova-compute[72150]:       <entry name="serial">9a4c69c1-6d13-4428-9460-be5988aa0b16</entry>
Aug 01 18:24:05 user nova-compute[72150]:       <entry name="uuid">9a4c69c1-6d13-4428-9460-be5988aa0b16</entry>
Aug 01 18:24:05 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:24:05 user nova-compute[72150]:     </system>
Aug 01 18:24:05 user nova-compute[72150]:   </sysinfo>
Aug 01 18:24:05 user nova-compute[72150]:   <os>
Aug 01 18:24:05 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:24:05 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:24:05 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:24:05 user nova-compute[72150]:   </os>
Aug 01 18:24:05 user nova-compute[72150]:   <features>
Aug 01 18:24:05 user nova-compute[72150]:     <acpi/>
Aug 01 18:24:05 user nova-compute[72150]:     <apic/>
Aug 01 18:24:05 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:24:05 user nova-compute[72150]:   </features>
Aug 01 18:24:05 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:24:05 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:24:05 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:24:05 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:24:05 user nova-compute[72150]:   </clock>
Aug 01 18:24:05 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:24:05 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:24:05 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:24:05 user nova-compute[72150]:   </cpu>
Aug 01 18:24:05 user nova-compute[72150]:   <devices>
Aug 01 18:24:05 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:24:05 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:24:05 user nova-compute[72150]:       <source dev="/dev/sdh"/>
Aug 01 18:24:05 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:24:05 user nova-compute[72150]:       <serial>99176d6f-ea51-4322-b763-9a4f8a154d17</serial>
Aug 01 18:24:05 user nova-compute[72150]:     </disk>
Aug 01 18:24:05 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:24:05 user nova-compute[72150]:       <mac address="fa:16:3e:ab:5f:8a"/>
Aug 01 18:24:05 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:24:05 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:24:05 user nova-compute[72150]:       <target dev="tap3383d1ec-87"/>
Aug 01 18:24:05 user nova-compute[72150]:     </interface>
Aug 01 18:24:05 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:24:05 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/9a4c69c1-6d13-4428-9460-be5988aa0b16/console.log" append="off"/>
Aug 01 18:24:05 user nova-compute[72150]:     </serial>
Aug 01 18:24:05 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:24:05 user nova-compute[72150]:     <video>
Aug 01 18:24:05 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:24:05 user nova-compute[72150]:     </video>
Aug 01 18:24:05 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:24:05 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:24:05 user nova-compute[72150]:     </rng>
Aug 01 18:24:05 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:24:05 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:24:05 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:24:05 user nova-compute[72150]:     </memballoon>
Aug 01 18:24:05 user nova-compute[72150]:   </devices>
Aug 01 18:24:05 user nova-compute[72150]: </domain>
Aug 01 18:24:05 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:23:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1283435186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1283435186',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+Nn4jIkP7o81KAVSuEafYwZ26XCjfE3kKImFLpIJCuWu6CIp77lxBWVyFrwhzih2blhaPYtQDdQOnjy77eqEv5UzljWf90RHtb08BFC6XddfTDCcic8R7KEtRpk3mn7g==',key_name='tempest-keypair-1383383211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cec5474a64d46c2bfc92435c677abf2',ramdisk_id='',reservation_id='r-wxny26dq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1421721381',owner_user_name='tempest-ServerActionsV293TestJSON-1421721381-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:23:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e312b378dd2b43798193756afb51e343',uuid=9a4c69c1-6d13-4428-9460-be5988aa0b16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3383d1ec-873d-4660-a685-3d71c2e0092c", "address": "fa:16:3e:ab:5f:8a", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3383d1ec-87", "ovs_interfaceid": "3383d1ec-873d-4660-a685-3d71c2e0092c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Converting VIF {"id": "3383d1ec-873d-4660-a685-3d71c2e0092c", "address": "fa:16:3e:ab:5f:8a", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3383d1ec-87", "ovs_interfaceid": "3383d1ec-873d-4660-a685-3d71c2e0092c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:5f:8a,bridge_name='br-int',has_traffic_filtering=True,id=3383d1ec-873d-4660-a685-3d71c2e0092c,network=Network(ac6e56c1-0122-4bc2-b6b2-a76d80894c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3383d1ec-87') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG os_vif [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:5f:8a,bridge_name='br-int',has_traffic_filtering=True,id=3383d1ec-873d-4660-a685-3d71c2e0092c,network=Network(ac6e56c1-0122-4bc2-b6b2-a76d80894c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3383d1ec-87') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3383d1ec-87, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3383d1ec-87, col_values=(('external_ids', {'iface-id': '3383d1ec-873d-4660-a685-3d71c2e0092c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:5f:8a', 'vm-uuid': '9a4c69c1-6d13-4428-9460-be5988aa0b16'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc5f090-04d9-4765-95bb-d967afd06c55]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:05 user nova-compute[72150]: INFO os_vif [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:5f:8a,bridge_name='br-int',has_traffic_filtering=True,id=3383d1ec-873d-4660-a685-3d71c2e0092c,network=Network(ac6e56c1-0122-4bc2-b6b2-a76d80894c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3383d1ec-87')
Aug 01 18:24:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ed0a3c-fc3a-4d7f-b40b-098522c0eb23]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yBaZxhJj {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yBaZxhJj" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2d9978-b23f-4920-811d-701b71e643a2]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yBaZxhJj'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b7838a-edd9-4e82-a657-4371d5443967]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] No VIF found with MAC fa:16:3e:ab:5f:8a, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad35b1c-0ef7-448c-b721-ce26daf232b4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:05 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:05 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:05 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:05 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:05 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:05 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:05 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:05 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:05 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:05 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:05 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:05 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:05 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:05 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:24:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a -p 172.16.0.220:3260 --login" returned: 0 in 1.183s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d99ebf2-3f7f-456b-8c10-d045e36d12ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a, portal: 172.16.0.220,3260]
Aug 01 18:24:07 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a, portal: 172.16.0.220,3260] successful.
Aug 01 18:24:07 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d394d56e-7005-43f5-969f-3107a530f005]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd066d9d-4ab1-4a32-827e-8679e450085b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:07 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:07 user nova-compute[72150]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a (non-flash)
Aug 01 18:24:07 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:07 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:07 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:07 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:07 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:07 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:07 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:07 user nova-compute[72150]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a (non-flash)
Aug 01 18:24:07 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:07 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:07 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:07 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:07 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:07 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.525s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ebd23a-ce9c-47b7-b08d-be4219520ae1]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBaZxhJj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG nova.compute.manager [req-ba9dbaa4-663e-4127-9a90-497ebaed49cb req-a132b44f-da67-47cc-8327-6d1efcad17c1 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Received event network-vif-plugged-3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ba9dbaa4-663e-4127-9a90-497ebaed49cb req-a132b44f-da67-47cc-8327-6d1efcad17c1 service nova] Acquiring lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ba9dbaa4-663e-4127-9a90-497ebaed49cb req-a132b44f-da67-47cc-8327-6d1efcad17c1 service nova] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ba9dbaa4-663e-4127-9a90-497ebaed49cb req-a132b44f-da67-47cc-8327-6d1efcad17c1 service nova] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:07 user nova-compute[72150]: DEBUG nova.compute.manager [req-ba9dbaa4-663e-4127-9a90-497ebaed49cb req-a132b44f-da67-47cc-8327-6d1efcad17c1 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] No waiting events found dispatching network-vif-plugged-3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:24:07 user nova-compute[72150]: WARNING nova.compute.manager [req-ba9dbaa4-663e-4127-9a90-497ebaed49cb req-a132b44f-da67-47cc-8327-6d1efcad17c1 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Received unexpected event network-vif-plugged-3383d1ec-873d-4660-a685-3d71c2e0092c for instance with vm_state building and task_state spawning.
Aug 01 18:24:08 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.574s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:24:08 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] <== connect_volume: return (4009ms) {'type': 'block', 'scsi_wwn': '23138323064373564', 'path': '/dev/sdi'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:24:08 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138323064373564', 'path': '/dev/sdi'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:24:08 user nova-compute[72150]: DEBUG nova.objects.instance [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lazy-loading 'flavor' on Instance uuid 554b19ce-2ea6-4494-bdd9-a02444ca920e {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:24:08 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:24:08 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:24:08 user nova-compute[72150]:   <source dev="/dev/sdi"/>
Aug 01 18:24:08 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:24:08 user nova-compute[72150]:   <serial>89bb3718-add8-4070-a931-b0f5fe01e20a</serial>
Aug 01 18:24:08 user nova-compute[72150]: </disk>
Aug 01 18:24:08 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:24:08 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:24:08 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] No BDM found with device name hda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:24:08 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] No VIF found with MAC fa:16:3e:16:e2:2d, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:24:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8a72f336-7ec4-4185-9b30-0fdd6138a871 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.203s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:09 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914249.7913477, 9a4c69c1-6d13-4428-9460-be5988aa0b16 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:24:09 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] VM Resumed (Lifecycle Event)
Aug 01 18:24:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:24:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:24:09 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Instance spawned successfully.
Aug 01 18:24:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:24:09 user nova-compute[72150]: DEBUG nova.compute.manager [req-4d026725-9a42-4722-9340-78cee1c605ba req-51f81a9e-bf24-42ff-98ae-b517bc247e9f service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Received event network-vif-plugged-3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4d026725-9a42-4722-9340-78cee1c605ba req-51f81a9e-bf24-42ff-98ae-b517bc247e9f service nova] Acquiring lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4d026725-9a42-4722-9340-78cee1c605ba req-51f81a9e-bf24-42ff-98ae-b517bc247e9f service nova] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4d026725-9a42-4722-9340-78cee1c605ba req-51f81a9e-bf24-42ff-98ae-b517bc247e9f service nova] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:09 user nova-compute[72150]: DEBUG nova.compute.manager [req-4d026725-9a42-4722-9340-78cee1c605ba req-51f81a9e-bf24-42ff-98ae-b517bc247e9f service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] No waiting events found dispatching network-vif-plugged-3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:24:09 user nova-compute[72150]: WARNING nova.compute.manager [req-4d026725-9a42-4722-9340-78cee1c605ba req-51f81a9e-bf24-42ff-98ae-b517bc247e9f service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Received unexpected event network-vif-plugged-3383d1ec-873d-4660-a685-3d71c2e0092c for instance with vm_state building and task_state spawning.
Aug 01 18:24:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:24:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:24:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:24:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:24:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:24:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:24:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:24:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:24:09 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:24:09 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914249.7955747, 9a4c69c1-6d13-4428-9460-be5988aa0b16 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:24:09 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] VM Started (Lifecycle Event)
Aug 01 18:24:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:24:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:24:10 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:24:10 user nova-compute[72150]: INFO nova.compute.manager [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Took 6.33 seconds to spawn the instance on the hypervisor.
Aug 01 18:24:10 user nova-compute[72150]: DEBUG nova.compute.manager [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Acquiring lock "554b19ce-2ea6-4494-bdd9-a02444ca920e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:10 user nova-compute[72150]: INFO nova.compute.manager [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Detaching volume 89bb3718-add8-4070-a931-b0f5fe01e20a
Aug 01 18:24:10 user nova-compute[72150]: INFO nova.compute.manager [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Took 20.02 seconds to build instance.
Aug 01 18:24:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WujeqSPa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:24:10 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:24:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:24:10 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:24:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:24:10 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-64edfd81-8f2b-42f6-b205-7ff04b40f231 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.198s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e938778e-3560-49dc-a166-bba76b4670b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:24:10 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7d3922-1110-4d0b-9549-62d33aa18761]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d] added
Aug 01 18:24:10 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c1d925-ba13-4508-ad57-afa5b976b4a7]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d1c91b-629a-4204-abf6-41f94324e57d]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:10 user nova-compute[72150]: INFO nova.virt.block_device [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Attempting to driver detach volume 89bb3718-add8-4070-a931-b0f5fe01e20a from mountpoint /dev/vdb
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WujeqSPa {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Attempting to detach device vdb from instance 554b19ce-2ea6-4494-bdd9-a02444ca920e from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:24:10 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:24:10 user nova-compute[72150]:   <source dev="/dev/sdi"/>
Aug 01 18:24:10 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:24:10 user nova-compute[72150]:   <serial>89bb3718-add8-4070-a931-b0f5fe01e20a</serial>
Aug 01 18:24:10 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 18:24:10 user nova-compute[72150]: </disk>
Aug 01 18:24:10 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WujeqSPa" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97b4203-4337-4c59-b5db-9da97a31fd67]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WujeqSPa'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:10 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Successfully detached device vdb from instance 554b19ce-2ea6-4494-bdd9-a02444ca920e from the persistent domain config.
Aug 01 18:24:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 554b19ce-2ea6-4494-bdd9-a02444ca920e from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:24:10 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:24:10 user nova-compute[72150]:   <source dev="/dev/sdi"/>
Aug 01 18:24:10 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:24:10 user nova-compute[72150]:   <serial>89bb3718-add8-4070-a931-b0f5fe01e20a</serial>
Aug 01 18:24:10 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 18:24:10 user nova-compute[72150]: </disk>
Aug 01 18:24:10 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2723ecf-23b9-4de0-94ca-c593ee087517]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d70b7b-481c-49fc-b544-2f932909598a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa46d7d-f303-4d5e-9193-cbd4cbe38fd6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d, portal: 172.16.0.220,3260]
Aug 01 18:24:10 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d, portal: 172.16.0.220,3260] successful.
Aug 01 18:24:10 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d90bd2-1dfb-4d38-af43-91cf1a368ab4]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75a673e-07f4-49b5-992d-e716cb616281]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:10 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] HCTL ('41', '-', '-', 0) found on session 13 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:24:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.060s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ee1481-3b09-44b1-9485-ebae10cfb3c7]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:11 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:24:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WujeqSPa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:24:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690914251.3214421, 554b19ce-2ea6-4494-bdd9-a02444ca920e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:24:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 554b19ce-2ea6-4494-bdd9-a02444ca920e {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:24:11 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Successfully detached device vdb from instance 554b19ce-2ea6-4494-bdd9-a02444ca920e from the live domain config.
Aug 01 18:24:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:24:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBaZxhJj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:24:11 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:24:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.485s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] <== connect_volume: return (1486ms) {'type': 'block', 'scsi_wwn': '23866643530653761', 'path': '/dev/sdj'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866643530653761', 'path': '/dev/sdj'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.688s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG nova.objects.instance [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lazy-loading 'flavor' on Instance uuid 161fa35c-1f33-4ea7-94a9-c3b78952155e {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:24:12 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:24:12 user nova-compute[72150]:   <source dev="/dev/sdj"/>
Aug 01 18:24:12 user nova-compute[72150]:   <target dev="sdc" bus="scsi"/>
Aug 01 18:24:12 user nova-compute[72150]:   <serial>32fc1c5d-95d3-4bcb-9edf-d822745f233d</serial>
Aug 01 18:24:12 user nova-compute[72150]:   <address type="drive" controller="0" unit="2"/>
Aug 01 18:24:12 user nova-compute[72150]: </disk>
Aug 01 18:24:12 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.082s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6327f30b-8793-46a8-8922-675637cb35bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.073s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b64dc82-fec8-4790-89dd-48734c943d46]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:12 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:12 user nova-compute[72150]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a (non-flash)
Aug 01 18:24:12 user nova-compute[72150]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d (non-flash)
Aug 01 18:24:12 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:12 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:12 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:12 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:12 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:12 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:12 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:12 user nova-compute[72150]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a (non-flash)
Aug 01 18:24:12 user nova-compute[72150]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d (non-flash)
Aug 01 18:24:12 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:12 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:12 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:12 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:12 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:12 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c383130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a'): ({'sdi'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Removing single pathed devices sdi {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e675bf-4c41-4951-b3bc-cf2ba0d20713]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d76db9-af02-43a4-83d4-687af4cfb524]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Flushing IO for device /dev/sdi {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8dedf84-6b4a-4ef2-9abc-6512047d5f41]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.054s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee241614-39c1-4591-afd9-b483b7c6580a]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] SCSI volumes sdi have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75a659b-8dd0-4188-921e-b50f5808f271]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee511a8-3f2a-4468-98e6-db865e0326c2]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a, portal: 172.16.0.220,3260]
Aug 01 18:24:12 user nova-compute[72150]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a, portal: 172.16.0.220,3260] successful.
Aug 01 18:24:12 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89bb3718-add8-4070-a931-b0f5fe01e20a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce74a944-01ab-4c00-8152-8b2221489f34]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.489s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] <== disconnect_volume: return (1178ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] No BDM found with device name sda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] No VIF found with MAC fa:16:3e:fb:db:7f, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:24:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-15f0162d-99df-41d4-8646-c98916088d4a tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "161fa35c-1f33-4ea7-94a9-c3b78952155e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.030s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:13 user nova-compute[72150]: DEBUG nova.objects.instance [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lazy-loading 'flavor' on Instance uuid 554b19ce-2ea6-4494-bdd9-a02444ca920e {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:24:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-78bf2773-9d2e-422a-89c1-404a33fd7041 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.217s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Acquiring lock "interface-554b19ce-2ea6-4494-bdd9-a02444ca920e-b3e91864-9951-4277-aa80-80fd19c4f3bd" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "interface-554b19ce-2ea6-4494-bdd9-a02444ca920e-b3e91864-9951-4277-aa80-80fd19c4f3bd" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.objects.instance [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lazy-loading 'flavor' on Instance uuid 554b19ce-2ea6-4494-bdd9-a02444ca920e {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:21:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-394626827',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-394626827',id=4,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGka8LdSLmSpjhTZLxRAxtcPMCKQajuZ77ZSdnGv3Wn3uuB5MQyyWWolkbZ67FX8/Xq0MR4R0cch8xeVC596/BP8zPK2w+Y90ycK77u4iqCmTXKKtZgqFB/uHq/hsiFKmg==',key_name='tempest-keypair-1974078877',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='914ef466b8524705868c2049eef686d6',ramdisk_id='',reservation_id='r-tmr2ov96',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1401298341',owner_user_name='tempest-TaggedAttachmentsTest-1401298341-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82554fe6d3e8493dad052be11ea1f30b',uuid=554b19ce-2ea6-4494-bdd9-a02444ca920e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "address": "fa:16:3e:e5:61:f3", "network": {"id": "f7037297-1133-40b9-a92f-ae5d7e9c70a3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1106927103", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e91864-99", "ovs_interfaceid": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Converting VIF {"id": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "address": "fa:16:3e:e5:61:f3", "network": {"id": "f7037297-1133-40b9-a92f-ae5d7e9c70a3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1106927103", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e91864-99", "ovs_interfaceid": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:61:f3,bridge_name='br-int',has_traffic_filtering=True,id=b3e91864-9951-4277-aa80-80fd19c4f3bd,network=Network(f7037297-1133-40b9-a92f-ae5d7e9c70a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e91864-99') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e5:61:f3"/><model type="virtio"/><mtu size="1442"/><target dev="tapb3e91864-99"/></interface> {{(pid=72150) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e5:61:f3"/><model type="virtio"/><mtu size="1442"/><target dev="tapb3e91864-99"/></interface> {{(pid=72150) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Attempting to detach device tapb3e91864-99 from instance 554b19ce-2ea6-4494-bdd9-a02444ca920e from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] detach device xml: <interface type="ethernet">
Aug 01 18:24:14 user nova-compute[72150]:   <mac address="fa:16:3e:e5:61:f3"/>
Aug 01 18:24:14 user nova-compute[72150]:   <model type="virtio"/>
Aug 01 18:24:14 user nova-compute[72150]:   <mtu size="1442"/>
Aug 01 18:24:14 user nova-compute[72150]:   <target dev="tapb3e91864-99"/>
Aug 01 18:24:14 user nova-compute[72150]: </interface>
Aug 01 18:24:14 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e5:61:f3"/><model type="virtio"/><mtu size="1442"/><target dev="tapb3e91864-99"/></interface> {{(pid=72150) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e5:61:f3"/><model type="virtio"/><mtu size="1442"/><target dev="tapb3e91864-99"/></interface>not found in domain: <domain type='kvm' id='4'>
Aug 01 18:24:14 user nova-compute[72150]:   <name>instance-00000004</name>
Aug 01 18:24:14 user nova-compute[72150]:   <uuid>554b19ce-2ea6-4494-bdd9-a02444ca920e</uuid>
Aug 01 18:24:14 user nova-compute[72150]:   <metadata>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:24:14 user nova-compute[72150]:   <nova:package version="0.0.0"/>
Aug 01 18:24:14 user nova-compute[72150]:   <nova:name>tempest-device-tagging-server-394626827</nova:name>
Aug 01 18:24:14 user nova-compute[72150]:   <nova:creationTime>2023-08-01 18:23:51</nova:creationTime>
Aug 01 18:24:14 user nova-compute[72150]:   <nova:flavor name="m1.tiny">
Aug 01 18:24:14 user nova-compute[72150]:     <nova:memory>512</nova:memory>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:disk>1</nova:disk>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:swap>0</nova:swap>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:vcpus>1</nova:vcpus>
Aug 01 18:24:14 user nova-compute[72150]:   </nova:flavor>
Aug 01 18:24:14 user nova-compute[72150]:   <nova:owner>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:user uuid="82554fe6d3e8493dad052be11ea1f30b">tempest-TaggedAttachmentsTest-1401298341-project-member</nova:user>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:project uuid="914ef466b8524705868c2049eef686d6">tempest-TaggedAttachmentsTest-1401298341</nova:project>
Aug 01 18:24:14 user nova-compute[72150]:   </nova:owner>
Aug 01 18:24:14 user nova-compute[72150]:   <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:24:14 user nova-compute[72150]:   <nova:ports>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:port uuid="ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a">
Aug 01 18:24:14 user nova-compute[72150]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 18:24:14 user nova-compute[72150]:     </nova:port>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:port uuid="b3e91864-9951-4277-aa80-80fd19c4f3bd">
Aug 01 18:24:14 user nova-compute[72150]:       <nova:ip type="fixed" address="10.10.10.167" ipVersion="4"/>
Aug 01 18:24:14 user nova-compute[72150]:     </nova:port>
Aug 01 18:24:14 user nova-compute[72150]:   </nova:ports>
Aug 01 18:24:14 user nova-compute[72150]: </nova:instance>
Aug 01 18:24:14 user nova-compute[72150]:   </metadata>
Aug 01 18:24:14 user nova-compute[72150]:   <memory unit='KiB'>524288</memory>
Aug 01 18:24:14 user nova-compute[72150]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 18:24:14 user nova-compute[72150]:   <vcpu placement='static'>1</vcpu>
Aug 01 18:24:14 user nova-compute[72150]:   <resource>
Aug 01 18:24:14 user nova-compute[72150]:     <partition>/machine</partition>
Aug 01 18:24:14 user nova-compute[72150]:   </resource>
Aug 01 18:24:14 user nova-compute[72150]:   <sysinfo type='smbios'>
Aug 01 18:24:14 user nova-compute[72150]:     <system>
Aug 01 18:24:14 user nova-compute[72150]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 18:24:14 user nova-compute[72150]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 18:24:14 user nova-compute[72150]:       <entry name='version'>0.0.0</entry>
Aug 01 18:24:14 user nova-compute[72150]:       <entry name='serial'>554b19ce-2ea6-4494-bdd9-a02444ca920e</entry>
Aug 01 18:24:14 user nova-compute[72150]:       <entry name='uuid'>554b19ce-2ea6-4494-bdd9-a02444ca920e</entry>
Aug 01 18:24:14 user nova-compute[72150]:       <entry name='family'>Virtual Machine</entry>
Aug 01 18:24:14 user nova-compute[72150]:     </system>
Aug 01 18:24:14 user nova-compute[72150]:   </sysinfo>
Aug 01 18:24:14 user nova-compute[72150]:   <os>
Aug 01 18:24:14 user nova-compute[72150]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 18:24:14 user nova-compute[72150]:     <boot dev='hd'/>
Aug 01 18:24:14 user nova-compute[72150]:     <smbios mode='sysinfo'/>
Aug 01 18:24:14 user nova-compute[72150]:   </os>
Aug 01 18:24:14 user nova-compute[72150]:   <features>
Aug 01 18:24:14 user nova-compute[72150]:     <acpi/>
Aug 01 18:24:14 user nova-compute[72150]:     <apic/>
Aug 01 18:24:14 user nova-compute[72150]:     <vmcoreinfo state='on'/>
Aug 01 18:24:14 user nova-compute[72150]:   </features>
Aug 01 18:24:14 user nova-compute[72150]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 18:24:14 user nova-compute[72150]:     <model fallback='forbid'>Nehalem</model>
Aug 01 18:24:14 user nova-compute[72150]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 18:24:14 user nova-compute[72150]:     <feature policy='require' name='vme'/>
Aug 01 18:24:14 user nova-compute[72150]:     <feature policy='require' name='x2apic'/>
Aug 01 18:24:14 user nova-compute[72150]:     <feature policy='require' name='hypervisor'/>
Aug 01 18:24:14 user nova-compute[72150]:   </cpu>
Aug 01 18:24:14 user nova-compute[72150]:   <clock offset='utc'>
Aug 01 18:24:14 user nova-compute[72150]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 18:24:14 user nova-compute[72150]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 18:24:14 user nova-compute[72150]:     <timer name='hpet' present='no'/>
Aug 01 18:24:14 user nova-compute[72150]:   </clock>
Aug 01 18:24:14 user nova-compute[72150]:   <on_poweroff>destroy</on_poweroff>
Aug 01 18:24:14 user nova-compute[72150]:   <on_reboot>restart</on_reboot>
Aug 01 18:24:14 user nova-compute[72150]:   <on_crash>destroy</on_crash>
Aug 01 18:24:14 user nova-compute[72150]:   <devices>
Aug 01 18:24:14 user nova-compute[72150]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 18:24:14 user nova-compute[72150]:     <disk type='file' device='disk'>
Aug 01 18:24:14 user nova-compute[72150]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 18:24:14 user nova-compute[72150]:       <source file='/opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk' index='2'/>
Aug 01 18:24:14 user nova-compute[72150]:       <backingStore type='file' index='3'>
Aug 01 18:24:14 user nova-compute[72150]:         <format type='raw'/>
Aug 01 18:24:14 user nova-compute[72150]:         <source file='/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c'/>
Aug 01 18:24:14 user nova-compute[72150]:         <backingStore/>
Aug 01 18:24:14 user nova-compute[72150]:       </backingStore>
Aug 01 18:24:14 user nova-compute[72150]:       <target dev='vda' bus='virtio'/>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='virtio-disk0'/>
Aug 01 18:24:14 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </disk>
Aug 01 18:24:14 user nova-compute[72150]:     <disk type='file' device='cdrom'>
Aug 01 18:24:14 user nova-compute[72150]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 18:24:14 user nova-compute[72150]:       <source file='/opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk.config' index='1'/>
Aug 01 18:24:14 user nova-compute[72150]:       <backingStore/>
Aug 01 18:24:14 user nova-compute[72150]:       <target dev='hda' bus='ide'/>
Aug 01 18:24:14 user nova-compute[72150]:       <readonly/>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='ide0-0-0'/>
Aug 01 18:24:14 user nova-compute[72150]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </disk>
Aug 01 18:24:14 user nova-compute[72150]:     <controller type='usb' index='0' model='none'>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='usb'/>
Aug 01 18:24:14 user nova-compute[72150]:     </controller>
Aug 01 18:24:14 user nova-compute[72150]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='pci.0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </controller>
Aug 01 18:24:14 user nova-compute[72150]:     <controller type='ide' index='0'>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='ide'/>
Aug 01 18:24:14 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 18:24:14 user nova-compute[72150]:     </controller>
Aug 01 18:24:14 user nova-compute[72150]:     <interface type='ethernet'>
Aug 01 18:24:14 user nova-compute[72150]:       <mac address='fa:16:3e:16:e2:2d'/>
Aug 01 18:24:14 user nova-compute[72150]:       <target dev='tapecdd368e-4d'/>
Aug 01 18:24:14 user nova-compute[72150]:       <model type='virtio'/>
Aug 01 18:24:14 user nova-compute[72150]:       <mtu size='1442'/>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='net0'/>
Aug 01 18:24:14 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </interface>
Aug 01 18:24:14 user nova-compute[72150]:     <interface type='ethernet'>
Aug 01 18:24:14 user nova-compute[72150]:       <mac address='fa:16:3e:e5:61:f3'/>
Aug 01 18:24:14 user nova-compute[72150]:       <target dev='tapb3e91864-99'/>
Aug 01 18:24:14 user nova-compute[72150]:       <model type='virtio'/>
Aug 01 18:24:14 user nova-compute[72150]:       <mtu size='1442'/>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='net1'/>
Aug 01 18:24:14 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </interface>
Aug 01 18:24:14 user nova-compute[72150]:     <serial type='pty'>
Aug 01 18:24:14 user nova-compute[72150]:       <source path='/dev/pts/3'/>
Aug 01 18:24:14 user nova-compute[72150]:       <log file='/opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/console.log' append='off'/>
Aug 01 18:24:14 user nova-compute[72150]:       <target type='isa-serial' port='0'>
Aug 01 18:24:14 user nova-compute[72150]:         <model name='isa-serial'/>
Aug 01 18:24:14 user nova-compute[72150]:       </target>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='serial0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </serial>
Aug 01 18:24:14 user nova-compute[72150]:     <console type='pty' tty='/dev/pts/3'>
Aug 01 18:24:14 user nova-compute[72150]:       <source path='/dev/pts/3'/>
Aug 01 18:24:14 user nova-compute[72150]:       <log file='/opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/console.log' append='off'/>
Aug 01 18:24:14 user nova-compute[72150]:       <target type='serial' port='0'/>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='serial0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </console>
Aug 01 18:24:14 user nova-compute[72150]:     <input type='mouse' bus='ps2'>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='input0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </input>
Aug 01 18:24:14 user nova-compute[72150]:     <input type='keyboard' bus='ps2'>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='input1'/>
Aug 01 18:24:14 user nova-compute[72150]:     </input>
Aug 01 18:24:14 user nova-compute[72150]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Aug 01 18:24:14 user nova-compute[72150]:       <listen type='address' address='0.0.0.0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </graphics>
Aug 01 18:24:14 user nova-compute[72150]:     <audio id='1' type='none'/>
Aug 01 18:24:14 user nova-compute[72150]:     <video>
Aug 01 18:24:14 user nova-compute[72150]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='video0'/>
Aug 01 18:24:14 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </video>
Aug 01 18:24:14 user nova-compute[72150]:     <memballoon model='virtio'>
Aug 01 18:24:14 user nova-compute[72150]:       <stats period='10'/>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='balloon0'/>
Aug 01 18:24:14 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </memballoon>
Aug 01 18:24:14 user nova-compute[72150]:     <rng model='virtio'>
Aug 01 18:24:14 user nova-compute[72150]:       <backend model='random'>/dev/urandom</backend>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='rng0'/>
Aug 01 18:24:14 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </rng>
Aug 01 18:24:14 user nova-compute[72150]:   </devices>
Aug 01 18:24:14 user nova-compute[72150]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 18:24:14 user nova-compute[72150]:     <label>libvirt-554b19ce-2ea6-4494-bdd9-a02444ca920e</label>
Aug 01 18:24:14 user nova-compute[72150]:     <imagelabel>libvirt-554b19ce-2ea6-4494-bdd9-a02444ca920e</imagelabel>
Aug 01 18:24:14 user nova-compute[72150]:   </seclabel>
Aug 01 18:24:14 user nova-compute[72150]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 18:24:14 user nova-compute[72150]:     <label>+64055:+108</label>
Aug 01 18:24:14 user nova-compute[72150]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 18:24:14 user nova-compute[72150]:   </seclabel>
Aug 01 18:24:14 user nova-compute[72150]: </domain>
Aug 01 18:24:14 user nova-compute[72150]:  {{(pid=72150) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 18:24:14 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Successfully detached device tapb3e91864-99 from instance 554b19ce-2ea6-4494-bdd9-a02444ca920e from the persistent domain config.
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] (1/8): Attempting to detach device tapb3e91864-99 with device alias net1 from instance 554b19ce-2ea6-4494-bdd9-a02444ca920e from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] detach device xml: <interface type="ethernet">
Aug 01 18:24:14 user nova-compute[72150]:   <mac address="fa:16:3e:e5:61:f3"/>
Aug 01 18:24:14 user nova-compute[72150]:   <model type="virtio"/>
Aug 01 18:24:14 user nova-compute[72150]:   <mtu size="1442"/>
Aug 01 18:24:14 user nova-compute[72150]:   <target dev="tapb3e91864-99"/>
Aug 01 18:24:14 user nova-compute[72150]: </interface>
Aug 01 18:24:14 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Acquiring lock "161fa35c-1f33-4ea7-94a9-c3b78952155e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "161fa35c-1f33-4ea7-94a9-c3b78952155e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:14 user nova-compute[72150]: INFO nova.compute.manager [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Detaching volume 32fc1c5d-95d3-4bcb-9edf-d822745f233d
Aug 01 18:24:14 user nova-compute[72150]: INFO nova.virt.block_device [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Attempting to driver detach volume 32fc1c5d-95d3-4bcb-9edf-d822745f233d from mountpoint /dev/sdc
Aug 01 18:24:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Attempting to detach device sdc from instance 161fa35c-1f33-4ea7-94a9-c3b78952155e from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:24:14 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:24:14 user nova-compute[72150]:   <source dev="/dev/sdj"/>
Aug 01 18:24:14 user nova-compute[72150]:   <target dev="sdc" bus="scsi"/>
Aug 01 18:24:14 user nova-compute[72150]:   <serial>32fc1c5d-95d3-4bcb-9edf-d822745f233d</serial>
Aug 01 18:24:14 user nova-compute[72150]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 01 18:24:14 user nova-compute[72150]: </disk>
Aug 01 18:24:14 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690914254.4827163, 554b19ce-2ea6-4494-bdd9-a02444ca920e => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Start waiting for the detach event from libvirt for device tapb3e91864-99 with device alias net1 for instance 554b19ce-2ea6-4494-bdd9-a02444ca920e {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e5:61:f3"/><model type="virtio"/><mtu size="1442"/><target dev="tapb3e91864-99"/></interface> {{(pid=72150) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 18:24:14 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Successfully detached device sdc from instance 161fa35c-1f33-4ea7-94a9-c3b78952155e from the persistent domain config.
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 161fa35c-1f33-4ea7-94a9-c3b78952155e from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:24:14 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:24:14 user nova-compute[72150]:   <source dev="/dev/sdj"/>
Aug 01 18:24:14 user nova-compute[72150]:   <target dev="sdc" bus="scsi"/>
Aug 01 18:24:14 user nova-compute[72150]:   <serial>32fc1c5d-95d3-4bcb-9edf-d822745f233d</serial>
Aug 01 18:24:14 user nova-compute[72150]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 01 18:24:14 user nova-compute[72150]: </disk>
Aug 01 18:24:14 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e5:61:f3"/><model type="virtio"/><mtu size="1442"/><target dev="tapb3e91864-99"/></interface>not found in domain: <domain type='kvm' id='4'>
Aug 01 18:24:14 user nova-compute[72150]:   <name>instance-00000004</name>
Aug 01 18:24:14 user nova-compute[72150]:   <uuid>554b19ce-2ea6-4494-bdd9-a02444ca920e</uuid>
Aug 01 18:24:14 user nova-compute[72150]:   <metadata>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:24:14 user nova-compute[72150]:   <nova:package version="0.0.0"/>
Aug 01 18:24:14 user nova-compute[72150]:   <nova:name>tempest-device-tagging-server-394626827</nova:name>
Aug 01 18:24:14 user nova-compute[72150]:   <nova:creationTime>2023-08-01 18:23:51</nova:creationTime>
Aug 01 18:24:14 user nova-compute[72150]:   <nova:flavor name="m1.tiny">
Aug 01 18:24:14 user nova-compute[72150]:     <nova:memory>512</nova:memory>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:disk>1</nova:disk>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:swap>0</nova:swap>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:vcpus>1</nova:vcpus>
Aug 01 18:24:14 user nova-compute[72150]:   </nova:flavor>
Aug 01 18:24:14 user nova-compute[72150]:   <nova:owner>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:user uuid="82554fe6d3e8493dad052be11ea1f30b">tempest-TaggedAttachmentsTest-1401298341-project-member</nova:user>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:project uuid="914ef466b8524705868c2049eef686d6">tempest-TaggedAttachmentsTest-1401298341</nova:project>
Aug 01 18:24:14 user nova-compute[72150]:   </nova:owner>
Aug 01 18:24:14 user nova-compute[72150]:   <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:24:14 user nova-compute[72150]:   <nova:ports>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:port uuid="ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a">
Aug 01 18:24:14 user nova-compute[72150]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 18:24:14 user nova-compute[72150]:     </nova:port>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:port uuid="b3e91864-9951-4277-aa80-80fd19c4f3bd">
Aug 01 18:24:14 user nova-compute[72150]:       <nova:ip type="fixed" address="10.10.10.167" ipVersion="4"/>
Aug 01 18:24:14 user nova-compute[72150]:     </nova:port>
Aug 01 18:24:14 user nova-compute[72150]:   </nova:ports>
Aug 01 18:24:14 user nova-compute[72150]: </nova:instance>
Aug 01 18:24:14 user nova-compute[72150]:   </metadata>
Aug 01 18:24:14 user nova-compute[72150]:   <memory unit='KiB'>524288</memory>
Aug 01 18:24:14 user nova-compute[72150]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 18:24:14 user nova-compute[72150]:   <vcpu placement='static'>1</vcpu>
Aug 01 18:24:14 user nova-compute[72150]:   <resource>
Aug 01 18:24:14 user nova-compute[72150]:     <partition>/machine</partition>
Aug 01 18:24:14 user nova-compute[72150]:   </resource>
Aug 01 18:24:14 user nova-compute[72150]:   <sysinfo type='smbios'>
Aug 01 18:24:14 user nova-compute[72150]:     <system>
Aug 01 18:24:14 user nova-compute[72150]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 18:24:14 user nova-compute[72150]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 18:24:14 user nova-compute[72150]:       <entry name='version'>0.0.0</entry>
Aug 01 18:24:14 user nova-compute[72150]:       <entry name='serial'>554b19ce-2ea6-4494-bdd9-a02444ca920e</entry>
Aug 01 18:24:14 user nova-compute[72150]:       <entry name='uuid'>554b19ce-2ea6-4494-bdd9-a02444ca920e</entry>
Aug 01 18:24:14 user nova-compute[72150]:       <entry name='family'>Virtual Machine</entry>
Aug 01 18:24:14 user nova-compute[72150]:     </system>
Aug 01 18:24:14 user nova-compute[72150]:   </sysinfo>
Aug 01 18:24:14 user nova-compute[72150]:   <os>
Aug 01 18:24:14 user nova-compute[72150]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 18:24:14 user nova-compute[72150]:     <boot dev='hd'/>
Aug 01 18:24:14 user nova-compute[72150]:     <smbios mode='sysinfo'/>
Aug 01 18:24:14 user nova-compute[72150]:   </os>
Aug 01 18:24:14 user nova-compute[72150]:   <features>
Aug 01 18:24:14 user nova-compute[72150]:     <acpi/>
Aug 01 18:24:14 user nova-compute[72150]:     <apic/>
Aug 01 18:24:14 user nova-compute[72150]:     <vmcoreinfo state='on'/>
Aug 01 18:24:14 user nova-compute[72150]:   </features>
Aug 01 18:24:14 user nova-compute[72150]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 18:24:14 user nova-compute[72150]:     <model fallback='forbid'>Nehalem</model>
Aug 01 18:24:14 user nova-compute[72150]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 18:24:14 user nova-compute[72150]:     <feature policy='require' name='vme'/>
Aug 01 18:24:14 user nova-compute[72150]:     <feature policy='require' name='x2apic'/>
Aug 01 18:24:14 user nova-compute[72150]:     <feature policy='require' name='hypervisor'/>
Aug 01 18:24:14 user nova-compute[72150]:   </cpu>
Aug 01 18:24:14 user nova-compute[72150]:   <clock offset='utc'>
Aug 01 18:24:14 user nova-compute[72150]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 18:24:14 user nova-compute[72150]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 18:24:14 user nova-compute[72150]:     <timer name='hpet' present='no'/>
Aug 01 18:24:14 user nova-compute[72150]:   </clock>
Aug 01 18:24:14 user nova-compute[72150]:   <on_poweroff>destroy</on_poweroff>
Aug 01 18:24:14 user nova-compute[72150]:   <on_reboot>restart</on_reboot>
Aug 01 18:24:14 user nova-compute[72150]:   <on_crash>destroy</on_crash>
Aug 01 18:24:14 user nova-compute[72150]:   <devices>
Aug 01 18:24:14 user nova-compute[72150]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 18:24:14 user nova-compute[72150]:     <disk type='file' device='disk'>
Aug 01 18:24:14 user nova-compute[72150]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 18:24:14 user nova-compute[72150]:       <source file='/opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk' index='2'/>
Aug 01 18:24:14 user nova-compute[72150]:       <backingStore type='file' index='3'>
Aug 01 18:24:14 user nova-compute[72150]:         <format type='raw'/>
Aug 01 18:24:14 user nova-compute[72150]:         <source file='/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c'/>
Aug 01 18:24:14 user nova-compute[72150]:         <backingStore/>
Aug 01 18:24:14 user nova-compute[72150]:       </backingStore>
Aug 01 18:24:14 user nova-compute[72150]:       <target dev='vda' bus='virtio'/>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='virtio-disk0'/>
Aug 01 18:24:14 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </disk>
Aug 01 18:24:14 user nova-compute[72150]:     <disk type='file' device='cdrom'>
Aug 01 18:24:14 user nova-compute[72150]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 18:24:14 user nova-compute[72150]:       <source file='/opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk.config' index='1'/>
Aug 01 18:24:14 user nova-compute[72150]:       <backingStore/>
Aug 01 18:24:14 user nova-compute[72150]:       <target dev='hda' bus='ide'/>
Aug 01 18:24:14 user nova-compute[72150]:       <readonly/>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='ide0-0-0'/>
Aug 01 18:24:14 user nova-compute[72150]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </disk>
Aug 01 18:24:14 user nova-compute[72150]:     <controller type='usb' index='0' model='none'>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='usb'/>
Aug 01 18:24:14 user nova-compute[72150]:     </controller>
Aug 01 18:24:14 user nova-compute[72150]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='pci.0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </controller>
Aug 01 18:24:14 user nova-compute[72150]:     <controller type='ide' index='0'>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='ide'/>
Aug 01 18:24:14 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 18:24:14 user nova-compute[72150]:     </controller>
Aug 01 18:24:14 user nova-compute[72150]:     <interface type='ethernet'>
Aug 01 18:24:14 user nova-compute[72150]:       <mac address='fa:16:3e:16:e2:2d'/>
Aug 01 18:24:14 user nova-compute[72150]:       <target dev='tapecdd368e-4d'/>
Aug 01 18:24:14 user nova-compute[72150]:       <model type='virtio'/>
Aug 01 18:24:14 user nova-compute[72150]:       <mtu size='1442'/>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='net0'/>
Aug 01 18:24:14 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </interface>
Aug 01 18:24:14 user nova-compute[72150]:     <serial type='pty'>
Aug 01 18:24:14 user nova-compute[72150]:       <source path='/dev/pts/3'/>
Aug 01 18:24:14 user nova-compute[72150]:       <log file='/opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/console.log' append='off'/>
Aug 01 18:24:14 user nova-compute[72150]:       <target type='isa-serial' port='0'>
Aug 01 18:24:14 user nova-compute[72150]:         <model name='isa-serial'/>
Aug 01 18:24:14 user nova-compute[72150]:       </target>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='serial0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </serial>
Aug 01 18:24:14 user nova-compute[72150]:     <console type='pty' tty='/dev/pts/3'>
Aug 01 18:24:14 user nova-compute[72150]:       <source path='/dev/pts/3'/>
Aug 01 18:24:14 user nova-compute[72150]:       <log file='/opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/console.log' append='off'/>
Aug 01 18:24:14 user nova-compute[72150]:       <target type='serial' port='0'/>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='serial0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </console>
Aug 01 18:24:14 user nova-compute[72150]:     <input type='mouse' bus='ps2'>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='input0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </input>
Aug 01 18:24:14 user nova-compute[72150]:     <input type='keyboard' bus='ps2'>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='input1'/>
Aug 01 18:24:14 user nova-compute[72150]:     </input>
Aug 01 18:24:14 user nova-compute[72150]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Aug 01 18:24:14 user nova-compute[72150]:       <listen type='address' address='0.0.0.0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </graphics>
Aug 01 18:24:14 user nova-compute[72150]:     <audio id='1' type='none'/>
Aug 01 18:24:14 user nova-compute[72150]:     <video>
Aug 01 18:24:14 user nova-compute[72150]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='video0'/>
Aug 01 18:24:14 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </video>
Aug 01 18:24:14 user nova-compute[72150]:     <memballoon model='virtio'>
Aug 01 18:24:14 user nova-compute[72150]:       <stats period='10'/>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='balloon0'/>
Aug 01 18:24:14 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </memballoon>
Aug 01 18:24:14 user nova-compute[72150]:     <rng model='virtio'>
Aug 01 18:24:14 user nova-compute[72150]:       <backend model='random'>/dev/urandom</backend>
Aug 01 18:24:14 user nova-compute[72150]:       <alias name='rng0'/>
Aug 01 18:24:14 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 18:24:14 user nova-compute[72150]:     </rng>
Aug 01 18:24:14 user nova-compute[72150]:   </devices>
Aug 01 18:24:14 user nova-compute[72150]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 18:24:14 user nova-compute[72150]:     <label>libvirt-554b19ce-2ea6-4494-bdd9-a02444ca920e</label>
Aug 01 18:24:14 user nova-compute[72150]:     <imagelabel>libvirt-554b19ce-2ea6-4494-bdd9-a02444ca920e</imagelabel>
Aug 01 18:24:14 user nova-compute[72150]:   </seclabel>
Aug 01 18:24:14 user nova-compute[72150]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 18:24:14 user nova-compute[72150]:     <label>+64055:+108</label>
Aug 01 18:24:14 user nova-compute[72150]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 18:24:14 user nova-compute[72150]:   </seclabel>
Aug 01 18:24:14 user nova-compute[72150]: </domain>
Aug 01 18:24:14 user nova-compute[72150]:  {{(pid=72150) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 18:24:14 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Successfully detached device tapb3e91864-99 from instance 554b19ce-2ea6-4494-bdd9-a02444ca920e from the live domain config.
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:21:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-394626827',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-394626827',id=4,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGka8LdSLmSpjhTZLxRAxtcPMCKQajuZ77ZSdnGv3Wn3uuB5MQyyWWolkbZ67FX8/Xq0MR4R0cch8xeVC596/BP8zPK2w+Y90ycK77u4iqCmTXKKtZgqFB/uHq/hsiFKmg==',key_name='tempest-keypair-1974078877',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='914ef466b8524705868c2049eef686d6',ramdisk_id='',reservation_id='r-tmr2ov96',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1401298341',owner_user_name='tempest-TaggedAttachmentsTest-1401298341-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82554fe6d3e8493dad052be11ea1f30b',uuid=554b19ce-2ea6-4494-bdd9-a02444ca920e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "address": "fa:16:3e:e5:61:f3", "network": {"id": "f7037297-1133-40b9-a92f-ae5d7e9c70a3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1106927103", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e91864-99", "ovs_interfaceid": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Converting VIF {"id": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "address": "fa:16:3e:e5:61:f3", "network": {"id": "f7037297-1133-40b9-a92f-ae5d7e9c70a3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1106927103", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e91864-99", "ovs_interfaceid": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:61:f3,bridge_name='br-int',has_traffic_filtering=True,id=b3e91864-9951-4277-aa80-80fd19c4f3bd,network=Network(f7037297-1133-40b9-a92f-ae5d7e9c70a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e91864-99') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG os_vif [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:61:f3,bridge_name='br-int',has_traffic_filtering=True,id=b3e91864-9951-4277-aa80-80fd19c4f3bd,network=Network(f7037297-1133-40b9-a92f-ae5d7e9c70a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e91864-99') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3e91864-99, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:14 user nova-compute[72150]: INFO os_vif [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:61:f3,bridge_name='br-int',has_traffic_filtering=True,id=b3e91864-9951-4277-aa80-80fd19c4f3bd,network=Network(f7037297-1133-40b9-a92f-ae5d7e9c70a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e91864-99')
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:24:14 user nova-compute[72150]:   <nova:package version="0.0.0"/>
Aug 01 18:24:14 user nova-compute[72150]:   <nova:name>tempest-device-tagging-server-394626827</nova:name>
Aug 01 18:24:14 user nova-compute[72150]:   <nova:creationTime>2023-08-01 18:24:14</nova:creationTime>
Aug 01 18:24:14 user nova-compute[72150]:   <nova:flavor name="m1.tiny">
Aug 01 18:24:14 user nova-compute[72150]:     <nova:memory>512</nova:memory>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:disk>1</nova:disk>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:swap>0</nova:swap>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:vcpus>1</nova:vcpus>
Aug 01 18:24:14 user nova-compute[72150]:   </nova:flavor>
Aug 01 18:24:14 user nova-compute[72150]:   <nova:owner>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:user uuid="82554fe6d3e8493dad052be11ea1f30b">tempest-TaggedAttachmentsTest-1401298341-project-member</nova:user>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:project uuid="914ef466b8524705868c2049eef686d6">tempest-TaggedAttachmentsTest-1401298341</nova:project>
Aug 01 18:24:14 user nova-compute[72150]:   </nova:owner>
Aug 01 18:24:14 user nova-compute[72150]:   <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:24:14 user nova-compute[72150]:   <nova:ports>
Aug 01 18:24:14 user nova-compute[72150]:     <nova:port uuid="ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a">
Aug 01 18:24:14 user nova-compute[72150]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 18:24:14 user nova-compute[72150]:     </nova:port>
Aug 01 18:24:14 user nova-compute[72150]:   </nova:ports>
Aug 01 18:24:14 user nova-compute[72150]: </nova:instance>
Aug 01 18:24:14 user nova-compute[72150]:  {{(pid=72150) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.compute.manager [req-e3e4ff67-2b62-4dd1-93f4-e29f565ca24d req-8de2d413-1fb3-47cf-9996-2113880eea71 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Received event network-vif-unplugged-b3e91864-9951-4277-aa80-80fd19c4f3bd {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e3e4ff67-2b62-4dd1-93f4-e29f565ca24d req-8de2d413-1fb3-47cf-9996-2113880eea71 service nova] Acquiring lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e3e4ff67-2b62-4dd1-93f4-e29f565ca24d req-8de2d413-1fb3-47cf-9996-2113880eea71 service nova] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e3e4ff67-2b62-4dd1-93f4-e29f565ca24d req-8de2d413-1fb3-47cf-9996-2113880eea71 service nova] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.compute.manager [req-e3e4ff67-2b62-4dd1-93f4-e29f565ca24d req-8de2d413-1fb3-47cf-9996-2113880eea71 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] No waiting events found dispatching network-vif-unplugged-b3e91864-9951-4277-aa80-80fd19c4f3bd {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:24:14 user nova-compute[72150]: WARNING nova.compute.manager [req-e3e4ff67-2b62-4dd1-93f4-e29f565ca24d req-8de2d413-1fb3-47cf-9996-2113880eea71 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Received unexpected event network-vif-unplugged-b3e91864-9951-4277-aa80-80fd19c4f3bd for instance with vm_state active and task_state None.
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690914254.8897145, 161fa35c-1f33-4ea7-94a9-c3b78952155e => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 161fa35c-1f33-4ea7-94a9-c3b78952155e {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:24:14 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Successfully detached device sdc from instance 161fa35c-1f33-4ea7-94a9-c3b78952155e from the live domain config.
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WujeqSPa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:24:14 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:24:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNpGQZqs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:24:14 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:24:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.052s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[91662404-a476-4eba-a793-2933ce9c6692]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.076s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c08a89-cec2-4d12-be74-4c3e5704ff4a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c209360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d'): ({'sdj'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Removing single pathed devices sdj {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a51fd40-8123-48cd-86af-4ff6af09d328]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f5fca5-98ec-4ea8-8a73-1323a7087b01]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Flushing IO for device /dev/sdj {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbd034d-0c23-4be9-8ff4-a86bb08bd34a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.054s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ef9737-d691-4597-b941-1c6ef5370893]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] SCSI volumes sdj have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[211d4cca-6526-4c20-aa47-df3bc159c489]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG nova.compute.manager [req-559de473-7533-43cb-b169-a6c23b4bb93d req-a3666fef-86ff-4aa9-b496-7d2b1286103b service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Received event network-vif-deleted-b3e91864-9951-4277-aa80-80fd19c4f3bd {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:15 user nova-compute[72150]: INFO nova.compute.manager [req-559de473-7533-43cb-b169-a6c23b4bb93d req-a3666fef-86ff-4aa9-b496-7d2b1286103b service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Neutron deleted interface b3e91864-9951-4277-aa80-80fd19c4f3bd; detaching it from the instance and deleting it from the info cache
Aug 01 18:24:15 user nova-compute[72150]: DEBUG nova.network.neutron [req-559de473-7533-43cb-b169-a6c23b4bb93d req-a3666fef-86ff-4aa9-b496-7d2b1286103b service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Updating instance_info_cache with network_info: [{"id": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "address": "fa:16:3e:16:e2:2d", "network": {"id": "b006b5b5-51ee-476d-93d1-0f7c510088da", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1317073326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdd368e-4d", "ovs_interfaceid": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG nova.objects.instance [req-559de473-7533-43cb-b169-a6c23b4bb93d req-a3666fef-86ff-4aa9-b496-7d2b1286103b service nova] Lazy-loading 'system_metadata' on Instance uuid 554b19ce-2ea6-4494-bdd9-a02444ca920e {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Acquiring lock "refresh_cache-554b19ce-2ea6-4494-bdd9-a02444ca920e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Acquired lock "refresh_cache-554b19ce-2ea6-4494-bdd9-a02444ca920e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG nova.network.neutron [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d491bf4-af1b-4dc5-ada9-53818562b164]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d, portal: 172.16.0.220,3260]
Aug 01 18:24:15 user nova-compute[72150]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d, portal: 172.16.0.220,3260] successful.
Aug 01 18:24:15 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG nova.objects.instance [req-559de473-7533-43cb-b169-a6c23b4bb93d req-a3666fef-86ff-4aa9-b496-7d2b1286103b service nova] Lazy-loading 'flavor' on Instance uuid 554b19ce-2ea6-4494-bdd9-a02444ca920e {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32fc1c5d-95d3-4bcb-9edf-d822745f233d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae31c8fd-9c67-4565-bcf6-ecda71819281]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.473s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] <== disconnect_volume: return (475ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.434s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:24:15 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:24:15 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[07364d3e-1538-46cb-9752-27e762883659]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:24:15 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [req-559de473-7533-43cb-b169-a6c23b4bb93d req-a3666fef-86ff-4aa9-b496-7d2b1286103b service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:21:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-394626827',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-394626827',id=4,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGka8LdSLmSpjhTZLxRAxtcPMCKQajuZ77ZSdnGv3Wn3uuB5MQyyWWolkbZ67FX8/Xq0MR4R0cch8xeVC596/BP8zPK2w+Y90ycK77u4iqCmTXKKtZgqFB/uHq/hsiFKmg==',key_name='tempest-keypair-1974078877',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='914ef466b8524705868c2049eef686d6',ramdisk_id='',reservation_id='r-tmr2ov96',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1401298341',owner_user_name='tempest-TaggedAttachmentsTest-1401298341-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82554fe6d3e8493dad052be11ea1f30b',uuid=554b19ce-2ea6-4494-bdd9-a02444ca920e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "address": "fa:16:3e:e5:61:f3", "network": {"id": "f7037297-1133-40b9-a92f-ae5d7e9c70a3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1106927103", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e91864-99", "ovs_interfaceid": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG nova.network.os_vif_util [req-559de473-7533-43cb-b169-a6c23b4bb93d req-a3666fef-86ff-4aa9-b496-7d2b1286103b service nova] Converting VIF {"id": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "address": "fa:16:3e:e5:61:f3", "network": {"id": "f7037297-1133-40b9-a92f-ae5d7e9c70a3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1106927103", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e91864-99", "ovs_interfaceid": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG nova.network.os_vif_util [req-559de473-7533-43cb-b169-a6c23b4bb93d req-a3666fef-86ff-4aa9-b496-7d2b1286103b service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:61:f3,bridge_name='br-int',has_traffic_filtering=True,id=b3e91864-9951-4277-aa80-80fd19c4f3bd,network=Network(f7037297-1133-40b9-a92f-ae5d7e9c70a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e91864-99') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [req-559de473-7533-43cb-b169-a6c23b4bb93d req-a3666fef-86ff-4aa9-b496-7d2b1286103b service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e5:61:f3"/><model type="virtio"/><mtu size="1442"/><target dev="tapb3e91864-99"/></interface> {{(pid=72150) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [req-559de473-7533-43cb-b169-a6c23b4bb93d req-a3666fef-86ff-4aa9-b496-7d2b1286103b service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e5:61:f3"/><model type="virtio"/><mtu size="1442"/><target dev="tapb3e91864-99"/></interface>not found in domain: <domain type='kvm' id='4'>
Aug 01 18:24:15 user nova-compute[72150]:   <name>instance-00000004</name>
Aug 01 18:24:15 user nova-compute[72150]:   <uuid>554b19ce-2ea6-4494-bdd9-a02444ca920e</uuid>
Aug 01 18:24:15 user nova-compute[72150]:   <metadata>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:24:15 user nova-compute[72150]:   <nova:package version="0.0.0"/>
Aug 01 18:24:15 user nova-compute[72150]:   <nova:name>tempest-device-tagging-server-394626827</nova:name>
Aug 01 18:24:15 user nova-compute[72150]:   <nova:creationTime>2023-08-01 18:24:14</nova:creationTime>
Aug 01 18:24:15 user nova-compute[72150]:   <nova:flavor name="m1.tiny">
Aug 01 18:24:15 user nova-compute[72150]:     <nova:memory>512</nova:memory>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:disk>1</nova:disk>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:swap>0</nova:swap>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:vcpus>1</nova:vcpus>
Aug 01 18:24:15 user nova-compute[72150]:   </nova:flavor>
Aug 01 18:24:15 user nova-compute[72150]:   <nova:owner>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:user uuid="82554fe6d3e8493dad052be11ea1f30b">tempest-TaggedAttachmentsTest-1401298341-project-member</nova:user>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:project uuid="914ef466b8524705868c2049eef686d6">tempest-TaggedAttachmentsTest-1401298341</nova:project>
Aug 01 18:24:15 user nova-compute[72150]:   </nova:owner>
Aug 01 18:24:15 user nova-compute[72150]:   <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:24:15 user nova-compute[72150]:   <nova:ports>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:port uuid="ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a">
Aug 01 18:24:15 user nova-compute[72150]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 18:24:15 user nova-compute[72150]:     </nova:port>
Aug 01 18:24:15 user nova-compute[72150]:   </nova:ports>
Aug 01 18:24:15 user nova-compute[72150]: </nova:instance>
Aug 01 18:24:15 user nova-compute[72150]:   </metadata>
Aug 01 18:24:15 user nova-compute[72150]:   <memory unit='KiB'>524288</memory>
Aug 01 18:24:15 user nova-compute[72150]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 18:24:15 user nova-compute[72150]:   <vcpu placement='static'>1</vcpu>
Aug 01 18:24:15 user nova-compute[72150]:   <resource>
Aug 01 18:24:15 user nova-compute[72150]:     <partition>/machine</partition>
Aug 01 18:24:15 user nova-compute[72150]:   </resource>
Aug 01 18:24:15 user nova-compute[72150]:   <sysinfo type='smbios'>
Aug 01 18:24:15 user nova-compute[72150]:     <system>
Aug 01 18:24:15 user nova-compute[72150]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 18:24:15 user nova-compute[72150]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 18:24:15 user nova-compute[72150]:       <entry name='version'>0.0.0</entry>
Aug 01 18:24:15 user nova-compute[72150]:       <entry name='serial'>554b19ce-2ea6-4494-bdd9-a02444ca920e</entry>
Aug 01 18:24:15 user nova-compute[72150]:       <entry name='uuid'>554b19ce-2ea6-4494-bdd9-a02444ca920e</entry>
Aug 01 18:24:15 user nova-compute[72150]:       <entry name='family'>Virtual Machine</entry>
Aug 01 18:24:15 user nova-compute[72150]:     </system>
Aug 01 18:24:15 user nova-compute[72150]:   </sysinfo>
Aug 01 18:24:15 user nova-compute[72150]:   <os>
Aug 01 18:24:15 user nova-compute[72150]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 18:24:15 user nova-compute[72150]:     <boot dev='hd'/>
Aug 01 18:24:15 user nova-compute[72150]:     <smbios mode='sysinfo'/>
Aug 01 18:24:15 user nova-compute[72150]:   </os>
Aug 01 18:24:15 user nova-compute[72150]:   <features>
Aug 01 18:24:15 user nova-compute[72150]:     <acpi/>
Aug 01 18:24:15 user nova-compute[72150]:     <apic/>
Aug 01 18:24:15 user nova-compute[72150]:     <vmcoreinfo state='on'/>
Aug 01 18:24:15 user nova-compute[72150]:   </features>
Aug 01 18:24:15 user nova-compute[72150]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 18:24:15 user nova-compute[72150]:     <model fallback='forbid'>Nehalem</model>
Aug 01 18:24:15 user nova-compute[72150]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 18:24:15 user nova-compute[72150]:     <feature policy='require' name='vme'/>
Aug 01 18:24:15 user nova-compute[72150]:     <feature policy='require' name='x2apic'/>
Aug 01 18:24:15 user nova-compute[72150]:     <feature policy='require' name='hypervisor'/>
Aug 01 18:24:15 user nova-compute[72150]:   </cpu>
Aug 01 18:24:15 user nova-compute[72150]:   <clock offset='utc'>
Aug 01 18:24:15 user nova-compute[72150]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 18:24:15 user nova-compute[72150]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 18:24:15 user nova-compute[72150]:     <timer name='hpet' present='no'/>
Aug 01 18:24:15 user nova-compute[72150]:   </clock>
Aug 01 18:24:15 user nova-compute[72150]:   <on_poweroff>destroy</on_poweroff>
Aug 01 18:24:15 user nova-compute[72150]:   <on_reboot>restart</on_reboot>
Aug 01 18:24:15 user nova-compute[72150]:   <on_crash>destroy</on_crash>
Aug 01 18:24:15 user nova-compute[72150]:   <devices>
Aug 01 18:24:15 user nova-compute[72150]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 18:24:15 user nova-compute[72150]:     <disk type='file' device='disk'>
Aug 01 18:24:15 user nova-compute[72150]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 18:24:15 user nova-compute[72150]:       <source file='/opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk' index='2'/>
Aug 01 18:24:15 user nova-compute[72150]:       <backingStore type='file' index='3'>
Aug 01 18:24:15 user nova-compute[72150]:         <format type='raw'/>
Aug 01 18:24:15 user nova-compute[72150]:         <source file='/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c'/>
Aug 01 18:24:15 user nova-compute[72150]:         <backingStore/>
Aug 01 18:24:15 user nova-compute[72150]:       </backingStore>
Aug 01 18:24:15 user nova-compute[72150]:       <target dev='vda' bus='virtio'/>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='virtio-disk0'/>
Aug 01 18:24:15 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 18:24:15 user nova-compute[72150]:     </disk>
Aug 01 18:24:15 user nova-compute[72150]:     <disk type='file' device='cdrom'>
Aug 01 18:24:15 user nova-compute[72150]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 18:24:15 user nova-compute[72150]:       <source file='/opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk.config' index='1'/>
Aug 01 18:24:15 user nova-compute[72150]:       <backingStore/>
Aug 01 18:24:15 user nova-compute[72150]:       <target dev='hda' bus='ide'/>
Aug 01 18:24:15 user nova-compute[72150]:       <readonly/>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='ide0-0-0'/>
Aug 01 18:24:15 user nova-compute[72150]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 18:24:15 user nova-compute[72150]:     </disk>
Aug 01 18:24:15 user nova-compute[72150]:     <controller type='usb' index='0' model='none'>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='usb'/>
Aug 01 18:24:15 user nova-compute[72150]:     </controller>
Aug 01 18:24:15 user nova-compute[72150]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='pci.0'/>
Aug 01 18:24:15 user nova-compute[72150]:     </controller>
Aug 01 18:24:15 user nova-compute[72150]:     <controller type='ide' index='0'>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='ide'/>
Aug 01 18:24:15 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 18:24:15 user nova-compute[72150]:     </controller>
Aug 01 18:24:15 user nova-compute[72150]:     <interface type='ethernet'>
Aug 01 18:24:15 user nova-compute[72150]:       <mac address='fa:16:3e:16:e2:2d'/>
Aug 01 18:24:15 user nova-compute[72150]:       <target dev='tapecdd368e-4d'/>
Aug 01 18:24:15 user nova-compute[72150]:       <model type='virtio'/>
Aug 01 18:24:15 user nova-compute[72150]:       <mtu size='1442'/>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='net0'/>
Aug 01 18:24:15 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 18:24:15 user nova-compute[72150]:     </interface>
Aug 01 18:24:15 user nova-compute[72150]:     <serial type='pty'>
Aug 01 18:24:15 user nova-compute[72150]:       <source path='/dev/pts/3'/>
Aug 01 18:24:15 user nova-compute[72150]:       <log file='/opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/console.log' append='off'/>
Aug 01 18:24:15 user nova-compute[72150]:       <target type='isa-serial' port='0'>
Aug 01 18:24:15 user nova-compute[72150]:         <model name='isa-serial'/>
Aug 01 18:24:15 user nova-compute[72150]:       </target>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='serial0'/>
Aug 01 18:24:15 user nova-compute[72150]:     </serial>
Aug 01 18:24:15 user nova-compute[72150]:     <console type='pty' tty='/dev/pts/3'>
Aug 01 18:24:15 user nova-compute[72150]:       <source path='/dev/pts/3'/>
Aug 01 18:24:15 user nova-compute[72150]:       <log file='/opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/console.log' append='off'/>
Aug 01 18:24:15 user nova-compute[72150]:       <target type='serial' port='0'/>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='serial0'/>
Aug 01 18:24:15 user nova-compute[72150]:     </console>
Aug 01 18:24:15 user nova-compute[72150]:     <input type='mouse' bus='ps2'>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='input0'/>
Aug 01 18:24:15 user nova-compute[72150]:     </input>
Aug 01 18:24:15 user nova-compute[72150]:     <input type='keyboard' bus='ps2'>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='input1'/>
Aug 01 18:24:15 user nova-compute[72150]:     </input>
Aug 01 18:24:15 user nova-compute[72150]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Aug 01 18:24:15 user nova-compute[72150]:       <listen type='address' address='0.0.0.0'/>
Aug 01 18:24:15 user nova-compute[72150]:     </graphics>
Aug 01 18:24:15 user nova-compute[72150]:     <audio id='1' type='none'/>
Aug 01 18:24:15 user nova-compute[72150]:     <video>
Aug 01 18:24:15 user nova-compute[72150]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='video0'/>
Aug 01 18:24:15 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 18:24:15 user nova-compute[72150]:     </video>
Aug 01 18:24:15 user nova-compute[72150]:     <memballoon model='virtio'>
Aug 01 18:24:15 user nova-compute[72150]:       <stats period='10'/>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='balloon0'/>
Aug 01 18:24:15 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 18:24:15 user nova-compute[72150]:     </memballoon>
Aug 01 18:24:15 user nova-compute[72150]:     <rng model='virtio'>
Aug 01 18:24:15 user nova-compute[72150]:       <backend model='random'>/dev/urandom</backend>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='rng0'/>
Aug 01 18:24:15 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 18:24:15 user nova-compute[72150]:     </rng>
Aug 01 18:24:15 user nova-compute[72150]:   </devices>
Aug 01 18:24:15 user nova-compute[72150]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 18:24:15 user nova-compute[72150]:     <label>libvirt-554b19ce-2ea6-4494-bdd9-a02444ca920e</label>
Aug 01 18:24:15 user nova-compute[72150]:     <imagelabel>libvirt-554b19ce-2ea6-4494-bdd9-a02444ca920e</imagelabel>
Aug 01 18:24:15 user nova-compute[72150]:   </seclabel>
Aug 01 18:24:15 user nova-compute[72150]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 18:24:15 user nova-compute[72150]:     <label>+64055:+108</label>
Aug 01 18:24:15 user nova-compute[72150]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 18:24:15 user nova-compute[72150]:   </seclabel>
Aug 01 18:24:15 user nova-compute[72150]: </domain>
Aug 01 18:24:15 user nova-compute[72150]:  {{(pid=72150) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [req-559de473-7533-43cb-b169-a6c23b4bb93d req-a3666fef-86ff-4aa9-b496-7d2b1286103b service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e5:61:f3"/><model type="virtio"/><mtu size="1442"/><target dev="tapb3e91864-99"/></interface> {{(pid=72150) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e05effe-ec2b-4770-b4de-adc96e2c6c11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f] added
Aug 01 18:24:15 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [req-559de473-7533-43cb-b169-a6c23b4bb93d req-a3666fef-86ff-4aa9-b496-7d2b1286103b service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e5:61:f3"/><model type="virtio"/><mtu size="1442"/><target dev="tapb3e91864-99"/></interface>not found in domain: <domain type='kvm' id='4'>
Aug 01 18:24:15 user nova-compute[72150]:   <name>instance-00000004</name>
Aug 01 18:24:15 user nova-compute[72150]:   <uuid>554b19ce-2ea6-4494-bdd9-a02444ca920e</uuid>
Aug 01 18:24:15 user nova-compute[72150]:   <metadata>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:24:15 user nova-compute[72150]:   <nova:package version="0.0.0"/>
Aug 01 18:24:15 user nova-compute[72150]:   <nova:name>tempest-device-tagging-server-394626827</nova:name>
Aug 01 18:24:15 user nova-compute[72150]:   <nova:creationTime>2023-08-01 18:24:14</nova:creationTime>
Aug 01 18:24:15 user nova-compute[72150]:   <nova:flavor name="m1.tiny">
Aug 01 18:24:15 user nova-compute[72150]:     <nova:memory>512</nova:memory>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:disk>1</nova:disk>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:swap>0</nova:swap>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:vcpus>1</nova:vcpus>
Aug 01 18:24:15 user nova-compute[72150]:   </nova:flavor>
Aug 01 18:24:15 user nova-compute[72150]:   <nova:owner>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:user uuid="82554fe6d3e8493dad052be11ea1f30b">tempest-TaggedAttachmentsTest-1401298341-project-member</nova:user>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:project uuid="914ef466b8524705868c2049eef686d6">tempest-TaggedAttachmentsTest-1401298341</nova:project>
Aug 01 18:24:15 user nova-compute[72150]:   </nova:owner>
Aug 01 18:24:15 user nova-compute[72150]:   <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:24:15 user nova-compute[72150]:   <nova:ports>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:port uuid="ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a">
Aug 01 18:24:15 user nova-compute[72150]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 18:24:15 user nova-compute[72150]:     </nova:port>
Aug 01 18:24:15 user nova-compute[72150]:   </nova:ports>
Aug 01 18:24:15 user nova-compute[72150]: </nova:instance>
Aug 01 18:24:15 user nova-compute[72150]:   </metadata>
Aug 01 18:24:15 user nova-compute[72150]:   <memory unit='KiB'>524288</memory>
Aug 01 18:24:15 user nova-compute[72150]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 18:24:15 user nova-compute[72150]:   <vcpu placement='static'>1</vcpu>
Aug 01 18:24:15 user nova-compute[72150]:   <resource>
Aug 01 18:24:15 user nova-compute[72150]:     <partition>/machine</partition>
Aug 01 18:24:15 user nova-compute[72150]:   </resource>
Aug 01 18:24:15 user nova-compute[72150]:   <sysinfo type='smbios'>
Aug 01 18:24:15 user nova-compute[72150]:     <system>
Aug 01 18:24:15 user nova-compute[72150]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 18:24:15 user nova-compute[72150]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 18:24:15 user nova-compute[72150]:       <entry name='version'>0.0.0</entry>
Aug 01 18:24:15 user nova-compute[72150]:       <entry name='serial'>554b19ce-2ea6-4494-bdd9-a02444ca920e</entry>
Aug 01 18:24:15 user nova-compute[72150]:       <entry name='uuid'>554b19ce-2ea6-4494-bdd9-a02444ca920e</entry>
Aug 01 18:24:15 user nova-compute[72150]:       <entry name='family'>Virtual Machine</entry>
Aug 01 18:24:15 user nova-compute[72150]:     </system>
Aug 01 18:24:15 user nova-compute[72150]:   </sysinfo>
Aug 01 18:24:15 user nova-compute[72150]:   <os>
Aug 01 18:24:15 user nova-compute[72150]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 18:24:15 user nova-compute[72150]:     <boot dev='hd'/>
Aug 01 18:24:15 user nova-compute[72150]:     <smbios mode='sysinfo'/>
Aug 01 18:24:15 user nova-compute[72150]:   </os>
Aug 01 18:24:15 user nova-compute[72150]:   <features>
Aug 01 18:24:15 user nova-compute[72150]:     <acpi/>
Aug 01 18:24:15 user nova-compute[72150]:     <apic/>
Aug 01 18:24:15 user nova-compute[72150]:     <vmcoreinfo state='on'/>
Aug 01 18:24:15 user nova-compute[72150]:   </features>
Aug 01 18:24:15 user nova-compute[72150]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 18:24:15 user nova-compute[72150]:     <model fallback='forbid'>Nehalem</model>
Aug 01 18:24:15 user nova-compute[72150]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 18:24:15 user nova-compute[72150]:     <feature policy='require' name='vme'/>
Aug 01 18:24:15 user nova-compute[72150]:     <feature policy='require' name='x2apic'/>
Aug 01 18:24:15 user nova-compute[72150]:     <feature policy='require' name='hypervisor'/>
Aug 01 18:24:15 user nova-compute[72150]:   </cpu>
Aug 01 18:24:15 user nova-compute[72150]:   <clock offset='utc'>
Aug 01 18:24:15 user nova-compute[72150]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 18:24:15 user nova-compute[72150]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 18:24:15 user nova-compute[72150]:     <timer name='hpet' present='no'/>
Aug 01 18:24:15 user nova-compute[72150]:   </clock>
Aug 01 18:24:15 user nova-compute[72150]:   <on_poweroff>destroy</on_poweroff>
Aug 01 18:24:15 user nova-compute[72150]:   <on_reboot>restart</on_reboot>
Aug 01 18:24:15 user nova-compute[72150]:   <on_crash>destroy</on_crash>
Aug 01 18:24:15 user nova-compute[72150]:   <devices>
Aug 01 18:24:15 user nova-compute[72150]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 18:24:15 user nova-compute[72150]:     <disk type='file' device='disk'>
Aug 01 18:24:15 user nova-compute[72150]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 18:24:15 user nova-compute[72150]:       <source file='/opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk' index='2'/>
Aug 01 18:24:15 user nova-compute[72150]:       <backingStore type='file' index='3'>
Aug 01 18:24:15 user nova-compute[72150]:         <format type='raw'/>
Aug 01 18:24:15 user nova-compute[72150]:         <source file='/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c'/>
Aug 01 18:24:15 user nova-compute[72150]:         <backingStore/>
Aug 01 18:24:15 user nova-compute[72150]:       </backingStore>
Aug 01 18:24:15 user nova-compute[72150]:       <target dev='vda' bus='virtio'/>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='virtio-disk0'/>
Aug 01 18:24:15 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 18:24:15 user nova-compute[72150]:     </disk>
Aug 01 18:24:15 user nova-compute[72150]:     <disk type='file' device='cdrom'>
Aug 01 18:24:15 user nova-compute[72150]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 18:24:15 user nova-compute[72150]:       <source file='/opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk.config' index='1'/>
Aug 01 18:24:15 user nova-compute[72150]:       <backingStore/>
Aug 01 18:24:15 user nova-compute[72150]:       <target dev='hda' bus='ide'/>
Aug 01 18:24:15 user nova-compute[72150]:       <readonly/>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='ide0-0-0'/>
Aug 01 18:24:15 user nova-compute[72150]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 18:24:15 user nova-compute[72150]:     </disk>
Aug 01 18:24:15 user nova-compute[72150]:     <controller type='usb' index='0' model='none'>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='usb'/>
Aug 01 18:24:15 user nova-compute[72150]:     </controller>
Aug 01 18:24:15 user nova-compute[72150]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='pci.0'/>
Aug 01 18:24:15 user nova-compute[72150]:     </controller>
Aug 01 18:24:15 user nova-compute[72150]:     <controller type='ide' index='0'>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='ide'/>
Aug 01 18:24:15 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 18:24:15 user nova-compute[72150]:     </controller>
Aug 01 18:24:15 user nova-compute[72150]:     <interface type='ethernet'>
Aug 01 18:24:15 user nova-compute[72150]:       <mac address='fa:16:3e:16:e2:2d'/>
Aug 01 18:24:15 user nova-compute[72150]:       <target dev='tapecdd368e-4d'/>
Aug 01 18:24:15 user nova-compute[72150]:       <model type='virtio'/>
Aug 01 18:24:15 user nova-compute[72150]:       <mtu size='1442'/>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='net0'/>
Aug 01 18:24:15 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 18:24:15 user nova-compute[72150]:     </interface>
Aug 01 18:24:15 user nova-compute[72150]:     <serial type='pty'>
Aug 01 18:24:15 user nova-compute[72150]:       <source path='/dev/pts/3'/>
Aug 01 18:24:15 user nova-compute[72150]:       <log file='/opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/console.log' append='off'/>
Aug 01 18:24:15 user nova-compute[72150]:       <target type='isa-serial' port='0'>
Aug 01 18:24:15 user nova-compute[72150]:         <model name='isa-serial'/>
Aug 01 18:24:15 user nova-compute[72150]:       </target>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='serial0'/>
Aug 01 18:24:15 user nova-compute[72150]:     </serial>
Aug 01 18:24:15 user nova-compute[72150]:     <console type='pty' tty='/dev/pts/3'>
Aug 01 18:24:15 user nova-compute[72150]:       <source path='/dev/pts/3'/>
Aug 01 18:24:15 user nova-compute[72150]:       <log file='/opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/console.log' append='off'/>
Aug 01 18:24:15 user nova-compute[72150]:       <target type='serial' port='0'/>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='serial0'/>
Aug 01 18:24:15 user nova-compute[72150]:     </console>
Aug 01 18:24:15 user nova-compute[72150]:     <input type='mouse' bus='ps2'>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='input0'/>
Aug 01 18:24:15 user nova-compute[72150]:     </input>
Aug 01 18:24:15 user nova-compute[72150]:     <input type='keyboard' bus='ps2'>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='input1'/>
Aug 01 18:24:15 user nova-compute[72150]:     </input>
Aug 01 18:24:15 user nova-compute[72150]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Aug 01 18:24:15 user nova-compute[72150]:       <listen type='address' address='0.0.0.0'/>
Aug 01 18:24:15 user nova-compute[72150]:     </graphics>
Aug 01 18:24:15 user nova-compute[72150]:     <audio id='1' type='none'/>
Aug 01 18:24:15 user nova-compute[72150]:     <video>
Aug 01 18:24:15 user nova-compute[72150]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='video0'/>
Aug 01 18:24:15 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 18:24:15 user nova-compute[72150]:     </video>
Aug 01 18:24:15 user nova-compute[72150]:     <memballoon model='virtio'>
Aug 01 18:24:15 user nova-compute[72150]:       <stats period='10'/>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='balloon0'/>
Aug 01 18:24:15 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 18:24:15 user nova-compute[72150]:     </memballoon>
Aug 01 18:24:15 user nova-compute[72150]:     <rng model='virtio'>
Aug 01 18:24:15 user nova-compute[72150]:       <backend model='random'>/dev/urandom</backend>
Aug 01 18:24:15 user nova-compute[72150]:       <alias name='rng0'/>
Aug 01 18:24:15 user nova-compute[72150]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 18:24:15 user nova-compute[72150]:     </rng>
Aug 01 18:24:15 user nova-compute[72150]:   </devices>
Aug 01 18:24:15 user nova-compute[72150]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 18:24:15 user nova-compute[72150]:     <label>libvirt-554b19ce-2ea6-4494-bdd9-a02444ca920e</label>
Aug 01 18:24:15 user nova-compute[72150]:     <imagelabel>libvirt-554b19ce-2ea6-4494-bdd9-a02444ca920e</imagelabel>
Aug 01 18:24:15 user nova-compute[72150]:   </seclabel>
Aug 01 18:24:15 user nova-compute[72150]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 18:24:15 user nova-compute[72150]:     <label>+64055:+108</label>
Aug 01 18:24:15 user nova-compute[72150]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 18:24:15 user nova-compute[72150]:   </seclabel>
Aug 01 18:24:15 user nova-compute[72150]: </domain>
Aug 01 18:24:15 user nova-compute[72150]:  {{(pid=72150) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 18:24:15 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [req-559de473-7533-43cb-b169-a6c23b4bb93d req-a3666fef-86ff-4aa9-b496-7d2b1286103b service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Detaching interface fa:16:3e:e5:61:f3 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapb3e91864-99' not found.
Aug 01 18:24:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [req-559de473-7533-43cb-b169-a6c23b4bb93d req-a3666fef-86ff-4aa9-b496-7d2b1286103b service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:21:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-394626827',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-394626827',id=4,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGka8LdSLmSpjhTZLxRAxtcPMCKQajuZ77ZSdnGv3Wn3uuB5MQyyWWolkbZ67FX8/Xq0MR4R0cch8xeVC596/BP8zPK2w+Y90ycK77u4iqCmTXKKtZgqFB/uHq/hsiFKmg==',key_name='tempest-keypair-1974078877',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='914ef466b8524705868c2049eef686d6',ramdisk_id='',reservation_id='r-tmr2ov96',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1401298341',owner_user_name='tempest-TaggedAttachmentsTest-1401298341-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82554fe6d3e8493dad052be11ea1f30b',uuid=554b19ce-2ea6-4494-bdd9-a02444ca920e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "address": "fa:16:3e:e5:61:f3", "network": {"id": "f7037297-1133-40b9-a92f-ae5d7e9c70a3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1106927103", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e91864-99", "ovs_interfaceid": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG nova.network.os_vif_util [req-559de473-7533-43cb-b169-a6c23b4bb93d req-a3666fef-86ff-4aa9-b496-7d2b1286103b service nova] Converting VIF {"id": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "address": "fa:16:3e:e5:61:f3", "network": {"id": "f7037297-1133-40b9-a92f-ae5d7e9c70a3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1106927103", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e91864-99", "ovs_interfaceid": "b3e91864-9951-4277-aa80-80fd19c4f3bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG nova.network.os_vif_util [req-559de473-7533-43cb-b169-a6c23b4bb93d req-a3666fef-86ff-4aa9-b496-7d2b1286103b service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:61:f3,bridge_name='br-int',has_traffic_filtering=True,id=b3e91864-9951-4277-aa80-80fd19c4f3bd,network=Network(f7037297-1133-40b9-a92f-ae5d7e9c70a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e91864-99') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_vif [req-559de473-7533-43cb-b169-a6c23b4bb93d req-a3666fef-86ff-4aa9-b496-7d2b1286103b service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:61:f3,bridge_name='br-int',has_traffic_filtering=True,id=b3e91864-9951-4277-aa80-80fd19c4f3bd,network=Network(f7037297-1133-40b9-a92f-ae5d7e9c70a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e91864-99') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3e91864-99, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:24:15 user nova-compute[72150]: INFO os_vif [req-559de473-7533-43cb-b169-a6c23b4bb93d req-a3666fef-86ff-4aa9-b496-7d2b1286103b service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:61:f3,bridge_name='br-int',has_traffic_filtering=True,id=b3e91864-9951-4277-aa80-80fd19c4f3bd,network=Network(f7037297-1133-40b9-a92f-ae5d7e9c70a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e91864-99')
Aug 01 18:24:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [req-559de473-7533-43cb-b169-a6c23b4bb93d req-a3666fef-86ff-4aa9-b496-7d2b1286103b service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:24:15 user nova-compute[72150]:   <nova:package version="0.0.0"/>
Aug 01 18:24:15 user nova-compute[72150]:   <nova:name>tempest-device-tagging-server-394626827</nova:name>
Aug 01 18:24:15 user nova-compute[72150]:   <nova:creationTime>2023-08-01 18:24:15</nova:creationTime>
Aug 01 18:24:15 user nova-compute[72150]:   <nova:flavor name="m1.tiny">
Aug 01 18:24:15 user nova-compute[72150]:     <nova:memory>512</nova:memory>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:disk>1</nova:disk>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:swap>0</nova:swap>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:vcpus>1</nova:vcpus>
Aug 01 18:24:15 user nova-compute[72150]:   </nova:flavor>
Aug 01 18:24:15 user nova-compute[72150]:   <nova:owner>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:user uuid="82554fe6d3e8493dad052be11ea1f30b">tempest-TaggedAttachmentsTest-1401298341-project-member</nova:user>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:project uuid="914ef466b8524705868c2049eef686d6">tempest-TaggedAttachmentsTest-1401298341</nova:project>
Aug 01 18:24:15 user nova-compute[72150]:   </nova:owner>
Aug 01 18:24:15 user nova-compute[72150]:   <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:24:15 user nova-compute[72150]:   <nova:ports>
Aug 01 18:24:15 user nova-compute[72150]:     <nova:port uuid="ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a">
Aug 01 18:24:15 user nova-compute[72150]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 18:24:15 user nova-compute[72150]:     </nova:port>
Aug 01 18:24:15 user nova-compute[72150]:   </nova:ports>
Aug 01 18:24:15 user nova-compute[72150]: </nova:instance>
Aug 01 18:24:15 user nova-compute[72150]:  {{(pid=72150) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1655c34-b058-4a72-b5cc-5c7a202c4d93]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c99cede-3f04-40dc-add5-d17a00dc4dbf]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wNpGQZqs {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wNpGQZqs" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7a109f-fc35-4fde-918b-fe37c7804fea]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wNpGQZqs'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d262a0b-0b0f-4013-b501-6038db722184]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[46340308-1130-427c-afdc-1e06e491087f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39ffcbd-b349-4479-9615-00c88ce56e6d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f, portal: 172.16.0.220,3260]
Aug 01 18:24:15 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f, portal: 172.16.0.220,3260] successful.
Aug 01 18:24:15 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd62706f-a6b1-4d71-843d-3cee0cbd2ded]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae192a7-0df7-4407-b356-3ad9225b7ea7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:15 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] HCTL ('40', '-', '-', 0) found on session 14 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ae899c-9d29-4d8f-a583-e73b7bcf5db7]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Searching for a device in session 14 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNpGQZqs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG nova.network.neutron [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Updating instance_info_cache with network_info: [{"id": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "address": "fa:16:3e:16:e2:2d", "network": {"id": "b006b5b5-51ee-476d-93d1-0f7c510088da", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1317073326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdd368e-4d", "ovs_interfaceid": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Releasing lock "refresh_cache-554b19ce-2ea6-4494-bdd9-a02444ca920e" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:24:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6f40f288-bcfd-4a43-a494-a6ca7d73c188 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "interface-554b19ce-2ea6-4494-bdd9-a02444ca920e-b3e91864-9951-4277-aa80-80fd19c4f3bd" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.825s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:16 user nova-compute[72150]: DEBUG nova.objects.instance [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lazy-loading 'flavor' on Instance uuid 161fa35c-1f33-4ea7-94a9-c3b78952155e {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:24:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7540c1f3-475e-4b62-91ec-160fad0aa7fa tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "161fa35c-1f33-4ea7-94a9-c3b78952155e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.124s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:16 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:24:16 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] <== connect_volume: return (1846ms) {'type': 'block', 'scsi_wwn': '26365383735616333', 'path': '/dev/sdi'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:24:16 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365383735616333', 'path': '/dev/sdi'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:24:16 user nova-compute[72150]: DEBUG nova.objects.instance [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lazy-loading 'flavor' on Instance uuid ad033976-bfc8-46b9-89bf-f752ae0cdf01 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:24:16 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:24:16 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:24:16 user nova-compute[72150]:   <source dev="/dev/sdi"/>
Aug 01 18:24:16 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:24:16 user nova-compute[72150]:   <serial>afc8f281-a010-4b93-82cc-3f0aeb2aa78f</serial>
Aug 01 18:24:16 user nova-compute[72150]: </disk>
Aug 01 18:24:16 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:24:16 user nova-compute[72150]: DEBUG nova.compute.manager [req-0c8e383c-5998-4412-9da6-7ba18178fc5d req-91513ed6-fa32-4a81-9c09-86ebb9787dd5 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Received event network-vif-plugged-b3e91864-9951-4277-aa80-80fd19c4f3bd {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0c8e383c-5998-4412-9da6-7ba18178fc5d req-91513ed6-fa32-4a81-9c09-86ebb9787dd5 service nova] Acquiring lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0c8e383c-5998-4412-9da6-7ba18178fc5d req-91513ed6-fa32-4a81-9c09-86ebb9787dd5 service nova] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0c8e383c-5998-4412-9da6-7ba18178fc5d req-91513ed6-fa32-4a81-9c09-86ebb9787dd5 service nova] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:16 user nova-compute[72150]: DEBUG nova.compute.manager [req-0c8e383c-5998-4412-9da6-7ba18178fc5d req-91513ed6-fa32-4a81-9c09-86ebb9787dd5 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] No waiting events found dispatching network-vif-plugged-b3e91864-9951-4277-aa80-80fd19c4f3bd {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:24:16 user nova-compute[72150]: WARNING nova.compute.manager [req-0c8e383c-5998-4412-9da6-7ba18178fc5d req-91513ed6-fa32-4a81-9c09-86ebb9787dd5 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Received unexpected event network-vif-plugged-b3e91864-9951-4277-aa80-80fd19c4f3bd for instance with vm_state active and task_state None.
Aug 01 18:24:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Acquiring lock "161fa35c-1f33-4ea7-94a9-c3b78952155e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "161fa35c-1f33-4ea7-94a9-c3b78952155e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Acquiring lock "161fa35c-1f33-4ea7-94a9-c3b78952155e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "161fa35c-1f33-4ea7-94a9-c3b78952155e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "161fa35c-1f33-4ea7-94a9-c3b78952155e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:16 user nova-compute[72150]: INFO nova.compute.manager [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Terminating instance
Aug 01 18:24:16 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] No VIF found with MAC fa:16:3e:86:2e:4d, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG nova.compute.manager [req-4707d7eb-2338-41b7-a942-62a28c560bb5 req-896f5859-047f-419a-954b-6774f89a2d56 service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Received event network-vif-unplugged-60b7ef01-f473-4729-8863-446ced3b583a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4707d7eb-2338-41b7-a942-62a28c560bb5 req-896f5859-047f-419a-954b-6774f89a2d56 service nova] Acquiring lock "161fa35c-1f33-4ea7-94a9-c3b78952155e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4707d7eb-2338-41b7-a942-62a28c560bb5 req-896f5859-047f-419a-954b-6774f89a2d56 service nova] Lock "161fa35c-1f33-4ea7-94a9-c3b78952155e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4707d7eb-2338-41b7-a942-62a28c560bb5 req-896f5859-047f-419a-954b-6774f89a2d56 service nova] Lock "161fa35c-1f33-4ea7-94a9-c3b78952155e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG nova.compute.manager [req-4707d7eb-2338-41b7-a942-62a28c560bb5 req-896f5859-047f-419a-954b-6774f89a2d56 service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] No waiting events found dispatching network-vif-unplugged-60b7ef01-f473-4729-8863-446ced3b583a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG nova.compute.manager [req-4707d7eb-2338-41b7-a942-62a28c560bb5 req-896f5859-047f-419a-954b-6774f89a2d56 service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Received event network-vif-unplugged-60b7ef01-f473-4729-8863-446ced3b583a for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-21a6269a-5e90-41ad-8a0d-518cb82dc2a0 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.177s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:17 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Instance destroyed successfully.
Aug 01 18:24:17 user nova-compute[72150]: DEBUG nova.objects.instance [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lazy-loading 'resources' on Instance uuid 161fa35c-1f33-4ea7-94a9-c3b78952155e {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:21:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1586121735',display_name='tempest-AttachSCSIVolumeTestJSON-server-1586121735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1586121735',id=5,image_ref='120c1fb6-662b-491f-ac88-bd1183481042',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH3hSaVqi10VPaXTMPUbv5vCl8GKYGKxRwmnL/rhXtfzbY8ZMIH7zzEYYoAAcheJRRmQLt2lz6E7TQKvLAtflAjlsZTrVU6yjGkm1aF9RmpeRzUjnSXyxzmGvMkEDV1Pw==',key_name='tempest-keypair-1236896563',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:22:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dac43f7be3cd43368a5c03411059c933',ramdisk_id='',reservation_id='r-y86to474',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='120c1fb6-662b-491f-ac88-bd1183481042',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1328185242',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1328185242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:22:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a704b33afa884146b6c55f6dd8534db0',uuid=161fa35c-1f33-4ea7-94a9-c3b78952155e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60b7ef01-f473-4729-8863-446ced3b583a", "address": "fa:16:3e:fb:db:7f", "network": {"id": "1d6b993c-de21-483f-9a8a-609bf15eb582", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1811936764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac43f7be3cd43368a5c03411059c933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b7ef01-f4", "ovs_interfaceid": "60b7ef01-f473-4729-8863-446ced3b583a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Converting VIF {"id": "60b7ef01-f473-4729-8863-446ced3b583a", "address": "fa:16:3e:fb:db:7f", "network": {"id": "1d6b993c-de21-483f-9a8a-609bf15eb582", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1811936764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac43f7be3cd43368a5c03411059c933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b7ef01-f4", "ovs_interfaceid": "60b7ef01-f473-4729-8863-446ced3b583a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:db:7f,bridge_name='br-int',has_traffic_filtering=True,id=60b7ef01-f473-4729-8863-446ced3b583a,network=Network(1d6b993c-de21-483f-9a8a-609bf15eb582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b7ef01-f4') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG os_vif [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:db:7f,bridge_name='br-int',has_traffic_filtering=True,id=60b7ef01-f473-4729-8863-446ced3b583a,network=Network(1d6b993c-de21-483f-9a8a-609bf15eb582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b7ef01-f4') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60b7ef01-f4, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:17 user nova-compute[72150]: INFO os_vif [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:db:7f,bridge_name='br-int',has_traffic_filtering=True,id=60b7ef01-f473-4729-8863-446ced3b583a,network=Network(1d6b993c-de21-483f-9a8a-609bf15eb582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b7ef01-f4')
Aug 01 18:24:17 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Deleting instance files /opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e_del
Aug 01 18:24:17 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Deletion of /opt/stack/data/nova/instances/161fa35c-1f33-4ea7-94a9-c3b78952155e_del complete
Aug 01 18:24:17 user nova-compute[72150]: INFO nova.compute.manager [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 01 18:24:17 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:24:17 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:24:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Acquiring lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG os_brick.utils [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cd9450-32f7-4c2c-aed2-84ae6e839901]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cf037d-c905-4bec-b067-beaed1e6b215]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:19 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Took 1.20 seconds to deallocate network for instance.
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bffd1d-b49f-4bcc-bd45-bae6f7b68693]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c26ada-d012-49df-b618-baf085ad36fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:24:19 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[efde0432-5a82-4d6d-9861-a59b2baf960a]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG os_brick.utils [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:19 user nova-compute[72150]: INFO nova.compute.manager [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Swapping volume afc8f281-a010-4b93-82cc-3f0aeb2aa78f for 2ed9481b-9cda-45fe-97e3-404e5572f3d0
Aug 01 18:24:19 user nova-compute[72150]: DEBUG nova.compute.manager [req-6503aaf7-1b16-4846-b45a-c8fa5890e06c req-d9d4093b-e720-4cb4-83f2-d0d0ec7e3e90 service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Received event network-vif-plugged-60b7ef01-f473-4729-8863-446ced3b583a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6503aaf7-1b16-4846-b45a-c8fa5890e06c req-d9d4093b-e720-4cb4-83f2-d0d0ec7e3e90 service nova] Acquiring lock "161fa35c-1f33-4ea7-94a9-c3b78952155e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6503aaf7-1b16-4846-b45a-c8fa5890e06c req-d9d4093b-e720-4cb4-83f2-d0d0ec7e3e90 service nova] Lock "161fa35c-1f33-4ea7-94a9-c3b78952155e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6503aaf7-1b16-4846-b45a-c8fa5890e06c req-d9d4093b-e720-4cb4-83f2-d0d0ec7e3e90 service nova] Lock "161fa35c-1f33-4ea7-94a9-c3b78952155e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG nova.compute.manager [req-6503aaf7-1b16-4846-b45a-c8fa5890e06c req-d9d4093b-e720-4cb4-83f2-d0d0ec7e3e90 service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] No waiting events found dispatching network-vif-plugged-60b7ef01-f473-4729-8863-446ced3b583a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:24:19 user nova-compute[72150]: WARNING nova.compute.manager [req-6503aaf7-1b16-4846-b45a-c8fa5890e06c req-d9d4093b-e720-4cb4-83f2-d0d0ec7e3e90 service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Received unexpected event network-vif-plugged-60b7ef01-f473-4729-8863-446ced3b583a for instance with vm_state deleted and task_state None.
Aug 01 18:24:19 user nova-compute[72150]: DEBUG nova.compute.manager [req-6503aaf7-1b16-4846-b45a-c8fa5890e06c req-d9d4093b-e720-4cb4-83f2-d0d0ec7e3e90 service nova] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Received event network-vif-deleted-60b7ef01-f473-4729-8863-446ced3b583a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.519s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:19 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Deleted allocations for instance 161fa35c-1f33-4ea7-94a9-c3b78952155e
Aug 01 18:24:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bbb3efe9-c98c-47a4-ad1b-0391de397509 tempest-AttachSCSIVolumeTestJSON-1328185242 tempest-AttachSCSIVolumeTestJSON-1328185242-project-member] Lock "161fa35c-1f33-4ea7-94a9-c3b78952155e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.982s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:25 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:24:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:25 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:24:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:24:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:24:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:24:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:24:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:24:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:24:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:24:26 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/214cf2f9-8bb2-431c-b5f4-15fc2fa526ed/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/214cf2f9-8bb2-431c-b5f4-15fc2fa526ed/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/214cf2f9-8bb2-431c-b5f4-15fc2fa526ed/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/214cf2f9-8bb2-431c-b5f4-15fc2fa526ed/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:27 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:24:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:28 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:24:28 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:24:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=7456MB free_disk=25.782306671142578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:24:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 050260e0-53e0-43dd-a301-a4e3e411f34d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:24:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 554b19ce-2ea6-4494-bdd9-a02444ca920e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:24:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ad033976-bfc8-46b9-89bf-f752ae0cdf01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:24:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:24:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 56ad8a5d-4046-463d-9259-67014867ebfe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:24:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 39ed0e93-df10-4f34-b13a-66a1825d21b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:24:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance e298ac85-ebe3-4aa1-ae1e-91134e13e230 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:24:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 9a4c69c1-6d13-4428-9460-be5988aa0b16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:24:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:24:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:24:28 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:24:28 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:24:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:24:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYDdZqQw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ad033976-bfc8-46b9-89bf-f752ae0cdf01', 'attached_at': '', 'detached_at': '', 'volume_id': '2ed9481b-9cda-45fe-97e3-404e5572f3d0', 'serial': '2ed9481b-9cda-45fe-97e3-404e5572f3d0'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNpGQZqs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'ad033976-bfc8-46b9-89bf-f752ae0cdf01', 'attached_at': '', 'detached_at': '', 'volume_id': 'afc8f281-a010-4b93-82cc-3f0aeb2aa78f', 'serial'} {{(pid=72150) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYDdZqQw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:24:29 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:24:29 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:24:29 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7886e3f2-b65c-4bea-aef8-561f4f676b53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:24:29 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a583d861-0321-48d3-8a41-1767ef14a133]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0] added
Aug 01 18:24:29 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b07227-963f-4f9f-bbac-0c467a2bc1ca]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a732249-3030-4276-bce6-cee5dacfbbee]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XYDdZqQw {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XYDdZqQw" returned: 0 in 0.083s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d4a662-4bd2-400c-aa11-fd02fee29b01]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XYDdZqQw'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fe823b-f34d-4adc-b3c5-0c5bb3e15533]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b91b13d-2650-4359-a85b-8ce985cb8a0d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[985a4568-b341-4177-8342-0bfaf741e7ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0, portal: 172.16.0.220,3260]
Aug 01 18:24:29 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0, portal: 172.16.0.220,3260] successful.
Aug 01 18:24:29 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec732ad-3f57-4494-a5da-b72090c7fd95]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3e6575-b8b9-4ba2-a39c-64b5746984bf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:29 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.400s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] HCTL ('41', '-', '-', 0) found on session 15 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[430173d2-3a92-4003-99f1-b307cc5276db]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Searching for a device in session 15 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYDdZqQw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:24:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:24:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Acquiring lock "214cf2f9-8bb2-431c-b5f4-15fc2fa526ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Lock "214cf2f9-8bb2-431c-b5f4-15fc2fa526ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Acquiring lock "214cf2f9-8bb2-431c-b5f4-15fc2fa526ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Lock "214cf2f9-8bb2-431c-b5f4-15fc2fa526ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Lock "214cf2f9-8bb2-431c-b5f4-15fc2fa526ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:24:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] <== connect_volume: return (1447ms) {'type': 'block', 'scsi_wwn': '23063353333653461', 'path': '/dev/sdj'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:24:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063353333653461', 'path': '/dev/sdj'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:24:30 user nova-compute[72150]: INFO nova.compute.manager [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Terminating instance
Aug 01 18:24:30 user nova-compute[72150]: DEBUG nova.compute.manager [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:24:30 user nova-compute[72150]: DEBUG nova.objects.instance [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Lazy-loading 'flavor' on Instance uuid ad033976-bfc8-46b9-89bf-f752ae0cdf01 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:24:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:30 user nova-compute[72150]: DEBUG nova.compute.manager [req-ef5c5437-aa77-4914-a362-cc88d186dc4b req-ad29af38-c669-474e-801c-e6f2baf9f1c4 service nova] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Received event network-vif-unplugged-307425fc-ae0c-4e24-aede-f9497c7b21fc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ef5c5437-aa77-4914-a362-cc88d186dc4b req-ad29af38-c669-474e-801c-e6f2baf9f1c4 service nova] Acquiring lock "214cf2f9-8bb2-431c-b5f4-15fc2fa526ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ef5c5437-aa77-4914-a362-cc88d186dc4b req-ad29af38-c669-474e-801c-e6f2baf9f1c4 service nova] Lock "214cf2f9-8bb2-431c-b5f4-15fc2fa526ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ef5c5437-aa77-4914-a362-cc88d186dc4b req-ad29af38-c669-474e-801c-e6f2baf9f1c4 service nova] Lock "214cf2f9-8bb2-431c-b5f4-15fc2fa526ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:30 user nova-compute[72150]: DEBUG nova.compute.manager [req-ef5c5437-aa77-4914-a362-cc88d186dc4b req-ad29af38-c669-474e-801c-e6f2baf9f1c4 service nova] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] No waiting events found dispatching network-vif-unplugged-307425fc-ae0c-4e24-aede-f9497c7b21fc {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:24:30 user nova-compute[72150]: DEBUG nova.compute.manager [req-ef5c5437-aa77-4914-a362-cc88d186dc4b req-ad29af38-c669-474e-801c-e6f2baf9f1c4 service nova] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Received event network-vif-unplugged-307425fc-ae0c-4e24-aede-f9497c7b21fc for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:24:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:24:31 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Instance destroyed successfully.
Aug 01 18:24:31 user nova-compute[72150]: DEBUG nova.objects.instance [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Lazy-loading 'resources' on Instance uuid 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:24:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:22:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1701584882',display_name='tempest-VolumesActionsTest-instance-1701584882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1701584882',id=7,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:22:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a22ea1b3d91a40baa45ba58eda78e6c9',ramdisk_id='',reservation_id='r-l655vzdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1335718488',owner_user_name='tempest-VolumesActionsTest-1335718488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:22:35Z,user_data=None,user_id='f34fd2084e79488f92afe91deefa4d6c',uuid=214cf2f9-8bb2-431c-b5f4-15fc2fa526ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "307425fc-ae0c-4e24-aede-f9497c7b21fc", "address": "fa:16:3e:22:5c:fb", "network": {"id": "246f10fd-f9be-4514-a4ca-9bf05a878810", "bridge": "br-int", "label": "tempest-VolumesActionsTest-795896996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22ea1b3d91a40baa45ba58eda78e6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307425fc-ae", "ovs_interfaceid": "307425fc-ae0c-4e24-aede-f9497c7b21fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:24:31 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Converting VIF {"id": "307425fc-ae0c-4e24-aede-f9497c7b21fc", "address": "fa:16:3e:22:5c:fb", "network": {"id": "246f10fd-f9be-4514-a4ca-9bf05a878810", "bridge": "br-int", "label": "tempest-VolumesActionsTest-795896996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22ea1b3d91a40baa45ba58eda78e6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307425fc-ae", "ovs_interfaceid": "307425fc-ae0c-4e24-aede-f9497c7b21fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:24:31 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:5c:fb,bridge_name='br-int',has_traffic_filtering=True,id=307425fc-ae0c-4e24-aede-f9497c7b21fc,network=Network(246f10fd-f9be-4514-a4ca-9bf05a878810),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307425fc-ae') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:24:31 user nova-compute[72150]: DEBUG os_vif [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:5c:fb,bridge_name='br-int',has_traffic_filtering=True,id=307425fc-ae0c-4e24-aede-f9497c7b21fc,network=Network(246f10fd-f9be-4514-a4ca-9bf05a878810),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307425fc-ae') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:24:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap307425fc-ae, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:24:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:24:31 user nova-compute[72150]: INFO os_vif [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:5c:fb,bridge_name='br-int',has_traffic_filtering=True,id=307425fc-ae0c-4e24-aede-f9497c7b21fc,network=Network(246f10fd-f9be-4514-a4ca-9bf05a878810),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307425fc-ae')
Aug 01 18:24:31 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Deleting instance files /opt/stack/data/nova/instances/214cf2f9-8bb2-431c-b5f4-15fc2fa526ed_del
Aug 01 18:24:31 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Deletion of /opt/stack/data/nova/instances/214cf2f9-8bb2-431c-b5f4-15fc2fa526ed_del complete
Aug 01 18:24:31 user nova-compute[72150]: INFO nova.compute.manager [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 01 18:24:31 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:24:31 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:24:31 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:24:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] COPY block job progress, current cursor: 138412032 final cursor: 1073741824 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:24:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] COPY block job progress, current cursor: 303038464 final cursor: 1073741824 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:24:32 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:24:32 user nova-compute[72150]: DEBUG nova.compute.manager [req-229a5820-893a-4cd9-87d0-09093eddaf7c req-a22ee0b0-5beb-4c14-907b-7a5332b3be52 service nova] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Received event network-vif-deleted-307425fc-ae0c-4e24-aede-f9497c7b21fc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:32 user nova-compute[72150]: INFO nova.compute.manager [req-229a5820-893a-4cd9-87d0-09093eddaf7c req-a22ee0b0-5beb-4c14-907b-7a5332b3be52 service nova] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Neutron deleted interface 307425fc-ae0c-4e24-aede-f9497c7b21fc; detaching it from the instance and deleting it from the info cache
Aug 01 18:24:32 user nova-compute[72150]: DEBUG nova.network.neutron [req-229a5820-893a-4cd9-87d0-09093eddaf7c req-a22ee0b0-5beb-4c14-907b-7a5332b3be52 service nova] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:24:32 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Took 0.75 seconds to deallocate network for instance.
Aug 01 18:24:32 user nova-compute[72150]: DEBUG nova.compute.manager [req-229a5820-893a-4cd9-87d0-09093eddaf7c req-a22ee0b0-5beb-4c14-907b-7a5332b3be52 service nova] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Detach interface failed, port_id=307425fc-ae0c-4e24-aede-f9497c7b21fc, reason: Instance 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed could not be found. {{(pid=72150) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 18:24:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] COPY block job progress, current cursor: 473956352 final cursor: 1073741824 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:24:32 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:24:32 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:24:32 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914257.7687716, 161fa35c-1f33-4ea7-94a9-c3b78952155e => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:24:32 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] VM Stopped (Lifecycle Event)
Aug 01 18:24:32 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:24:32 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:24:32 user nova-compute[72150]: DEBUG nova.compute.manager [None req-95884b78-97db-4ae0-b824-a508f342377c None None] [instance: 161fa35c-1f33-4ea7-94a9-c3b78952155e] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:24:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:32 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Deleted allocations for instance 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed
Aug 01 18:24:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-050260e0-53e0-43dd-a301-a4e3e411f34d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:24:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-050260e0-53e0-43dd-a301-a4e3e411f34d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:24:32 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:24:33 user nova-compute[72150]: DEBUG nova.compute.manager [req-2ccab012-cf89-4eed-a586-0fee7e654fdd req-ad4809ce-b44b-49c8-8cb0-80469b1bb304 service nova] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Received event network-vif-plugged-307425fc-ae0c-4e24-aede-f9497c7b21fc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2ccab012-cf89-4eed-a586-0fee7e654fdd req-ad4809ce-b44b-49c8-8cb0-80469b1bb304 service nova] Acquiring lock "214cf2f9-8bb2-431c-b5f4-15fc2fa526ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2ccab012-cf89-4eed-a586-0fee7e654fdd req-ad4809ce-b44b-49c8-8cb0-80469b1bb304 service nova] Lock "214cf2f9-8bb2-431c-b5f4-15fc2fa526ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2ccab012-cf89-4eed-a586-0fee7e654fdd req-ad4809ce-b44b-49c8-8cb0-80469b1bb304 service nova] Lock "214cf2f9-8bb2-431c-b5f4-15fc2fa526ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:33 user nova-compute[72150]: DEBUG nova.compute.manager [req-2ccab012-cf89-4eed-a586-0fee7e654fdd req-ad4809ce-b44b-49c8-8cb0-80469b1bb304 service nova] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] No waiting events found dispatching network-vif-plugged-307425fc-ae0c-4e24-aede-f9497c7b21fc {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:24:33 user nova-compute[72150]: WARNING nova.compute.manager [req-2ccab012-cf89-4eed-a586-0fee7e654fdd req-ad4809ce-b44b-49c8-8cb0-80469b1bb304 service nova] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Received unexpected event network-vif-plugged-307425fc-ae0c-4e24-aede-f9497c7b21fc for instance with vm_state deleted and task_state None.
Aug 01 18:24:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f63e83b2-12b3-44d2-ad7f-00b484014d45 tempest-VolumesActionsTest-1335718488 tempest-VolumesActionsTest-1335718488-project-member] Lock "214cf2f9-8bb2-431c-b5f4-15fc2fa526ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.488s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] COPY block job progress, current cursor: 638582784 final cursor: 1073741824 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:24:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] COPY block job progress, current cursor: 747634688 final cursor: 1073741824 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:24:33 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Updating instance_info_cache with network_info: [{"id": "c82387ba-7cc9-4eac-9469-021c80c1c195", "address": "fa:16:3e:ba:0b:96", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82387ba-7c", "ovs_interfaceid": "c82387ba-7cc9-4eac-9469-021c80c1c195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:24:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-050260e0-53e0-43dd-a301-a4e3e411f34d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:24:33 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:24:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] COPY block job progress, current cursor: 932184064 final cursor: 1073741824 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:24:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] COPY block job progress, current cursor: 1070596096 final cursor: 1073741824 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNpGQZqs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:24:35 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:24:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[20200db6-e02c-499b-a75e-82ffda773af1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6da9bc-ba24-400f-a97b-83d739dcce5b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:35 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:35 user nova-compute[72150]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f (non-flash)
Aug 01 18:24:35 user nova-compute[72150]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 (non-flash)
Aug 01 18:24:35 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:35 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:35 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:35 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:35 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:35 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:35 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:35 user nova-compute[72150]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f (non-flash)
Aug 01 18:24:35 user nova-compute[72150]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 (non-flash)
Aug 01 18:24:35 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:35 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:35 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:35 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:35 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:35 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c3803a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f'): ({'sdi'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Removing single pathed devices sdi {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9202c7-3eab-4710-aaf5-6fad316569d2]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c69af9-10c3-475a-a033-2fa498638490]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Flushing IO for device /dev/sdi {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3234323f-42e1-4e8a-90e5-a7fd4b17b23f]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.038s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f676df-6867-4d42-8291-1f9ea70805cc]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] SCSI volumes sdi have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[56213b5e-a0ce-4fff-9c09-78e93b7a22da]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[582cb221-b7b9-4e69-9800-d17a7a06fd6c]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f, portal: 172.16.0.220,3260]
Aug 01 18:24:35 user nova-compute[72150]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f, portal: 172.16.0.220,3260] successful.
Aug 01 18:24:35 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[00420c28-6b30-47c3-8c29-95d4d8e79f2c]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] <== disconnect_volume: return (317ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG nova.compute.manager [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYDdZqQw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'ad033976-bfc8-46b9-89bf-f752ae0cdf01', 'attached_at': '', 'detached_at': '', 'volume_id': '2ed9481b-9cda-45fe-97e3-404e5572f3d0', 'serial'} {{(pid=72150) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 01 18:24:35 user nova-compute[72150]: DEBUG nova.compute.manager [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] swap_volume: removing Cinder connection for volume afc8f281-a010-4b93-82cc-3f0aeb2aa78f {{(pid=72150) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 01 18:24:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:36 user nova-compute[72150]: DEBUG nova.compute.manager [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] swap_volume: Updating volume afc8f281-a010-4b93-82cc-3f0aeb2aa78f BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "XYDdZqQw", "auth_password": "YizbDUQ7FxXcSm", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "2ed9481b-9cda-45fe-97e3-404e5572f3d0"}, "status": "reserved", "instance": "ad033976-bfc8-46b9-89bf-f752ae0cdf01", "attached_at": "", "detached_at": "", "volume_id": "2ed9481b-9cda-45fe-97e3-404e5572f3d0", "serial": "2ed9481b-9cda-45fe-97e3-404e5572f3d0"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '2ed9481b-9cda-45fe-97e3-404e5572f3d0', 'no_device': None, 'attachment_id': '8fa7b9ca-0667-44cf-9888-3e87cf426bba'} {{(pid=72150) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 01 18:24:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-06d491f1-2adc-402d-b5e0-6d575eaf587c tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.934s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Acquiring lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:37 user nova-compute[72150]: DEBUG os_brick.utils [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:24:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1147d25e-aa96-41dd-9ae0-5af0f75167e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c57bad-40d8-42be-a12c-030b417402d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbfcb20-8878-40f3-9460-3e94e72371bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0531d9b1-c4b0-4f9a-889a-57cd176dae1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:24:38 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:24:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:24:38 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:24:38 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffda2c5a-a136-48f5-84c9-fcbed63d0596]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:38 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:24:38 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:24:38 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:24:38 user nova-compute[72150]: DEBUG os_brick.utils [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:24:38 user nova-compute[72150]: INFO nova.compute.manager [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Swapping volume 2ed9481b-9cda-45fe-97e3-404e5572f3d0 for afc8f281-a010-4b93-82cc-3f0aeb2aa78f
Aug 01 18:24:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914271.4312272, 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:24:46 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] VM Stopped (Lifecycle Event)
Aug 01 18:24:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-1924ed65-182d-42d4-98e4-aa94d7957950 None None] [instance: 214cf2f9-8bb2-431c-b5f4-15fc2fa526ed] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNpGQZqs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ad033976-bfc8-46b9-89bf-f752ae0cdf01', 'attached_at': '', 'detached_at': '', 'volume_id': 'afc8f281-a010-4b93-82cc-3f0aeb2aa78f', 'serial': 'afc8f281-a010-4b93-82cc-3f0aeb2aa78f'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYDdZqQw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '2ed9481b-9cda-45fe-97e3-404e5572f3d0'}, 'status': 'reserved', 'instance': 'ad033976-bfc8-46b9-89bf-f752ae0cdf01', 'attached_at': '', 'detached_at': '', 'volume_id': '2ed9481b-9cda-45fe-97e3-404e5572f3d0', 'serial'} {{(pid=72150) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNpGQZqs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:24:46 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:24:46 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:24:46 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[66867b26-cc78-4637-aef1-f1dd75d2405b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:24:46 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d36af2-806d-45f7-9943-bd1a38016c5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f] added
Aug 01 18:24:46 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52abae0-722c-4f65-99c5-2885c9211c69]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d280d34-e305-46a3-83a4-47dfacb0a607]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wNpGQZqs {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wNpGQZqs" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbde93c-fdfe-47ef-b308-4a238be4a1ed]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wNpGQZqs'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[377a53d4-54ee-4601-8136-ed37e007175e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2c0b1a-85eb-4e76-957a-9d7815c33ae1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf35035a-cead-4278-9de2-e5c7b9d9f2e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f, portal: 172.16.0.220,3260]
Aug 01 18:24:46 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f, portal: 172.16.0.220,3260] successful.
Aug 01 18:24:46 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bb4417-3422-4893-b37e-bbba4aba69e9]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de88c02-af8d-4a9d-a341-d00bf7a1f465]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:46 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] HCTL ('40', '-', '-', 0) found on session 16 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a93a85-58b2-4f03-a278-f2765e2a5260]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Searching for a device in session 16 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:24:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNpGQZqs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:24:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:24:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26365383735616333', 'path': '/dev/sdi'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:24:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365383735616333', 'path': '/dev/sdi'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:24:47 user nova-compute[72150]: DEBUG nova.objects.instance [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Lazy-loading 'flavor' on Instance uuid ad033976-bfc8-46b9-89bf-f752ae0cdf01 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:24:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:24:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] COPY block job progress, current cursor: 154140672 final cursor: 1073741824 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:24:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] COPY block job progress, current cursor: 211812352 final cursor: 1073741824 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:24:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] COPY block job progress, current cursor: 370147328 final cursor: 1073741824 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:24:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] COPY block job progress, current cursor: 540016640 final cursor: 1073741824 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:24:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] COPY block job progress, current cursor: 668991488 final cursor: 1073741824 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:24:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] COPY block job progress, current cursor: 794820608 final cursor: 1073741824 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:24:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] COPY block job progress, current cursor: 945815552 final cursor: 1073741824 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYDdZqQw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '2ed9481b-9cda-45fe-97e3-404e5572f3d0'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:24:52 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:24:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c9c157-32e0-454e-a378-bc752911d236]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG nova.compute.manager [req-2a970ada-a0b9-4774-b5c0-aea099c778b8 req-eba575e7-0843-4c4e-b2be-4497b412df1e service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-changed-7e74d56b-c054-4c2e-8f0f-6502341a1fac {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG nova.compute.manager [req-2a970ada-a0b9-4774-b5c0-aea099c778b8 req-eba575e7-0843-4c4e-b2be-4497b412df1e service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Refreshing instance network info cache due to event network-changed-7e74d56b-c054-4c2e-8f0f-6502341a1fac. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2a970ada-a0b9-4774-b5c0-aea099c778b8 req-eba575e7-0843-4c4e-b2be-4497b412df1e service nova] Acquiring lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2a970ada-a0b9-4774-b5c0-aea099c778b8 req-eba575e7-0843-4c4e-b2be-4497b412df1e service nova] Acquired lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG nova.network.neutron [req-2a970ada-a0b9-4774-b5c0-aea099c778b8 req-eba575e7-0843-4c4e-b2be-4497b412df1e service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Refreshing network info cache for port 7e74d56b-c054-4c2e-8f0f-6502341a1fac {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[621b04a0-bdf7-4816-8d3c-3b47df3fff6b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:52 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:52 user nova-compute[72150]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 (non-flash)
Aug 01 18:24:52 user nova-compute[72150]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f (non-flash)
Aug 01 18:24:52 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:52 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:52 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:52 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:52 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:52 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:52 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:52 user nova-compute[72150]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 (non-flash)
Aug 01 18:24:52 user nova-compute[72150]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f (non-flash)
Aug 01 18:24:52 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:52 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:52 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:52 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:52 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:52 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c53c5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0'): ({'sdj'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Removing single pathed devices sdj {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9320310c-a8f9-456d-a13c-c9e23466a99c]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4556184-d313-48b4-b9c3-93e7b559882b]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Flushing IO for device /dev/sdj {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[689a6538-b6f3-4f36-89c9-1f57f3afa01b]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.041s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5885586-4942-493b-8c51-c7492bfc75f4]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] SCSI volumes sdj have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[369a22dc-1be0-4aff-9516-bbd25a6f6076]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6d35d8-8a21-443f-9471-58163a7ed1fe]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0, portal: 172.16.0.220,3260]
Aug 01 18:24:52 user nova-compute[72150]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0, portal: 172.16.0.220,3260] successful.
Aug 01 18:24:52 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ed9481b-9cda-45fe-97e3-404e5572f3d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.057s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2292f206-742c-4034-9244-a8688905732e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] <== disconnect_volume: return (402ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:24:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:24:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNpGQZqs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'ad033976-bfc8-46b9-89bf-f752ae0cdf01', 'attached_at': '', 'detached_at': '', 'volume_id': 'afc8f281-a010-4b93-82cc-3f0aeb2aa78f', 'serial'} {{(pid=72150) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 01 18:24:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] swap_volume: removing Cinder connection for volume 2ed9481b-9cda-45fe-97e3-404e5572f3d0 {{(pid=72150) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 01 18:24:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:53 user nova-compute[72150]: DEBUG nova.network.neutron [req-2a970ada-a0b9-4774-b5c0-aea099c778b8 req-eba575e7-0843-4c4e-b2be-4497b412df1e service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Updated VIF entry in instance network info cache for port 7e74d56b-c054-4c2e-8f0f-6502341a1fac. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:24:53 user nova-compute[72150]: DEBUG nova.network.neutron [req-2a970ada-a0b9-4774-b5c0-aea099c778b8 req-eba575e7-0843-4c4e-b2be-4497b412df1e service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Updating instance_info_cache with network_info: [{"id": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "address": "fa:16:3e:92:3a:b2", "network": {"id": "e17eb56a-a429-4b1b-a469-106a0e453e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-502389898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e74d56b-c0", "ovs_interfaceid": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "address": "fa:16:3e:b7:55:d4", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2976671-7a", "ovs_interfaceid": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "address": "fa:16:3e:4d:a2:31", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11da1cb-a4", "ovs_interfaceid": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "624f99f7-d827-4106-9ffc-f57b26c45b5c", "address": "fa:16:3e:6e:78:7e", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624f99f7-d8", "ovs_interfaceid": "624f99f7-d827-4106-9ffc-f57b26c45b5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "address": "fa:16:3e:53:16:5f", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5fca36-38", "ovs_interfaceid": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af62c1f6-4440-4109-92b3-80721228f311", "address": "fa:16:3e:0a:89:2e", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf62c1f6-44", "ovs_interfaceid": "af62c1f6-4440-4109-92b3-80721228f311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "address": "fa:16:3e:1b:a3:2f", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ea9e27-a7", "ovs_interfaceid": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:24:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2a970ada-a0b9-4774-b5c0-aea099c778b8 req-eba575e7-0843-4c4e-b2be-4497b412df1e service nova] Releasing lock "refresh_cache-56ad8a5d-4046-463d-9259-67014867ebfe" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:24:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] swap_volume: Updating volume 2ed9481b-9cda-45fe-97e3-404e5572f3d0 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "wNpGQZqs", "auth_password": "6Q49jrZlKJYHWS", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "afc8f281-a010-4b93-82cc-3f0aeb2aa78f"}, "status": "reserved", "instance": "ad033976-bfc8-46b9-89bf-f752ae0cdf01", "attached_at": "", "detached_at": "", "volume_id": "afc8f281-a010-4b93-82cc-3f0aeb2aa78f", "serial": "afc8f281-a010-4b93-82cc-3f0aeb2aa78f"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'afc8f281-a010-4b93-82cc-3f0aeb2aa78f', 'no_device': None, 'attachment_id': 'f3c3190e-d91e-4966-a494-f5061c1d7f06'} {{(pid=72150) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 01 18:24:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-836e98a5-e90b-4f0e-8125-a827c242c3e1 tempest-TestVolumeSwap-347208406 tempest-TestVolumeSwap-347208406-project-admin] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.062s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "769690c8-53c5-4057-88a5-fbdbcb930e32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:24:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Acquiring lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:54 user nova-compute[72150]: INFO nova.compute.manager [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Detaching volume afc8f281-a010-4b93-82cc-3f0aeb2aa78f
Aug 01 18:24:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:24:54 user nova-compute[72150]: INFO nova.compute.claims [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Claim successful on node user
Aug 01 18:24:54 user nova-compute[72150]: INFO nova.virt.block_device [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Attempting to driver detach volume afc8f281-a010-4b93-82cc-3f0aeb2aa78f from mountpoint /dev/vdb
Aug 01 18:24:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Attempting to detach device vdb from instance ad033976-bfc8-46b9-89bf-f752ae0cdf01 from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:24:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:24:54 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:24:54 user nova-compute[72150]:   <source dev="/dev/sdi"/>
Aug 01 18:24:54 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:24:54 user nova-compute[72150]:   <serial>afc8f281-a010-4b93-82cc-3f0aeb2aa78f</serial>
Aug 01 18:24:54 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:24:54 user nova-compute[72150]: </disk>
Aug 01 18:24:54 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:24:54 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Successfully detached device vdb from instance ad033976-bfc8-46b9-89bf-f752ae0cdf01 from the persistent domain config.
Aug 01 18:24:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ad033976-bfc8-46b9-89bf-f752ae0cdf01 from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:24:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:24:54 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:24:54 user nova-compute[72150]:   <source dev="/dev/sdi"/>
Aug 01 18:24:54 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:24:54 user nova-compute[72150]:   <serial>afc8f281-a010-4b93-82cc-3f0aeb2aa78f</serial>
Aug 01 18:24:54 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:24:54 user nova-compute[72150]: </disk>
Aug 01 18:24:54 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:24:54 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:24:54 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:24:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG nova.network.neutron [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "ea68420b-8362-4df3-b710-cd1cf76adba0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:55 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:24:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690914295.1355762, ad033976-bfc8-46b9-89bf-f752ae0cdf01 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ad033976-bfc8-46b9-89bf-f752ae0cdf01 {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:24:55 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Successfully detached device vdb from instance ad033976-bfc8-46b9-89bf-f752ae0cdf01 from the live domain config.
Aug 01 18:24:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNpGQZqs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'afc8f281-a010-4b93-82cc-3f0aeb2aa78f'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:24:55 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:24:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06c807e-dd97-462a-90c4-5b2bc021aa71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[97053ba9-3e6e-43a5-b24f-c3bd3a00c3b2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:55 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:55 user nova-compute[72150]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f (non-flash)
Aug 01 18:24:55 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:55 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:55 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:55 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:55 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:55 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:55 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:55 user nova-compute[72150]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f (non-flash)
Aug 01 18:24:55 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:55 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:55 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:55 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:55 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:55 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f471c08b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f'): ({'sdi'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Removing single pathed devices sdi {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d998950-cbf2-4fcf-869b-82f00ebced56]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[786c7d1f-df26-46aa-a54a-10200996c0b8]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Flushing IO for device /dev/sdi {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ca4a7e-1bc1-4cdd-9fec-0dbe9f7d3d34]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:24:55 user nova-compute[72150]: INFO nova.compute.claims [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Claim successful on node user
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.045s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf55eb1-de59-4597-a932-c9e92535e304]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] SCSI volumes sdi have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG nova.policy [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '375cd4acff1646f4a5418fb012118600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b70fdffe9e414aa766f7c8f7a20d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:24:55 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Creating image(s)
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "/opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "/opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "/opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d3bd8e-04c3-426d-a048-5e962a4b4069]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[043aa135-136d-4e77-af36-7ad7ec2882c4]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f, portal: 172.16.0.220,3260]
Aug 01 18:24:55 user nova-compute[72150]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f, portal: 172.16.0.220,3260] successful.
Aug 01 18:24:55 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.141s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc8f281-a010-4b93-82cc-3f0aeb2aa78f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e0929b-5bce-43c8-a556-6c966bf1e96a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] <== disconnect_volume: return (429ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.143s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "56ad8a5d-4046-463d-9259-67014867ebfe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:55 user nova-compute[72150]: INFO nova.compute.manager [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Terminating instance
Aug 01 18:24:55 user nova-compute[72150]: DEBUG nova.compute.manager [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk 1073741824" returned: 0 in 0.075s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.217s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Checking if we can resize image /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:24:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.network.neutron [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Successfully created port: b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.787s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Cannot resize image /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.objects.instance [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'migration_context' on Instance uuid 769690c8-53c5-4057-88a5-fbdbcb930e32 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-5f181bbb-59c8-4f0a-b789-6ed807cf7471 req-45402188-45ae-46b8-8b8d-2c50301fdc67 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-unplugged-7e74d56b-c054-4c2e-8f0f-6502341a1fac {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5f181bbb-59c8-4f0a-b789-6ed807cf7471 req-45402188-45ae-46b8-8b8d-2c50301fdc67 service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5f181bbb-59c8-4f0a-b789-6ed807cf7471 req-45402188-45ae-46b8-8b8d-2c50301fdc67 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5f181bbb-59c8-4f0a-b789-6ed807cf7471 req-45402188-45ae-46b8-8b8d-2c50301fdc67 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-5f181bbb-59c8-4f0a-b789-6ed807cf7471 req-45402188-45ae-46b8-8b8d-2c50301fdc67 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-unplugged-7e74d56b-c054-4c2e-8f0f-6502341a1fac {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-5f181bbb-59c8-4f0a-b789-6ed807cf7471 req-45402188-45ae-46b8-8b8d-2c50301fdc67 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-unplugged-7e74d56b-c054-4c2e-8f0f-6502341a1fac for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Ensure instance console log exists: /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:24:56 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:24:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-519d428b-3f41-491c-8b07-40ac22eae0c2 req-87d2cbb5-367b-4224-b7bf-42e10fdbac06 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-unplugged-d2976671-7ae2-4b1a-a3eb-dc87ba628494 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-519d428b-3f41-491c-8b07-40ac22eae0c2 req-87d2cbb5-367b-4224-b7bf-42e10fdbac06 service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-519d428b-3f41-491c-8b07-40ac22eae0c2 req-87d2cbb5-367b-4224-b7bf-42e10fdbac06 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-519d428b-3f41-491c-8b07-40ac22eae0c2 req-87d2cbb5-367b-4224-b7bf-42e10fdbac06 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-519d428b-3f41-491c-8b07-40ac22eae0c2 req-87d2cbb5-367b-4224-b7bf-42e10fdbac06 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-unplugged-d2976671-7ae2-4b1a-a3eb-dc87ba628494 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-519d428b-3f41-491c-8b07-40ac22eae0c2 req-87d2cbb5-367b-4224-b7bf-42e10fdbac06 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-unplugged-d2976671-7ae2-4b1a-a3eb-dc87ba628494 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.objects.instance [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lazy-loading 'flavor' on Instance uuid ad033976-bfc8-46b9-89bf-f752ae0cdf01 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dae1df55-6f2c-44e1-b356-419282a97779 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.969s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.policy [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '375cd4acff1646f4a5418fb012118600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b70fdffe9e414aa766f7c8f7a20d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:24:56 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Creating image(s)
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "/opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "/opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-f988f8d0-492b-4541-8a7e-2e3c3251814e req-0f8fd21f-6616-4c88-93da-ecda01c21cce service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-unplugged-d11da1cb-a45e-468e-949d-48d3bdc0628b {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f988f8d0-492b-4541-8a7e-2e3c3251814e req-0f8fd21f-6616-4c88-93da-ecda01c21cce service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f988f8d0-492b-4541-8a7e-2e3c3251814e req-0f8fd21f-6616-4c88-93da-ecda01c21cce service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f988f8d0-492b-4541-8a7e-2e3c3251814e req-0f8fd21f-6616-4c88-93da-ecda01c21cce service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-f988f8d0-492b-4541-8a7e-2e3c3251814e req-0f8fd21f-6616-4c88-93da-ecda01c21cce service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-unplugged-d11da1cb-a45e-468e-949d-48d3bdc0628b {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-f988f8d0-492b-4541-8a7e-2e3c3251814e req-0f8fd21f-6616-4c88-93da-ecda01c21cce service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-unplugged-d11da1cb-a45e-468e-949d-48d3bdc0628b for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.165s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.198s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk 1073741824" returned: 0 in 0.087s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.159s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Cannot resize image /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'migration_context' on Instance uuid ea68420b-8362-4df3-b710-cd1cf76adba0 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Ensure instance console log exists: /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:57 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Instance destroyed successfully.
Aug 01 18:24:57 user nova-compute[72150]: DEBUG nova.objects.instance [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lazy-loading 'resources' on Instance uuid 56ad8a5d-4046-463d-9259-67014867ebfe {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Successfully created port: 6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456768924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456768924',id=8,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUYRtnDS+kkO/Rh+VblNErZcbUsvPJke7jxaucFFzSO+Mb+KhBtRbF8QGnbCQ2PxB7iMKA8+jh+37ApV2oMjhrqq3DJgiwkaMbl7zQh8FMnQn8cSlzLcvdfhF5zShzGYw==',key_name='tempest-keypair-1384803495',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:23:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6276f231fd7d45098b6a469e59fe4a22',ramdisk_id='',reservation_id='r-nwls9cju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1387804727',owner_user_name='tempest-TaggedBootDevicesTest-1387804727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315bf50b017b4f9fbe8bfe987fcea8a3',uuid=56ad8a5d-4046-463d-9259-67014867ebfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "address": "fa:16:3e:92:3a:b2", "network": {"id": "e17eb56a-a429-4b1b-a469-106a0e453e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-502389898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e74d56b-c0", "ovs_interfaceid": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converting VIF {"id": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "address": "fa:16:3e:92:3a:b2", "network": {"id": "e17eb56a-a429-4b1b-a469-106a0e453e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-502389898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e74d56b-c0", "ovs_interfaceid": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:3a:b2,bridge_name='br-int',has_traffic_filtering=True,id=7e74d56b-c054-4c2e-8f0f-6502341a1fac,network=Network(e17eb56a-a429-4b1b-a469-106a0e453e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e74d56b-c0') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG os_vif [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:3a:b2,bridge_name='br-int',has_traffic_filtering=True,id=7e74d56b-c054-4c2e-8f0f-6502341a1fac,network=Network(e17eb56a-a429-4b1b-a469-106a0e453e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e74d56b-c0') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e74d56b-c0, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:57 user nova-compute[72150]: INFO os_vif [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:3a:b2,bridge_name='br-int',has_traffic_filtering=True,id=7e74d56b-c054-4c2e-8f0f-6502341a1fac,network=Network(e17eb56a-a429-4b1b-a469-106a0e453e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e74d56b-c0')
Aug 01 18:24:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456768924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456768924',id=8,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUYRtnDS+kkO/Rh+VblNErZcbUsvPJke7jxaucFFzSO+Mb+KhBtRbF8QGnbCQ2PxB7iMKA8+jh+37ApV2oMjhrqq3DJgiwkaMbl7zQh8FMnQn8cSlzLcvdfhF5zShzGYw==',key_name='tempest-keypair-1384803495',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:23:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6276f231fd7d45098b6a469e59fe4a22',ramdisk_id='',reservation_id='r-nwls9cju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1387804727',owner_user_name='tempest-TaggedBootDevicesTest-1387804727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315bf50b017b4f9fbe8bfe987fcea8a3',uuid=56ad8a5d-4046-463d-9259-67014867ebfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "address": "fa:16:3e:b7:55:d4", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2976671-7a", "ovs_interfaceid": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converting VIF {"id": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "address": "fa:16:3e:b7:55:d4", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2976671-7a", "ovs_interfaceid": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:55:d4,bridge_name='br-int',has_traffic_filtering=True,id=d2976671-7ae2-4b1a-a3eb-dc87ba628494,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2976671-7a') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG os_vif [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:55:d4,bridge_name='br-int',has_traffic_filtering=True,id=d2976671-7ae2-4b1a-a3eb-dc87ba628494,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2976671-7a') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2976671-7a, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG nova.network.neutron [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Successfully updated port: b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:57 user nova-compute[72150]: INFO os_vif [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:55:d4,bridge_name='br-int',has_traffic_filtering=True,id=d2976671-7ae2-4b1a-a3eb-dc87ba628494,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2976671-7a')
Aug 01 18:24:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456768924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456768924',id=8,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUYRtnDS+kkO/Rh+VblNErZcbUsvPJke7jxaucFFzSO+Mb+KhBtRbF8QGnbCQ2PxB7iMKA8+jh+37ApV2oMjhrqq3DJgiwkaMbl7zQh8FMnQn8cSlzLcvdfhF5zShzGYw==',key_name='tempest-keypair-1384803495',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:23:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6276f231fd7d45098b6a469e59fe4a22',ramdisk_id='',reservation_id='r-nwls9cju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1387804727',owner_user_name='tempest-TaggedBootDevicesTest-1387804727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315bf50b017b4f9fbe8bfe987fcea8a3',uuid=56ad8a5d-4046-463d-9259-67014867ebfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "address": "fa:16:3e:4d:a2:31", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11da1cb-a4", "ovs_interfaceid": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converting VIF {"id": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "address": "fa:16:3e:4d:a2:31", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11da1cb-a4", "ovs_interfaceid": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a2:31,bridge_name='br-int',has_traffic_filtering=True,id=d11da1cb-a45e-468e-949d-48d3bdc0628b,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd11da1cb-a4') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG os_vif [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a2:31,bridge_name='br-int',has_traffic_filtering=True,id=d11da1cb-a45e-468e-949d-48d3bdc0628b,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd11da1cb-a4') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd11da1cb-a4, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:24:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "refresh_cache-769690c8-53c5-4057-88a5-fbdbcb930e32" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquired lock "refresh_cache-769690c8-53c5-4057-88a5-fbdbcb930e32" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.network.neutron [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:58 user nova-compute[72150]: INFO os_vif [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a2:31,bridge_name='br-int',has_traffic_filtering=True,id=d11da1cb-a45e-468e-949d-48d3bdc0628b,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd11da1cb-a4')
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456768924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456768924',id=8,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUYRtnDS+kkO/Rh+VblNErZcbUsvPJke7jxaucFFzSO+Mb+KhBtRbF8QGnbCQ2PxB7iMKA8+jh+37ApV2oMjhrqq3DJgiwkaMbl7zQh8FMnQn8cSlzLcvdfhF5zShzGYw==',key_name='tempest-keypair-1384803495',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:23:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6276f231fd7d45098b6a469e59fe4a22',ramdisk_id='',reservation_id='r-nwls9cju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1387804727',owner_user_name='tempest-TaggedBootDevicesTest-1387804727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315bf50b017b4f9fbe8bfe987fcea8a3',uuid=56ad8a5d-4046-463d-9259-67014867ebfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "624f99f7-d827-4106-9ffc-f57b26c45b5c", "address": "fa:16:3e:6e:78:7e", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624f99f7-d8", "ovs_interfaceid": "624f99f7-d827-4106-9ffc-f57b26c45b5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converting VIF {"id": "624f99f7-d827-4106-9ffc-f57b26c45b5c", "address": "fa:16:3e:6e:78:7e", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624f99f7-d8", "ovs_interfaceid": "624f99f7-d827-4106-9ffc-f57b26c45b5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:78:7e,bridge_name='br-int',has_traffic_filtering=True,id=624f99f7-d827-4106-9ffc-f57b26c45b5c,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624f99f7-d8') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_vif [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:78:7e,bridge_name='br-int',has_traffic_filtering=True,id=624f99f7-d827-4106-9ffc-f57b26c45b5c,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624f99f7-d8') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap624f99f7-d8, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:58 user nova-compute[72150]: INFO os_vif [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:78:7e,bridge_name='br-int',has_traffic_filtering=True,id=624f99f7-d827-4106-9ffc-f57b26c45b5c,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624f99f7-d8')
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456768924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456768924',id=8,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUYRtnDS+kkO/Rh+VblNErZcbUsvPJke7jxaucFFzSO+Mb+KhBtRbF8QGnbCQ2PxB7iMKA8+jh+37ApV2oMjhrqq3DJgiwkaMbl7zQh8FMnQn8cSlzLcvdfhF5zShzGYw==',key_name='tempest-keypair-1384803495',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:23:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6276f231fd7d45098b6a469e59fe4a22',ramdisk_id='',reservation_id='r-nwls9cju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1387804727',owner_user_name='tempest-TaggedBootDevicesTest-1387804727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315bf50b017b4f9fbe8bfe987fcea8a3',uuid=56ad8a5d-4046-463d-9259-67014867ebfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "address": "fa:16:3e:53:16:5f", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5fca36-38", "ovs_interfaceid": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converting VIF {"id": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "address": "fa:16:3e:53:16:5f", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5fca36-38", "ovs_interfaceid": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:16:5f,bridge_name='br-int',has_traffic_filtering=True,id=9b5fca36-3823-421c-9e7e-bcfb0a4c00ab,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b5fca36-38') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_vif [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:16:5f,bridge_name='br-int',has_traffic_filtering=True,id=9b5fca36-3823-421c-9e7e-bcfb0a4c00ab,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b5fca36-38') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b5fca36-38, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.network.neutron [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:58 user nova-compute[72150]: INFO os_vif [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:16:5f,bridge_name='br-int',has_traffic_filtering=True,id=9b5fca36-3823-421c-9e7e-bcfb0a4c00ab,network=Network(14b293ee-4065-412b-8e50-c43df33872a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b5fca36-38')
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456768924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456768924',id=8,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUYRtnDS+kkO/Rh+VblNErZcbUsvPJke7jxaucFFzSO+Mb+KhBtRbF8QGnbCQ2PxB7iMKA8+jh+37ApV2oMjhrqq3DJgiwkaMbl7zQh8FMnQn8cSlzLcvdfhF5zShzGYw==',key_name='tempest-keypair-1384803495',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:23:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6276f231fd7d45098b6a469e59fe4a22',ramdisk_id='',reservation_id='r-nwls9cju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1387804727',owner_user_name='tempest-TaggedBootDevicesTest-1387804727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315bf50b017b4f9fbe8bfe987fcea8a3',uuid=56ad8a5d-4046-463d-9259-67014867ebfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af62c1f6-4440-4109-92b3-80721228f311", "address": "fa:16:3e:0a:89:2e", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf62c1f6-44", "ovs_interfaceid": "af62c1f6-4440-4109-92b3-80721228f311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converting VIF {"id": "af62c1f6-4440-4109-92b3-80721228f311", "address": "fa:16:3e:0a:89:2e", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf62c1f6-44", "ovs_interfaceid": "af62c1f6-4440-4109-92b3-80721228f311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:89:2e,bridge_name='br-int',has_traffic_filtering=True,id=af62c1f6-4440-4109-92b3-80721228f311,network=Network(29a56d4f-d6b7-48c1-b20f-e2e684773d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf62c1f6-44') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_vif [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:89:2e,bridge_name='br-int',has_traffic_filtering=True,id=af62c1f6-4440-4109-92b3-80721228f311,network=Network(29a56d4f-d6b7-48c1-b20f-e2e684773d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf62c1f6-44') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf62c1f6-44, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:58 user nova-compute[72150]: INFO os_vif [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:89:2e,bridge_name='br-int',has_traffic_filtering=True,id=af62c1f6-4440-4109-92b3-80721228f311,network=Network(29a56d4f-d6b7-48c1-b20f-e2e684773d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf62c1f6-44')
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456768924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456768924',id=8,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUYRtnDS+kkO/Rh+VblNErZcbUsvPJke7jxaucFFzSO+Mb+KhBtRbF8QGnbCQ2PxB7iMKA8+jh+37ApV2oMjhrqq3DJgiwkaMbl7zQh8FMnQn8cSlzLcvdfhF5zShzGYw==',key_name='tempest-keypair-1384803495',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:23:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6276f231fd7d45098b6a469e59fe4a22',ramdisk_id='',reservation_id='r-nwls9cju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1387804727',owner_user_name='tempest-TaggedBootDevicesTest-1387804727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315bf50b017b4f9fbe8bfe987fcea8a3',uuid=56ad8a5d-4046-463d-9259-67014867ebfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "address": "fa:16:3e:1b:a3:2f", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ea9e27-a7", "ovs_interfaceid": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converting VIF {"id": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "address": "fa:16:3e:1b:a3:2f", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ea9e27-a7", "ovs_interfaceid": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a3:2f,bridge_name='br-int',has_traffic_filtering=True,id=13ea9e27-a7e5-4afa-bda3-87c95c480373,network=Network(29a56d4f-d6b7-48c1-b20f-e2e684773d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ea9e27-a7') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_vif [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a3:2f,bridge_name='br-int',has_traffic_filtering=True,id=13ea9e27-a7e5-4afa-bda3-87c95c480373,network=Network(29a56d4f-d6b7-48c1-b20f-e2e684773d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ea9e27-a7') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13ea9e27-a7, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:24:58 user nova-compute[72150]: INFO os_vif [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a3:2f,bridge_name='br-int',has_traffic_filtering=True,id=13ea9e27-a7e5-4afa-bda3-87c95c480373,network=Network(29a56d4f-d6b7-48c1-b20f-e2e684773d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ea9e27-a7')
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dpAqiOch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:24:58 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c59877-7cdb-4d2c-baed-ee194518ee58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-ce86830d-a4d4-49a5-bc12-3f6a739d96cb req-5c758234-3c3a-42cf-bde4-eb087ff3c0b3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-plugged-7e74d56b-c054-4c2e-8f0f-6502341a1fac {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ce86830d-a4d4-49a5-bc12-3f6a739d96cb req-5c758234-3c3a-42cf-bde4-eb087ff3c0b3 service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ce86830d-a4d4-49a5-bc12-3f6a739d96cb req-5c758234-3c3a-42cf-bde4-eb087ff3c0b3 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ce86830d-a4d4-49a5-bc12-3f6a739d96cb req-5c758234-3c3a-42cf-bde4-eb087ff3c0b3 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-ce86830d-a4d4-49a5-bc12-3f6a739d96cb req-5c758234-3c3a-42cf-bde4-eb087ff3c0b3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-plugged-7e74d56b-c054-4c2e-8f0f-6502341a1fac {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:24:58 user nova-compute[72150]: WARNING nova.compute.manager [req-ce86830d-a4d4-49a5-bc12-3f6a739d96cb req-5c758234-3c3a-42cf-bde4-eb087ff3c0b3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received unexpected event network-vif-plugged-7e74d56b-c054-4c2e-8f0f-6502341a1fac for instance with vm_state active and task_state deleting.
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-ce86830d-a4d4-49a5-bc12-3f6a739d96cb req-5c758234-3c3a-42cf-bde4-eb087ff3c0b3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-unplugged-af62c1f6-4440-4109-92b3-80721228f311 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ce86830d-a4d4-49a5-bc12-3f6a739d96cb req-5c758234-3c3a-42cf-bde4-eb087ff3c0b3 service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ce86830d-a4d4-49a5-bc12-3f6a739d96cb req-5c758234-3c3a-42cf-bde4-eb087ff3c0b3 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ce86830d-a4d4-49a5-bc12-3f6a739d96cb req-5c758234-3c3a-42cf-bde4-eb087ff3c0b3 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-ce86830d-a4d4-49a5-bc12-3f6a739d96cb req-5c758234-3c3a-42cf-bde4-eb087ff3c0b3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-unplugged-af62c1f6-4440-4109-92b3-80721228f311 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-ce86830d-a4d4-49a5-bc12-3f6a739d96cb req-5c758234-3c3a-42cf-bde4-eb087ff3c0b3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-unplugged-af62c1f6-4440-4109-92b3-80721228f311 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-ce86830d-a4d4-49a5-bc12-3f6a739d96cb req-5c758234-3c3a-42cf-bde4-eb087ff3c0b3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-plugged-af62c1f6-4440-4109-92b3-80721228f311 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ce86830d-a4d4-49a5-bc12-3f6a739d96cb req-5c758234-3c3a-42cf-bde4-eb087ff3c0b3 service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ce86830d-a4d4-49a5-bc12-3f6a739d96cb req-5c758234-3c3a-42cf-bde4-eb087ff3c0b3 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ce86830d-a4d4-49a5-bc12-3f6a739d96cb req-5c758234-3c3a-42cf-bde4-eb087ff3c0b3 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-ce86830d-a4d4-49a5-bc12-3f6a739d96cb req-5c758234-3c3a-42cf-bde4-eb087ff3c0b3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-plugged-af62c1f6-4440-4109-92b3-80721228f311 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:24:58 user nova-compute[72150]: WARNING nova.compute.manager [req-ce86830d-a4d4-49a5-bc12-3f6a739d96cb req-5c758234-3c3a-42cf-bde4-eb087ff3c0b3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received unexpected event network-vif-plugged-af62c1f6-4440-4109-92b3-80721228f311 for instance with vm_state active and task_state deleting.
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b03b75-5b5f-4fec-ad18-e47f31165543]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c53df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134'): ({'sdb'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Removing single pathed devices sdb {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[33096cbd-8e7c-469c-a1e3-6e32153cb892]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[99be7f12-39a9-4e6d-869b-0e98bff057cb]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Flushing IO for device /dev/sdb {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c1f53b-39f9-4046-9c09-6be68232d668]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e399325-3872-44ca-883e-17ad70b536be]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe44295-7cc5-45c6-a0ff-af559f1e40ae]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[52575809-98aa-45d1-bd97-80cd245ac1a4]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134, portal: 172.16.0.220,3260]
Aug 01 18:24:58 user nova-compute[72150]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134, portal: 172.16.0.220,3260] successful.
Aug 01 18:24:58 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.network.neutron [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Updating instance_info_cache with network_info: [{"id": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "address": "fa:16:3e:8e:d7:75", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2596e33-c1", "ovs_interfaceid": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4616a37-17ef-4d3d-a9c8-02871bd0b134 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[64de1b63-0a20-480c-820d-34f8eeb5d9ec]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] <== disconnect_volume: return (358ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cXhLHmgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:24:58 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Releasing lock "refresh_cache-769690c8-53c5-4057-88a5-fbdbcb930e32" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Instance network_info: |[{"id": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "address": "fa:16:3e:8e:d7:75", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2596e33-c1", "ovs_interfaceid": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Start _get_guest_xml network_info=[{"id": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "address": "fa:16:3e:8e:d7:75", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2596e33-c1", "ovs_interfaceid": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:24:58 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:24:58 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[615d0308-169c-4040-857c-dd84137c2447]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-plugged-d2976671-7ae2-4b1a-a3eb-dc87ba628494 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-plugged-d2976671-7ae2-4b1a-a3eb-dc87ba628494 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:24:58 user nova-compute[72150]: WARNING nova.compute.manager [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received unexpected event network-vif-plugged-d2976671-7ae2-4b1a-a3eb-dc87ba628494 for instance with vm_state active and task_state deleting.
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-unplugged-13ea9e27-a7e5-4afa-bda3-87c95c480373 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-unplugged-13ea9e27-a7e5-4afa-bda3-87c95c480373 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-unplugged-13ea9e27-a7e5-4afa-bda3-87c95c480373 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received event network-changed-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Refreshing instance network info cache due to event network-changed-b2596e33-c1fc-42ae-ae83-524af44bbb0a. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] Acquiring lock "refresh_cache-769690c8-53c5-4057-88a5-fbdbcb930e32" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] Acquired lock "refresh_cache-769690c8-53c5-4057-88a5-fbdbcb930e32" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.network.neutron [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Refreshing network info cache for port b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-101128963',display_name='tempest-ServerRescueNegativeTestJSON-server-101128963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-101128963',id=12,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0b70fdffe9e414aa766f7c8f7a20d50',ramdisk_id='',reservation_id='r-mwkwhm7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2003578958',owner_user_name='tempest-ServerRescueNegativeTestJSON-2003578958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:24:55Z,user_data=None,user_id='375cd4acff1646f4a5418fb012118600',uuid=769690c8-53c5-4057-88a5-fbdbcb930e32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "address": "fa:16:3e:8e:d7:75", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2596e33-c1", "ovs_interfaceid": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converting VIF {"id": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "address": "fa:16:3e:8e:d7:75", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2596e33-c1", "ovs_interfaceid": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:d7:75,bridge_name='br-int',has_traffic_filtering=True,id=b2596e33-c1fc-42ae-ae83-524af44bbb0a,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2596e33-c1') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.objects.instance [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'pci_devices' on Instance uuid 769690c8-53c5-4057-88a5-fbdbcb930e32 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e888871b-f5ee-4c94-ac30-f1851cd2a106]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f471c0a2710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f'): ({'sdc'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Removing single pathed devices sdc {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:24:58 user nova-compute[72150]:   <uuid>769690c8-53c5-4057-88a5-fbdbcb930e32</uuid>
Aug 01 18:24:58 user nova-compute[72150]:   <name>instance-0000000c</name>
Aug 01 18:24:58 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:24:58 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:24:58 user nova-compute[72150]:   <metadata>
Aug 01 18:24:58 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:24:58 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:24:58 user nova-compute[72150]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-101128963</nova:name>
Aug 01 18:24:58 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:24:58</nova:creationTime>
Aug 01 18:24:58 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:24:58 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:24:58 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:24:58 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:24:58 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:24:58 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:24:58 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:24:58 user nova-compute[72150]:       <nova:owner>
Aug 01 18:24:58 user nova-compute[72150]:         <nova:user uuid="375cd4acff1646f4a5418fb012118600">tempest-ServerRescueNegativeTestJSON-2003578958-project-member</nova:user>
Aug 01 18:24:58 user nova-compute[72150]:         <nova:project uuid="e0b70fdffe9e414aa766f7c8f7a20d50">tempest-ServerRescueNegativeTestJSON-2003578958</nova:project>
Aug 01 18:24:58 user nova-compute[72150]:       </nova:owner>
Aug 01 18:24:58 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:24:58 user nova-compute[72150]:       <nova:ports>
Aug 01 18:24:58 user nova-compute[72150]:         <nova:port uuid="b2596e33-c1fc-42ae-ae83-524af44bbb0a">
Aug 01 18:24:58 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 18:24:58 user nova-compute[72150]:         </nova:port>
Aug 01 18:24:58 user nova-compute[72150]:       </nova:ports>
Aug 01 18:24:58 user nova-compute[72150]:     </nova:instance>
Aug 01 18:24:58 user nova-compute[72150]:   </metadata>
Aug 01 18:24:58 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:24:58 user nova-compute[72150]:     <system>
Aug 01 18:24:58 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:24:58 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:24:58 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:24:58 user nova-compute[72150]:       <entry name="serial">769690c8-53c5-4057-88a5-fbdbcb930e32</entry>
Aug 01 18:24:58 user nova-compute[72150]:       <entry name="uuid">769690c8-53c5-4057-88a5-fbdbcb930e32</entry>
Aug 01 18:24:58 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:24:58 user nova-compute[72150]:     </system>
Aug 01 18:24:58 user nova-compute[72150]:   </sysinfo>
Aug 01 18:24:58 user nova-compute[72150]:   <os>
Aug 01 18:24:58 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:24:58 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:24:58 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:24:58 user nova-compute[72150]:   </os>
Aug 01 18:24:58 user nova-compute[72150]:   <features>
Aug 01 18:24:58 user nova-compute[72150]:     <acpi/>
Aug 01 18:24:58 user nova-compute[72150]:     <apic/>
Aug 01 18:24:58 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:24:58 user nova-compute[72150]:   </features>
Aug 01 18:24:58 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:24:58 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:24:58 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:24:58 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:24:58 user nova-compute[72150]:   </clock>
Aug 01 18:24:58 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:24:58 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:24:58 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:24:58 user nova-compute[72150]:   </cpu>
Aug 01 18:24:58 user nova-compute[72150]:   <devices>
Aug 01 18:24:58 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:24:58 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:24:58 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk"/>
Aug 01 18:24:58 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:24:58 user nova-compute[72150]:     </disk>
Aug 01 18:24:58 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:24:58 user nova-compute[72150]:       <mac address="fa:16:3e:8e:d7:75"/>
Aug 01 18:24:58 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:24:58 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:24:58 user nova-compute[72150]:       <target dev="tapb2596e33-c1"/>
Aug 01 18:24:58 user nova-compute[72150]:     </interface>
Aug 01 18:24:58 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:24:58 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/console.log" append="off"/>
Aug 01 18:24:58 user nova-compute[72150]:     </serial>
Aug 01 18:24:58 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:24:58 user nova-compute[72150]:     <video>
Aug 01 18:24:58 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:24:58 user nova-compute[72150]:     </video>
Aug 01 18:24:58 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:24:58 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:24:58 user nova-compute[72150]:     </rng>
Aug 01 18:24:58 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:24:58 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:24:58 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:24:58 user nova-compute[72150]:     </memballoon>
Aug 01 18:24:58 user nova-compute[72150]:   </devices>
Aug 01 18:24:58 user nova-compute[72150]: </domain>
Aug 01 18:24:58 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-101128963',display_name='tempest-ServerRescueNegativeTestJSON-server-101128963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-101128963',id=12,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0b70fdffe9e414aa766f7c8f7a20d50',ramdisk_id='',reservation_id='r-mwkwhm7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2003578958',owner_user_name='tempest-ServerRescueNegativeTestJSON-2003578958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:24:55Z,user_data=None,user_id='375cd4acff1646f4a5418fb012118600',uuid=769690c8-53c5-4057-88a5-fbdbcb930e32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "address": "fa:16:3e:8e:d7:75", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2596e33-c1", "ovs_interfaceid": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converting VIF {"id": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "address": "fa:16:3e:8e:d7:75", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2596e33-c1", "ovs_interfaceid": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:d7:75,bridge_name='br-int',has_traffic_filtering=True,id=b2596e33-c1fc-42ae-ae83-524af44bbb0a,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2596e33-c1') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_vif [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:d7:75,bridge_name='br-int',has_traffic_filtering=True,id=b2596e33-c1fc-42ae-ae83-524af44bbb0a,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2596e33-c1') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2596e33-c1, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb2596e33-c1, col_values=(('external_ids', {'iface-id': 'b2596e33-c1fc-42ae-ae83-524af44bbb0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:d7:75', 'vm-uuid': '769690c8-53c5-4057-88a5-fbdbcb930e32'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:58 user nova-compute[72150]: INFO os_vif [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:d7:75,bridge_name='br-int',has_traffic_filtering=True,id=b2596e33-c1fc-42ae-ae83-524af44bbb0a,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2596e33-c1')
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abf6f3b-4b12-46d8-86f2-21b92fdf460d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfa0fcb-489b-46b1-8c0d-7e800eb57611]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Flushing IO for device /dev/sdc {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0942bbd-9db8-4678-b398-d9035c3231cb]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] No VIF found with MAC fa:16:3e:8e:d7:75, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-plugged-d11da1cb-a45e-468e-949d-48d3bdc0628b {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-plugged-d11da1cb-a45e-468e-949d-48d3bdc0628b {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:24:58 user nova-compute[72150]: WARNING nova.compute.manager [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received unexpected event network-vif-plugged-d11da1cb-a45e-468e-949d-48d3bdc0628b for instance with vm_state active and task_state deleting.
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-unplugged-624f99f7-d827-4106-9ffc-f57b26c45b5c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-unplugged-624f99f7-d827-4106-9ffc-f57b26c45b5c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-unplugged-624f99f7-d827-4106-9ffc-f57b26c45b5c for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-plugged-624f99f7-d827-4106-9ffc-f57b26c45b5c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-plugged-624f99f7-d827-4106-9ffc-f57b26c45b5c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:24:58 user nova-compute[72150]: WARNING nova.compute.manager [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received unexpected event network-vif-plugged-624f99f7-d827-4106-9ffc-f57b26c45b5c for instance with vm_state active and task_state deleting.
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-unplugged-9b5fca36-3823-421c-9e7e-bcfb0a4c00ab {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-unplugged-9b5fca36-3823-421c-9e7e-bcfb0a4c00ab {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-1b74942e-38ed-437c-9a4b-29cfd9050a6a req-50d83c26-d103-4eca-91c9-de62c59c282e service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-unplugged-9b5fca36-3823-421c-9e7e-bcfb0a4c00ab for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f236ce7b-0422-4420-94ec-27d82c5c20e4]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] SCSI volumes sdc have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[136d6f28-650e-4de4-bb9e-9f27d05175ae]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[480dadc1-ee79-49c3-bc51-b0d0b34122f9]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f, portal: 172.16.0.220,3260]
Aug 01 18:24:58 user nova-compute[72150]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f, portal: 172.16.0.220,3260] successful.
Aug 01 18:24:58 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4bd7b1-f8e0-44c5-b6ab-37b4763ccd3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcd7261-c615-4b05-b581-02c505bbc845]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] <== disconnect_volume: return (383ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'acUrAZfO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:24:58 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d00cea-74c6-486e-9660-c020b47d23f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[de84651b-5540-46cc-8324-f880e8c77a34]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:24:58 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c2b6cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9'): ({'sdd'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Removing single pathed devices sdd {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe0be6d-2f58-41d7-9f09-37f7e067bb05]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf55db63-b6b7-4a2a-bc59-30f4b74ea9e8]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Flushing IO for device /dev/sdd {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[babed7a4-abec-44c0-9ccc-871a70411a51]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.network.neutron [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Updated VIF entry in instance network info cache for port b2596e33-c1fc-42ae-ae83-524af44bbb0a. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.network.neutron [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Updating instance_info_cache with network_info: [{"id": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "address": "fa:16:3e:8e:d7:75", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2596e33-c1", "ovs_interfaceid": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.062s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] Releasing lock "refresh_cache-769690c8-53c5-4057-88a5-fbdbcb930e32" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-plugged-13ea9e27-a7e5-4afa-bda3-87c95c480373 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-plugged-13ea9e27-a7e5-4afa-bda3-87c95c480373 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:24:59 user nova-compute[72150]: WARNING nova.compute.manager [req-ed38f44c-ad46-43ad-9955-fec5335387a8 req-a2a03541-d018-4f72-8a34-03c7f2fee9f3 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received unexpected event network-vif-plugged-13ea9e27-a7e5-4afa-bda3-87c95c480373 for instance with vm_state active and task_state deleting.
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f083561-108f-40dc-a603-babdc15e80f2]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] SCSI volumes sdd have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Successfully updated port: 6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fd0300-2664-41f6-8201-37a830e2b602]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "refresh_cache-ea68420b-8362-4df3-b710-cd1cf76adba0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquired lock "refresh_cache-ea68420b-8362-4df3-b710-cd1cf76adba0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb74477-f421-4b85-8734-4111ee9807c7]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9, portal: 172.16.0.220,3260]
Aug 01 18:24:59 user nova-compute[72150]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9, portal: 172.16.0.220,3260] successful.
Aug 01 18:24:59 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8274439e-c3d8-41cc-af90-e53d3ae158a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaa234a-a437-4ffc-b790-aa16628b2b8a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] <== disconnect_volume: return (340ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:24:59 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Deleting instance files /opt/stack/data/nova/instances/56ad8a5d-4046-463d-9259-67014867ebfe_del
Aug 01 18:24:59 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Deletion of /opt/stack/data/nova/instances/56ad8a5d-4046-463d-9259-67014867ebfe_del complete
Aug 01 18:24:59 user nova-compute[72150]: INFO nova.compute.manager [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Took 3.60 seconds to destroy the instance on the hypervisor.
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Updating instance_info_cache with network_info: [{"id": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "address": "fa:16:3e:a6:bd:40", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a63bb1a-08", "ovs_interfaceid": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Releasing lock "refresh_cache-ea68420b-8362-4df3-b710-cd1cf76adba0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Instance network_info: |[{"id": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "address": "fa:16:3e:a6:bd:40", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a63bb1a-08", "ovs_interfaceid": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Start _get_guest_xml network_info=[{"id": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "address": "fa:16:3e:a6:bd:40", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a63bb1a-08", "ovs_interfaceid": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:24:59 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:24:59 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-784211986',display_name='tempest-ServerRescueNegativeTestJSON-server-784211986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-784211986',id=13,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0b70fdffe9e414aa766f7c8f7a20d50',ramdisk_id='',reservation_id='r-wf7l5fq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2003578958',owner_user_name='tempest-ServerRescueNegativeTestJSON-2003578958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:24:56Z,user_data=None,user_id='375cd4acff1646f4a5418fb012118600',uuid=ea68420b-8362-4df3-b710-cd1cf76adba0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "address": "fa:16:3e:a6:bd:40", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a63bb1a-08", "ovs_interfaceid": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converting VIF {"id": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "address": "fa:16:3e:a6:bd:40", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a63bb1a-08", "ovs_interfaceid": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:bd:40,bridge_name='br-int',has_traffic_filtering=True,id=6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a63bb1a-08') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'pci_devices' on Instance uuid ea68420b-8362-4df3-b710-cd1cf76adba0 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:24:59 user nova-compute[72150]:   <uuid>ea68420b-8362-4df3-b710-cd1cf76adba0</uuid>
Aug 01 18:24:59 user nova-compute[72150]:   <name>instance-0000000d</name>
Aug 01 18:24:59 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:24:59 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:24:59 user nova-compute[72150]:   <metadata>
Aug 01 18:24:59 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:24:59 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:24:59 user nova-compute[72150]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-784211986</nova:name>
Aug 01 18:24:59 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:24:59</nova:creationTime>
Aug 01 18:24:59 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:24:59 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:24:59 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:24:59 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:24:59 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:24:59 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:24:59 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:24:59 user nova-compute[72150]:       <nova:owner>
Aug 01 18:24:59 user nova-compute[72150]:         <nova:user uuid="375cd4acff1646f4a5418fb012118600">tempest-ServerRescueNegativeTestJSON-2003578958-project-member</nova:user>
Aug 01 18:24:59 user nova-compute[72150]:         <nova:project uuid="e0b70fdffe9e414aa766f7c8f7a20d50">tempest-ServerRescueNegativeTestJSON-2003578958</nova:project>
Aug 01 18:24:59 user nova-compute[72150]:       </nova:owner>
Aug 01 18:24:59 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:24:59 user nova-compute[72150]:       <nova:ports>
Aug 01 18:24:59 user nova-compute[72150]:         <nova:port uuid="6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a">
Aug 01 18:24:59 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 18:24:59 user nova-compute[72150]:         </nova:port>
Aug 01 18:24:59 user nova-compute[72150]:       </nova:ports>
Aug 01 18:24:59 user nova-compute[72150]:     </nova:instance>
Aug 01 18:24:59 user nova-compute[72150]:   </metadata>
Aug 01 18:24:59 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:24:59 user nova-compute[72150]:     <system>
Aug 01 18:24:59 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:24:59 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:24:59 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:24:59 user nova-compute[72150]:       <entry name="serial">ea68420b-8362-4df3-b710-cd1cf76adba0</entry>
Aug 01 18:24:59 user nova-compute[72150]:       <entry name="uuid">ea68420b-8362-4df3-b710-cd1cf76adba0</entry>
Aug 01 18:24:59 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:24:59 user nova-compute[72150]:     </system>
Aug 01 18:24:59 user nova-compute[72150]:   </sysinfo>
Aug 01 18:24:59 user nova-compute[72150]:   <os>
Aug 01 18:24:59 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:24:59 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:24:59 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:24:59 user nova-compute[72150]:   </os>
Aug 01 18:24:59 user nova-compute[72150]:   <features>
Aug 01 18:24:59 user nova-compute[72150]:     <acpi/>
Aug 01 18:24:59 user nova-compute[72150]:     <apic/>
Aug 01 18:24:59 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:24:59 user nova-compute[72150]:   </features>
Aug 01 18:24:59 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:24:59 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:24:59 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:24:59 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:24:59 user nova-compute[72150]:   </clock>
Aug 01 18:24:59 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:24:59 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:24:59 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:24:59 user nova-compute[72150]:   </cpu>
Aug 01 18:24:59 user nova-compute[72150]:   <devices>
Aug 01 18:24:59 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:24:59 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:24:59 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk"/>
Aug 01 18:24:59 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:24:59 user nova-compute[72150]:     </disk>
Aug 01 18:24:59 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:24:59 user nova-compute[72150]:       <mac address="fa:16:3e:a6:bd:40"/>
Aug 01 18:24:59 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:24:59 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:24:59 user nova-compute[72150]:       <target dev="tap6a63bb1a-08"/>
Aug 01 18:24:59 user nova-compute[72150]:     </interface>
Aug 01 18:24:59 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:24:59 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/console.log" append="off"/>
Aug 01 18:24:59 user nova-compute[72150]:     </serial>
Aug 01 18:24:59 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:24:59 user nova-compute[72150]:     <video>
Aug 01 18:24:59 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:24:59 user nova-compute[72150]:     </video>
Aug 01 18:24:59 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:24:59 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:24:59 user nova-compute[72150]:     </rng>
Aug 01 18:24:59 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:24:59 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:24:59 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:24:59 user nova-compute[72150]:     </memballoon>
Aug 01 18:24:59 user nova-compute[72150]:   </devices>
Aug 01 18:24:59 user nova-compute[72150]: </domain>
Aug 01 18:24:59 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-784211986',display_name='tempest-ServerRescueNegativeTestJSON-server-784211986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-784211986',id=13,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0b70fdffe9e414aa766f7c8f7a20d50',ramdisk_id='',reservation_id='r-wf7l5fq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2003578958',owner_user_name='tempest-ServerRescueNegativeTestJSON-2003578958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:24:56Z,user_data=None,user_id='375cd4acff1646f4a5418fb012118600',uuid=ea68420b-8362-4df3-b710-cd1cf76adba0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "address": "fa:16:3e:a6:bd:40", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a63bb1a-08", "ovs_interfaceid": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converting VIF {"id": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "address": "fa:16:3e:a6:bd:40", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a63bb1a-08", "ovs_interfaceid": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:bd:40,bridge_name='br-int',has_traffic_filtering=True,id=6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a63bb1a-08') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG os_vif [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:bd:40,bridge_name='br-int',has_traffic_filtering=True,id=6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a63bb1a-08') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a63bb1a-08, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6a63bb1a-08, col_values=(('external_ids', {'iface-id': '6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:bd:40', 'vm-uuid': 'ea68420b-8362-4df3-b710-cd1cf76adba0'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:24:59 user nova-compute[72150]: INFO os_vif [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:bd:40,bridge_name='br-int',has_traffic_filtering=True,id=6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a63bb1a-08')
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:24:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] No VIF found with MAC fa:16:3e:a6:bd:40, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:25:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:00 user nova-compute[72150]: DEBUG nova.compute.manager [req-f5eb6758-2f1a-4d13-a421-8da57f972909 req-f65e3342-9396-49a3-aad0-61aabe4ef329 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-plugged-9b5fca36-3823-421c-9e7e-bcfb0a4c00ab {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f5eb6758-2f1a-4d13-a421-8da57f972909 req-f65e3342-9396-49a3-aad0-61aabe4ef329 service nova] Acquiring lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f5eb6758-2f1a-4d13-a421-8da57f972909 req-f65e3342-9396-49a3-aad0-61aabe4ef329 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f5eb6758-2f1a-4d13-a421-8da57f972909 req-f65e3342-9396-49a3-aad0-61aabe4ef329 service nova] Lock "56ad8a5d-4046-463d-9259-67014867ebfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:00 user nova-compute[72150]: DEBUG nova.compute.manager [req-f5eb6758-2f1a-4d13-a421-8da57f972909 req-f65e3342-9396-49a3-aad0-61aabe4ef329 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] No waiting events found dispatching network-vif-plugged-9b5fca36-3823-421c-9e7e-bcfb0a4c00ab {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:00 user nova-compute[72150]: WARNING nova.compute.manager [req-f5eb6758-2f1a-4d13-a421-8da57f972909 req-f65e3342-9396-49a3-aad0-61aabe4ef329 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received unexpected event network-vif-plugged-9b5fca36-3823-421c-9e7e-bcfb0a4c00ab for instance with vm_state active and task_state deleting.
Aug 01 18:25:00 user nova-compute[72150]: DEBUG nova.compute.manager [req-f5eb6758-2f1a-4d13-a421-8da57f972909 req-f65e3342-9396-49a3-aad0-61aabe4ef329 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Received event network-changed-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:00 user nova-compute[72150]: DEBUG nova.compute.manager [req-f5eb6758-2f1a-4d13-a421-8da57f972909 req-f65e3342-9396-49a3-aad0-61aabe4ef329 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Refreshing instance network info cache due to event network-changed-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:25:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f5eb6758-2f1a-4d13-a421-8da57f972909 req-f65e3342-9396-49a3-aad0-61aabe4ef329 service nova] Acquiring lock "refresh_cache-ea68420b-8362-4df3-b710-cd1cf76adba0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:25:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f5eb6758-2f1a-4d13-a421-8da57f972909 req-f65e3342-9396-49a3-aad0-61aabe4ef329 service nova] Acquired lock "refresh_cache-ea68420b-8362-4df3-b710-cd1cf76adba0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:25:00 user nova-compute[72150]: DEBUG nova.network.neutron [req-f5eb6758-2f1a-4d13-a421-8da57f972909 req-f65e3342-9396-49a3-aad0-61aabe4ef329 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Refreshing network info cache for port 6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:25:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:01 user nova-compute[72150]: DEBUG nova.compute.manager [req-ebd269d7-fc4e-41e3-ad6f-573dedb0541c req-792d1ece-de2e-413f-8927-b97d71421ee1 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-deleted-624f99f7-d827-4106-9ffc-f57b26c45b5c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:01 user nova-compute[72150]: INFO nova.compute.manager [req-ebd269d7-fc4e-41e3-ad6f-573dedb0541c req-792d1ece-de2e-413f-8927-b97d71421ee1 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Neutron deleted interface 624f99f7-d827-4106-9ffc-f57b26c45b5c; detaching it from the instance and deleting it from the info cache
Aug 01 18:25:01 user nova-compute[72150]: DEBUG nova.network.neutron [req-ebd269d7-fc4e-41e3-ad6f-573dedb0541c req-792d1ece-de2e-413f-8927-b97d71421ee1 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Updating instance_info_cache with network_info: [{"id": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "address": "fa:16:3e:92:3a:b2", "network": {"id": "e17eb56a-a429-4b1b-a469-106a0e453e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-502389898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e74d56b-c0", "ovs_interfaceid": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "address": "fa:16:3e:b7:55:d4", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2976671-7a", "ovs_interfaceid": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "address": "fa:16:3e:4d:a2:31", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11da1cb-a4", "ovs_interfaceid": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "address": "fa:16:3e:53:16:5f", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5fca36-38", "ovs_interfaceid": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af62c1f6-4440-4109-92b3-80721228f311", "address": "fa:16:3e:0a:89:2e", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf62c1f6-44", "ovs_interfaceid": "af62c1f6-4440-4109-92b3-80721228f311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "address": "fa:16:3e:1b:a3:2f", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ea9e27-a7", "ovs_interfaceid": "13ea9e27-a7e5-4afa-bda3-87c95c480373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:25:01 user nova-compute[72150]: DEBUG nova.compute.manager [req-ebd269d7-fc4e-41e3-ad6f-573dedb0541c req-792d1ece-de2e-413f-8927-b97d71421ee1 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Detach interface failed, port_id=624f99f7-d827-4106-9ffc-f57b26c45b5c, reason: Instance 56ad8a5d-4046-463d-9259-67014867ebfe could not be found. {{(pid=72150) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 18:25:01 user nova-compute[72150]: DEBUG nova.network.neutron [req-f5eb6758-2f1a-4d13-a421-8da57f972909 req-f65e3342-9396-49a3-aad0-61aabe4ef329 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Updated VIF entry in instance network info cache for port 6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:25:01 user nova-compute[72150]: DEBUG nova.network.neutron [req-f5eb6758-2f1a-4d13-a421-8da57f972909 req-f65e3342-9396-49a3-aad0-61aabe4ef329 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Updating instance_info_cache with network_info: [{"id": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "address": "fa:16:3e:a6:bd:40", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a63bb1a-08", "ovs_interfaceid": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:25:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f5eb6758-2f1a-4d13-a421-8da57f972909 req-f65e3342-9396-49a3-aad0-61aabe4ef329 service nova] Releasing lock "refresh_cache-ea68420b-8362-4df3-b710-cd1cf76adba0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:25:01 user nova-compute[72150]: DEBUG nova.compute.manager [req-f5eb6758-2f1a-4d13-a421-8da57f972909 req-f65e3342-9396-49a3-aad0-61aabe4ef329 service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received event network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f5eb6758-2f1a-4d13-a421-8da57f972909 req-f65e3342-9396-49a3-aad0-61aabe4ef329 service nova] Acquiring lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f5eb6758-2f1a-4d13-a421-8da57f972909 req-f65e3342-9396-49a3-aad0-61aabe4ef329 service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f5eb6758-2f1a-4d13-a421-8da57f972909 req-f65e3342-9396-49a3-aad0-61aabe4ef329 service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:01 user nova-compute[72150]: DEBUG nova.compute.manager [req-f5eb6758-2f1a-4d13-a421-8da57f972909 req-f65e3342-9396-49a3-aad0-61aabe4ef329 service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] No waiting events found dispatching network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:01 user nova-compute[72150]: WARNING nova.compute.manager [req-f5eb6758-2f1a-4d13-a421-8da57f972909 req-f65e3342-9396-49a3-aad0-61aabe4ef329 service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received unexpected event network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a for instance with vm_state building and task_state spawning.
Aug 01 18:25:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:02 user nova-compute[72150]: DEBUG nova.compute.manager [req-02e83c48-46e6-4488-a10f-f705c4b616b8 req-78a636e4-7f4a-41b8-bcb8-d0fd2ba56897 service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received event network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-02e83c48-46e6-4488-a10f-f705c4b616b8 req-78a636e4-7f4a-41b8-bcb8-d0fd2ba56897 service nova] Acquiring lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-02e83c48-46e6-4488-a10f-f705c4b616b8 req-78a636e4-7f4a-41b8-bcb8-d0fd2ba56897 service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-02e83c48-46e6-4488-a10f-f705c4b616b8 req-78a636e4-7f4a-41b8-bcb8-d0fd2ba56897 service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:02 user nova-compute[72150]: DEBUG nova.compute.manager [req-02e83c48-46e6-4488-a10f-f705c4b616b8 req-78a636e4-7f4a-41b8-bcb8-d0fd2ba56897 service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] No waiting events found dispatching network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:02 user nova-compute[72150]: WARNING nova.compute.manager [req-02e83c48-46e6-4488-a10f-f705c4b616b8 req-78a636e4-7f4a-41b8-bcb8-d0fd2ba56897 service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received unexpected event network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a for instance with vm_state building and task_state spawning.
Aug 01 18:25:02 user nova-compute[72150]: DEBUG nova.compute.manager [req-02e83c48-46e6-4488-a10f-f705c4b616b8 req-78a636e4-7f4a-41b8-bcb8-d0fd2ba56897 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Received event network-vif-plugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-02e83c48-46e6-4488-a10f-f705c4b616b8 req-78a636e4-7f4a-41b8-bcb8-d0fd2ba56897 service nova] Acquiring lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-02e83c48-46e6-4488-a10f-f705c4b616b8 req-78a636e4-7f4a-41b8-bcb8-d0fd2ba56897 service nova] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-02e83c48-46e6-4488-a10f-f705c4b616b8 req-78a636e4-7f4a-41b8-bcb8-d0fd2ba56897 service nova] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:02 user nova-compute[72150]: DEBUG nova.compute.manager [req-02e83c48-46e6-4488-a10f-f705c4b616b8 req-78a636e4-7f4a-41b8-bcb8-d0fd2ba56897 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] No waiting events found dispatching network-vif-plugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:02 user nova-compute[72150]: WARNING nova.compute.manager [req-02e83c48-46e6-4488-a10f-f705c4b616b8 req-78a636e4-7f4a-41b8-bcb8-d0fd2ba56897 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Received unexpected event network-vif-plugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a for instance with vm_state building and task_state spawning.
Aug 01 18:25:02 user nova-compute[72150]: DEBUG nova.compute.manager [req-02e83c48-46e6-4488-a10f-f705c4b616b8 req-78a636e4-7f4a-41b8-bcb8-d0fd2ba56897 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Received event network-vif-plugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-02e83c48-46e6-4488-a10f-f705c4b616b8 req-78a636e4-7f4a-41b8-bcb8-d0fd2ba56897 service nova] Acquiring lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-02e83c48-46e6-4488-a10f-f705c4b616b8 req-78a636e4-7f4a-41b8-bcb8-d0fd2ba56897 service nova] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-02e83c48-46e6-4488-a10f-f705c4b616b8 req-78a636e4-7f4a-41b8-bcb8-d0fd2ba56897 service nova] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:02 user nova-compute[72150]: DEBUG nova.compute.manager [req-02e83c48-46e6-4488-a10f-f705c4b616b8 req-78a636e4-7f4a-41b8-bcb8-d0fd2ba56897 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] No waiting events found dispatching network-vif-plugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:02 user nova-compute[72150]: WARNING nova.compute.manager [req-02e83c48-46e6-4488-a10f-f705c4b616b8 req-78a636e4-7f4a-41b8-bcb8-d0fd2ba56897 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Received unexpected event network-vif-plugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a for instance with vm_state building and task_state spawning.
Aug 01 18:25:03 user nova-compute[72150]: DEBUG nova.compute.manager [req-0d72de62-a27a-4730-a209-68575d361c0e req-05e27a16-5782-4ebb-9568-0061522ce410 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-deleted-13ea9e27-a7e5-4afa-bda3-87c95c480373 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:03 user nova-compute[72150]: INFO nova.compute.manager [req-0d72de62-a27a-4730-a209-68575d361c0e req-05e27a16-5782-4ebb-9568-0061522ce410 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Neutron deleted interface 13ea9e27-a7e5-4afa-bda3-87c95c480373; detaching it from the instance and deleting it from the info cache
Aug 01 18:25:03 user nova-compute[72150]: DEBUG nova.network.neutron [req-0d72de62-a27a-4730-a209-68575d361c0e req-05e27a16-5782-4ebb-9568-0061522ce410 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Updating instance_info_cache with network_info: [{"id": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "address": "fa:16:3e:92:3a:b2", "network": {"id": "e17eb56a-a429-4b1b-a469-106a0e453e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-502389898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e74d56b-c0", "ovs_interfaceid": "7e74d56b-c054-4c2e-8f0f-6502341a1fac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "address": "fa:16:3e:b7:55:d4", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2976671-7a", "ovs_interfaceid": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "address": "fa:16:3e:4d:a2:31", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11da1cb-a4", "ovs_interfaceid": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "address": "fa:16:3e:53:16:5f", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5fca36-38", "ovs_interfaceid": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af62c1f6-4440-4109-92b3-80721228f311", "address": "fa:16:3e:0a:89:2e", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf62c1f6-44", "ovs_interfaceid": "af62c1f6-4440-4109-92b3-80721228f311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:25:03 user nova-compute[72150]: DEBUG nova.compute.manager [req-0d72de62-a27a-4730-a209-68575d361c0e req-05e27a16-5782-4ebb-9568-0061522ce410 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Detach interface failed, port_id=13ea9e27-a7e5-4afa-bda3-87c95c480373, reason: Instance 56ad8a5d-4046-463d-9259-67014867ebfe could not be found. {{(pid=72150) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 18:25:03 user nova-compute[72150]: DEBUG nova.compute.manager [req-0d72de62-a27a-4730-a209-68575d361c0e req-05e27a16-5782-4ebb-9568-0061522ce410 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-deleted-7e74d56b-c054-4c2e-8f0f-6502341a1fac {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:03 user nova-compute[72150]: INFO nova.compute.manager [req-0d72de62-a27a-4730-a209-68575d361c0e req-05e27a16-5782-4ebb-9568-0061522ce410 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Neutron deleted interface 7e74d56b-c054-4c2e-8f0f-6502341a1fac; detaching it from the instance and deleting it from the info cache
Aug 01 18:25:03 user nova-compute[72150]: DEBUG nova.network.neutron [req-0d72de62-a27a-4730-a209-68575d361c0e req-05e27a16-5782-4ebb-9568-0061522ce410 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Updating instance_info_cache with network_info: [{"id": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "address": "fa:16:3e:b7:55:d4", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2976671-7a", "ovs_interfaceid": "d2976671-7ae2-4b1a-a3eb-dc87ba628494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "address": "fa:16:3e:4d:a2:31", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd11da1cb-a4", "ovs_interfaceid": "d11da1cb-a45e-468e-949d-48d3bdc0628b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "address": "fa:16:3e:53:16:5f", "network": {"id": "14b293ee-4065-412b-8e50-c43df33872a9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1958061986", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5fca36-38", "ovs_interfaceid": "9b5fca36-3823-421c-9e7e-bcfb0a4c00ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af62c1f6-4440-4109-92b3-80721228f311", "address": "fa:16:3e:0a:89:2e", "network": {"id": "29a56d4f-d6b7-48c1-b20f-e2e684773d56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1650152558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6276f231fd7d45098b6a469e59fe4a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf62c1f6-44", "ovs_interfaceid": "af62c1f6-4440-4109-92b3-80721228f311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:25:03 user nova-compute[72150]: DEBUG nova.compute.manager [req-0d72de62-a27a-4730-a209-68575d361c0e req-05e27a16-5782-4ebb-9568-0061522ce410 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Detach interface failed, port_id=7e74d56b-c054-4c2e-8f0f-6502341a1fac, reason: Instance 56ad8a5d-4046-463d-9259-67014867ebfe could not be found. {{(pid=72150) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 18:25:03 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:25:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:03 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Took 4.42 seconds to deallocate network for instance.
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914304.3830779, ea68420b-8362-4df3-b710-cd1cf76adba0 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:25:04 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] VM Resumed (Lifecycle Event)
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:25:04 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Instance spawned successfully.
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:25:04 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Instance spawned successfully.
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:25:04 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914304.387562, ea68420b-8362-4df3-b710-cd1cf76adba0 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:25:04 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] VM Started (Lifecycle Event)
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:25:04 user nova-compute[72150]: INFO nova.compute.manager [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Took 7.92 seconds to spawn the instance on the hypervisor.
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:25:04 user nova-compute[72150]: INFO nova.compute.manager [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Took 9.16 seconds to spawn the instance on the hypervisor.
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:25:04 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914304.3878062, 769690c8-53c5-4057-88a5-fbdbcb930e32 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:25:04 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] VM Resumed (Lifecycle Event)
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:25:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:04 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914304.3891578, 769690c8-53c5-4057-88a5-fbdbcb930e32 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:25:04 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] VM Started (Lifecycle Event)
Aug 01 18:25:04 user nova-compute[72150]: INFO nova.compute.manager [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Took 9.33 seconds to build instance.
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:25:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:25:04 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:25:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d58afb9-42d3-4d16-9b8e-196b6ec00578 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.556s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:04 user nova-compute[72150]: INFO nova.compute.manager [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Took 10.14 seconds to build instance.
Aug 01 18:25:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7dda834c-a5f8-4e98-bdd7-dc5cd68ca604 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.246s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Acquiring lock "554b19ce-2ea6-4494-bdd9-a02444ca920e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Acquiring lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:05 user nova-compute[72150]: INFO nova.compute.manager [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Terminating instance
Aug 01 18:25:05 user nova-compute[72150]: DEBUG nova.compute.manager [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:25:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:05 user nova-compute[72150]: DEBUG nova.compute.manager [req-0cdd2aef-fec3-4a54-909d-95930b156f4b req-c21b72e8-fbad-41e0-b983-0910c49dbd30 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-deleted-af62c1f6-4440-4109-92b3-80721228f311 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:05 user nova-compute[72150]: DEBUG nova.compute.manager [req-0cdd2aef-fec3-4a54-909d-95930b156f4b req-c21b72e8-fbad-41e0-b983-0910c49dbd30 service nova] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Received event network-vif-deleted-9b5fca36-3823-421c-9e7e-bcfb0a4c00ab {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:05 user nova-compute[72150]: DEBUG nova.compute.manager [req-a1cc1255-6d38-4c0b-abdc-a7bcd8c947ee req-0cec8a28-3069-4d00-b92e-dfb31dc929b1 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Received event network-vif-unplugged-ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a1cc1255-6d38-4c0b-abdc-a7bcd8c947ee req-0cec8a28-3069-4d00-b92e-dfb31dc929b1 service nova] Acquiring lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a1cc1255-6d38-4c0b-abdc-a7bcd8c947ee req-0cec8a28-3069-4d00-b92e-dfb31dc929b1 service nova] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a1cc1255-6d38-4c0b-abdc-a7bcd8c947ee req-0cec8a28-3069-4d00-b92e-dfb31dc929b1 service nova] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:05 user nova-compute[72150]: DEBUG nova.compute.manager [req-a1cc1255-6d38-4c0b-abdc-a7bcd8c947ee req-0cec8a28-3069-4d00-b92e-dfb31dc929b1 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] No waiting events found dispatching network-vif-unplugged-ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:05 user nova-compute[72150]: DEBUG nova.compute.manager [req-a1cc1255-6d38-4c0b-abdc-a7bcd8c947ee req-0cec8a28-3069-4d00-b92e-dfb31dc929b1 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Received event network-vif-unplugged-ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:25:06 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Instance destroyed successfully.
Aug 01 18:25:06 user nova-compute[72150]: DEBUG nova.objects.instance [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lazy-loading 'resources' on Instance uuid 554b19ce-2ea6-4494-bdd9-a02444ca920e {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:25:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:21:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-394626827',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-394626827',id=4,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGka8LdSLmSpjhTZLxRAxtcPMCKQajuZ77ZSdnGv3Wn3uuB5MQyyWWolkbZ67FX8/Xq0MR4R0cch8xeVC596/BP8zPK2w+Y90ycK77u4iqCmTXKKtZgqFB/uHq/hsiFKmg==',key_name='tempest-keypair-1974078877',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='914ef466b8524705868c2049eef686d6',ramdisk_id='',reservation_id='r-tmr2ov96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1401298341',owner_user_name='tempest-TaggedAttachmentsTest-1401298341-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82554fe6d3e8493dad052be11ea1f30b',uuid=554b19ce-2ea6-4494-bdd9-a02444ca920e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "address": "fa:16:3e:16:e2:2d", "network": {"id": "b006b5b5-51ee-476d-93d1-0f7c510088da", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1317073326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdd368e-4d", "ovs_interfaceid": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:25:06 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Converting VIF {"id": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "address": "fa:16:3e:16:e2:2d", "network": {"id": "b006b5b5-51ee-476d-93d1-0f7c510088da", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1317073326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "914ef466b8524705868c2049eef686d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecdd368e-4d", "ovs_interfaceid": "ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:25:06 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:e2:2d,bridge_name='br-int',has_traffic_filtering=True,id=ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a,network=Network(b006b5b5-51ee-476d-93d1-0f7c510088da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecdd368e-4d') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:25:06 user nova-compute[72150]: DEBUG os_vif [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:e2:2d,bridge_name='br-int',has_traffic_filtering=True,id=ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a,network=Network(b006b5b5-51ee-476d-93d1-0f7c510088da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecdd368e-4d') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:25:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecdd368e-4d, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:25:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:25:06 user nova-compute[72150]: INFO os_vif [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:e2:2d,bridge_name='br-int',has_traffic_filtering=True,id=ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a,network=Network(b006b5b5-51ee-476d-93d1-0f7c510088da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecdd368e-4d')
Aug 01 18:25:06 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Deleting instance files /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e_del
Aug 01 18:25:06 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Deletion of /opt/stack/data/nova/instances/554b19ce-2ea6-4494-bdd9-a02444ca920e_del complete
Aug 01 18:25:06 user nova-compute[72150]: INFO nova.compute.manager [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 01 18:25:06 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:25:06 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:25:06 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:25:07 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:25:07 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Took 1.38 seconds to deallocate network for instance.
Aug 01 18:25:07 user nova-compute[72150]: DEBUG nova.compute.manager [req-78b3cf67-39d4-4fbc-b80d-15ad19f50410 req-67250dae-d071-4709-b9e2-bd9919a16f14 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Received event network-vif-deleted-ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:07 user nova-compute[72150]: DEBUG nova.compute.manager [req-6414fc14-48ff-44a1-8be2-52294b809e9d req-683b5f99-bfab-4ea2-8b7f-8adae31a65e0 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Received event network-vif-plugged-ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6414fc14-48ff-44a1-8be2-52294b809e9d req-683b5f99-bfab-4ea2-8b7f-8adae31a65e0 service nova] Acquiring lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6414fc14-48ff-44a1-8be2-52294b809e9d req-683b5f99-bfab-4ea2-8b7f-8adae31a65e0 service nova] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6414fc14-48ff-44a1-8be2-52294b809e9d req-683b5f99-bfab-4ea2-8b7f-8adae31a65e0 service nova] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:07 user nova-compute[72150]: DEBUG nova.compute.manager [req-6414fc14-48ff-44a1-8be2-52294b809e9d req-683b5f99-bfab-4ea2-8b7f-8adae31a65e0 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] No waiting events found dispatching network-vif-plugged-ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:07 user nova-compute[72150]: WARNING nova.compute.manager [req-6414fc14-48ff-44a1-8be2-52294b809e9d req-683b5f99-bfab-4ea2-8b7f-8adae31a65e0 service nova] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Received unexpected event network-vif-plugged-ecdd368e-4d7d-4f05-a8b0-81cc40c86e4a for instance with vm_state deleted and task_state None.
Aug 01 18:25:08 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:25:08 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:25:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:08 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Deleted allocations for instance 554b19ce-2ea6-4494-bdd9-a02444ca920e
Aug 01 18:25:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3f5ba7eb-9bd0-438f-b3e5-2aa84f8288b3 tempest-TaggedAttachmentsTest-1401298341 tempest-TaggedAttachmentsTest-1401298341-project-member] Lock "554b19ce-2ea6-4494-bdd9-a02444ca920e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.537s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:12 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914297.8248944, 56ad8a5d-4046-463d-9259-67014867ebfe => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:25:12 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] VM Stopped (Lifecycle Event)
Aug 01 18:25:12 user nova-compute[72150]: DEBUG nova.compute.manager [None req-0391a567-2952-4d84-be3f-32fa737eb387 None None] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:25:13 user nova-compute[72150]: INFO nova.compute.manager [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] [instance: 56ad8a5d-4046-463d-9259-67014867ebfe] Took 10.16 seconds to detach 3 volumes for instance.
Aug 01 18:25:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:14 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:25:14 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:25:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:14 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Deleted allocations for instance 56ad8a5d-4046-463d-9259-67014867ebfe
Aug 01 18:25:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f76854d2-33f9-4706-bd4e-d8bd9696b934 tempest-TaggedBootDevicesTest-1387804727 tempest-TaggedBootDevicesTest-1387804727-project-member] Lock "56ad8a5d-4046-463d-9259-67014867ebfe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 18.825s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914306.164142, 554b19ce-2ea6-4494-bdd9-a02444ca920e => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:25:21 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] VM Stopped (Lifecycle Event)
Aug 01 18:25:21 user nova-compute[72150]: DEBUG nova.compute.manager [None req-c95fbbc0-5e31-4b09-80f4-a9ccc93289ba None None] [instance: 554b19ce-2ea6-4494-bdd9-a02444ca920e] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:21 user nova-compute[72150]: INFO nova.compute.manager [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Unshelving
Aug 01 18:25:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:21 user nova-compute[72150]: INFO nova.virt.block_device [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Booting with volume 97e42f6b-03a1-4846-80a6-e8e08f236253 at /dev/vdc
Aug 01 18:25:21 user nova-compute[72150]: DEBUG os_brick.utils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8de10c3-ce8a-47bc-b055-a8ac206c479d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[081cdf98-adea-4dfd-8862-ab51ccd1f20c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65c2bb8-77d1-44a1-82e7-158b2dc78233]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb93a4e-4f30-4b08-ab3e-dbeef6b91be8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:25:21 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:25:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0fb651-b9b0-47b0-b9d7-377efdb993fc]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG os_brick.utils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:25:21 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Updating existing volume attachment record: 7e81b7bc-a6a0-43e4-ba92-d74620513d13 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:25:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:27 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:25:27 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:25:27 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:25:27 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:25:27 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:25:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:27 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:25:28 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:25:28 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:25:28 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:25:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:28 user nova-compute[72150]: DEBUG nova.objects.instance [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lazy-loading 'flavor' on Instance uuid e298ac85-ebe3-4aa1-ae1e-91134e13e230 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:25:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:29 user nova-compute[72150]: INFO nova.compute.manager [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Attaching volume 4628e1ee-2e16-4255-95e8-c5cc4e6c775a to /dev/vdb
Aug 01 18:25:29 user nova-compute[72150]: DEBUG os_brick.utils [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b68846-8965-4758-95fb-81bd81a4c23a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[641036d4-f40b-40ad-881a-d8c0f8e6abb5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3da48b-4961-40e4-8e2d-d86a21ac2e71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa57bd4-e204-40e3-aa0a-f154b0ec25eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:25:29 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a478ed-d72e-45c7-917d-baa6a6c865f6]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG os_brick.utils [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Updating existing volume attachment record: f387545f-1fd0-4f60-8c6a-0f3dbbb7b14f {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:30 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:25:30 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:25:30 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=7683MB free_disk=25.810298919677734GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:25:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:30 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 050260e0-53e0-43dd-a301-a4e3e411f34d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:25:30 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ad033976-bfc8-46b9-89bf-f752ae0cdf01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:25:30 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 39ed0e93-df10-4f34-b13a-66a1825d21b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:25:30 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance e298ac85-ebe3-4aa1-ae1e-91134e13e230 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:25:30 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 9a4c69c1-6d13-4428-9460-be5988aa0b16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:25:30 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 769690c8-53c5-4057-88a5-fbdbcb930e32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:25:30 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ea68420b-8362-4df3-b710-cd1cf76adba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:25:30 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 3f123d4e-1aec-4aa1-8717-f31305a62a5d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 01 18:25:30 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:25:30 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:25:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:30 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:25:30 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:25:30 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:25:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.290s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:30 user nova-compute[72150]: DEBUG nova.objects.instance [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'pci_requests' on Instance uuid 3f123d4e-1aec-4aa1-8717-f31305a62a5d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:25:30 user nova-compute[72150]: DEBUG nova.objects.instance [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'numa_topology' on Instance uuid 3f123d4e-1aec-4aa1-8717-f31305a62a5d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:25:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:25:30 user nova-compute[72150]: INFO nova.compute.claims [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Claim successful on node user
Aug 01 18:25:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:31 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:25:31 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:25:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:31 user nova-compute[72150]: INFO nova.network.neutron [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Updating port b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 18:25:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:32 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:25:32 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:25:32 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:25:32 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:25:32 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:25:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:25:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquired lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:25:33 user nova-compute[72150]: DEBUG nova.network.neutron [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:25:33 user nova-compute[72150]: DEBUG nova.compute.manager [req-e59fa034-1335-4879-bef4-60365580f4e3 req-7206ee36-4eb4-4dce-bb6a-6369c72b5ad9 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Received event network-changed-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:33 user nova-compute[72150]: DEBUG nova.compute.manager [req-e59fa034-1335-4879-bef4-60365580f4e3 req-7206ee36-4eb4-4dce-bb6a-6369c72b5ad9 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Refreshing instance network info cache due to event network-changed-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:25:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e59fa034-1335-4879-bef4-60365580f4e3 req-7206ee36-4eb4-4dce-bb6a-6369c72b5ad9 service nova] Acquiring lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:25:33 user nova-compute[72150]: DEBUG nova.network.neutron [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Updating instance_info_cache with network_info: [{"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:25:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Releasing lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:25:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:25:33 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Creating image(s)
Aug 01 18:25:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "/opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "/opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:33 user nova-compute[72150]: DEBUG nova.objects.instance [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3f123d4e-1aec-4aa1-8717-f31305a62a5d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:25:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e59fa034-1335-4879-bef4-60365580f4e3 req-7206ee36-4eb4-4dce-bb6a-6369c72b5ad9 service nova] Acquired lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:25:33 user nova-compute[72150]: DEBUG nova.network.neutron [req-e59fa034-1335-4879-bef4-60365580f4e3 req-7206ee36-4eb4-4dce-bb6a-6369c72b5ad9 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Refreshing network info cache for port b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:25:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "cf5630a205e6f5e5a33659f87211df460a806f2f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "cf5630a205e6f5e5a33659f87211df460a806f2f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf5630a205e6f5e5a33659f87211df460a806f2f.part --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:34 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:25:34 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:25:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf5630a205e6f5e5a33659f87211df460a806f2f.part --force-share --output=json" returned: 0 in 0.157s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:34 user nova-compute[72150]: DEBUG nova.virt.images [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] 57df6da1-0e8d-4695-8c9f-330d0cd907aa was qcow2, converting to raw {{(pid=72150) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 18:25:34 user nova-compute[72150]: DEBUG nova.privsep.utils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72150) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 18:25:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cf5630a205e6f5e5a33659f87211df460a806f2f.part /opt/stack/data/nova/instances/_base/cf5630a205e6f5e5a33659f87211df460a806f2f.converted {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-ad033976-bfc8-46b9-89bf-f752ae0cdf01" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:25:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-ad033976-bfc8-46b9-89bf-f752ae0cdf01" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:25:34 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:25:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cf5630a205e6f5e5a33659f87211df460a806f2f.part /opt/stack/data/nova/instances/_base/cf5630a205e6f5e5a33659f87211df460a806f2f.converted" returned: 0 in 1.058s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf5630a205e6f5e5a33659f87211df460a806f2f.converted --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG nova.network.neutron [req-e59fa034-1335-4879-bef4-60365580f4e3 req-7206ee36-4eb4-4dce-bb6a-6369c72b5ad9 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Updated VIF entry in instance network info cache for port b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG nova.network.neutron [req-e59fa034-1335-4879-bef4-60365580f4e3 req-7206ee36-4eb4-4dce-bb6a-6369c72b5ad9 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Updating instance_info_cache with network_info: [{"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf5630a205e6f5e5a33659f87211df460a806f2f.converted --force-share --output=json" returned: 0 in 0.156s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "cf5630a205e6f5e5a33659f87211df460a806f2f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.509s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf5630a205e6f5e5a33659f87211df460a806f2f --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e59fa034-1335-4879-bef4-60365580f4e3 req-7206ee36-4eb4-4dce-bb6a-6369c72b5ad9 service nova] Releasing lock "refresh_cache-3f123d4e-1aec-4aa1-8717-f31305a62a5d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf5630a205e6f5e5a33659f87211df460a806f2f --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "cf5630a205e6f5e5a33659f87211df460a806f2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "cf5630a205e6f5e5a33659f87211df460a806f2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf5630a205e6f5e5a33659f87211df460a806f2f --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Updating instance_info_cache with network_info: [{"id": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "address": "fa:16:3e:86:2e:4d", "network": {"id": "64d2a931-7450-40f4-827a-e54a5db845a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-125648202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b8e37a30724a0186d9b7f126a46b0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8509ce7f-8c", "ovs_interfaceid": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-ad033976-bfc8-46b9-89bf-f752ae0cdf01" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf5630a205e6f5e5a33659f87211df460a806f2f --force-share --output=json" returned: 0 in 0.154s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cf5630a205e6f5e5a33659f87211df460a806f2f,backing_fmt=raw /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cf5630a205e6f5e5a33659f87211df460a806f2f,backing_fmt=raw /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk 1073741824" returned: 0 in 0.054s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "cf5630a205e6f5e5a33659f87211df460a806f2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf5630a205e6f5e5a33659f87211df460a806f2f --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf5630a205e6f5e5a33659f87211df460a806f2f --force-share --output=json" returned: 0 in 0.171s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG nova.objects.instance [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'migration_context' on Instance uuid 3f123d4e-1aec-4aa1-8717-f31305a62a5d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:25:36 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Rebasing disk image.
Aug 01 18:25:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.142s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c -F raw /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:25:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVImtzaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:25:37 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:25:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:25:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:25:37 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:25:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:25:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:25:37 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:25:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9d0406-7546-4a60-b714-927ff503563d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:25:37 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edafcb8-e180-4711-9e92-e30499817379]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a] added
Aug 01 18:25:37 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e47a04-fd00-4cf1-b5e5-0ca01dc57c2a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d85d57-8f73-46ee-94d0-d802a0c9a7d0]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XVImtzaC {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XVImtzaC" returned: 0 in 0.041s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e1cfa8-4fdd-4c3d-b9ce-652c826d77a3]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XVImtzaC'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.054s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b39d02-ac43-4c10-9a67-9b6246bfa219]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca681450-6a89-438e-b81f-7f11c131ce5b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:25:38 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:25:38 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:25:38 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:25:38 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:25:38 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:25:38 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:25:38 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:25:38 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6949a3-e2c4-4e89-992d-32e8c59a756e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a, portal: 172.16.0.220,3260]
Aug 01 18:25:38 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a, portal: 172.16.0.220,3260] successful.
Aug 01 18:25:38 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb10451-74c4-4672-ac01-0fd0ebbf2ef4]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ed9b1e-f23a-43c1-ab7e-adbaa9cb3a3b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:25:38 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:25:38 user nova-compute[72150]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:25:38 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:25:38 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:25:38 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:25:38 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:25:38 user nova-compute[72150]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:25:38 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:25:38 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:25:38 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.422s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.038s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[245e8eb5-7287-4933-9dcb-0648890a3d05]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVImtzaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:25:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c -F raw /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk" returned: 0 in 2.651s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Ensure instance console log exists: /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Start _get_guest_xml network_info=[{"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='95d5b416925aef7927c4a3966021930c',container_format='bare',created_at=2023-08-01T18:23:29Z,direct_url=<?>,disk_format='qcow2',id=57df6da1-0e8d-4695-8c9f-330d0cd907aa,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1003209770-shelved',owner='493923414b464384bb3a1ce3e6f7a2f0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T18:23:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7e81b7bc-a6a0-43e4-ba92-d74620513d13', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvsCrJUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '3f123d4e-1aec-4aa1-8717-f31305a62a5d', 'attached_at': '', 'detached_at': '', 'volume_id': '97e42f6b-03a1-4846-80a6-e8e08f236253', 'serial': '97e42f6b-03a1-4846-80a6-e8e08f236253'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.479s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] <== connect_volume: return (1481ms) {'type': 'block', 'scsi_wwn': '23732663034653666', 'path': '/dev/sdb'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732663034653666', 'path': '/dev/sdb'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.objects.instance [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lazy-loading 'flavor' on Instance uuid e298ac85-ebe3-4aa1-ae1e-91134e13e230 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:25:39 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:25:39 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='95d5b416925aef7927c4a3966021930c',container_format='bare',created_at=2023-08-01T18:23:29Z,direct_url=<?>,disk_format='qcow2',id=57df6da1-0e8d-4695-8c9f-330d0cd907aa,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1003209770-shelved',owner='493923414b464384bb3a1ce3e6f7a2f0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T18:23:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.objects.instance [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3f123d4e-1aec-4aa1-8717-f31305a62a5d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:25:39 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:25:39 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 18:25:39 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:25:39 user nova-compute[72150]:   <serial>4628e1ee-2e16-4255-95e8-c5cc4e6c775a</serial>
Aug 01 18:25:39 user nova-compute[72150]: </disk>
Aug 01 18:25:39 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvsCrJUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:25:39 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:25:39 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:25:39 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cd9511-7e71-4a97-a4b4-59eae2bbfdaa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:25:39 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[16448065-7535-48bf-9cdd-a0df8d3fdd61]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253] added
Aug 01 18:25:39 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fb8315-b03f-413f-9a4b-cd7bf073a22a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c85012-30db-485f-bb54-6e1e417d93d5]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RvsCrJUx {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RvsCrJUx" returned: 0 in 0.027s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a15bf6-7338-4d71-bc01-fe2aeee8c7f3]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RvsCrJUx'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[521c6e8a-886c-41a6-ab19-2f0df31f93be]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddd1feb-4660-4af9-add5-a845d171f1c1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:25:39 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:25:39 user nova-compute[72150]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:25:39 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:25:39 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:25:39 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:25:39 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:25:39 user nova-compute[72150]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:25:39 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:25:39 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:25:39 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e3911f-e291-437c-8f1c-66cd81e2e18d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253, portal: 172.16.0.220,3260]
Aug 01 18:25:39 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253, portal: 172.16.0.220,3260] successful.
Aug 01 18:25:39 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[58502c24-7d89-445d-9d0e-e8f4fb41b3f5]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dbeb36-3d89-414a-920a-399668fe71db]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:25:39 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:25:39 user nova-compute[72150]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:25:39 user nova-compute[72150]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:25:39 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:25:39 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:25:39 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:25:39 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:25:39 user nova-compute[72150]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:25:39 user nova-compute[72150]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:25:39 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:25:39 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:25:39 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.031s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54a4b92-1b5d-40ac-bcf7-05db661339a1]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:25:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvsCrJUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:25:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:25:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:25:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] No VIF found with MAC fa:16:3e:c1:4e:93, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:25:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0900c040-8f27-40d6-8730-f616e1373ba5 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.155s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.475s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:25:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] <== connect_volume: return (1476ms) {'type': 'block', 'scsi_wwn': '26334373135653131', 'path': '/dev/sdc'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:25:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334373135653131', 'path': '/dev/sdc'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:25:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T18:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1003209770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1003209770',id=1,image_ref='57df6da1-0e8d-4695-8c9f-330d0cd907aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1020169864',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:21:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='493923414b464384bb3a1ce3e6f7a2f0',ramdisk_id='',reservation_id='r-6jxlw7xx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849821930',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849821930-project-member',shelved_at='2023-08-01T18:23:33.835905',shelved_host='user',shelved_image_id='57df6da1-0e8d-4695-8c9f-330d0cd907aa'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:25:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5804d69f9f18482f9fe0e0d4d73c4e92',uuid=3f123d4e-1aec-4aa1-8717-f31305a62a5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:25:41 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converting VIF {"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:25:41 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fb:29,bridge_name='br-int',has_traffic_filtering=True,id=b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc6d1a-9b') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:25:41 user nova-compute[72150]: DEBUG nova.objects.instance [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f123d4e-1aec-4aa1-8717-f31305a62a5d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:25:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:25:41 user nova-compute[72150]:   <uuid>3f123d4e-1aec-4aa1-8717-f31305a62a5d</uuid>
Aug 01 18:25:41 user nova-compute[72150]:   <name>instance-00000001</name>
Aug 01 18:25:41 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:25:41 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:25:41 user nova-compute[72150]:   <metadata>
Aug 01 18:25:41 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:25:41 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:25:41 user nova-compute[72150]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1003209770</nova:name>
Aug 01 18:25:41 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:25:39</nova:creationTime>
Aug 01 18:25:41 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:25:41 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:25:41 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:25:41 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:25:41 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:25:41 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:25:41 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:25:41 user nova-compute[72150]:       <nova:owner>
Aug 01 18:25:41 user nova-compute[72150]:         <nova:user uuid="5804d69f9f18482f9fe0e0d4d73c4e92">tempest-AttachVolumeShelveTestJSON-1849821930-project-member</nova:user>
Aug 01 18:25:41 user nova-compute[72150]:         <nova:project uuid="493923414b464384bb3a1ce3e6f7a2f0">tempest-AttachVolumeShelveTestJSON-1849821930</nova:project>
Aug 01 18:25:41 user nova-compute[72150]:       </nova:owner>
Aug 01 18:25:41 user nova-compute[72150]:       <nova:root type="image" uuid="57df6da1-0e8d-4695-8c9f-330d0cd907aa"/>
Aug 01 18:25:41 user nova-compute[72150]:       <nova:ports>
Aug 01 18:25:41 user nova-compute[72150]:         <nova:port uuid="b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17">
Aug 01 18:25:41 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 18:25:41 user nova-compute[72150]:         </nova:port>
Aug 01 18:25:41 user nova-compute[72150]:       </nova:ports>
Aug 01 18:25:41 user nova-compute[72150]:     </nova:instance>
Aug 01 18:25:41 user nova-compute[72150]:   </metadata>
Aug 01 18:25:41 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:25:41 user nova-compute[72150]:     <system>
Aug 01 18:25:41 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:25:41 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:25:41 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:25:41 user nova-compute[72150]:       <entry name="serial">3f123d4e-1aec-4aa1-8717-f31305a62a5d</entry>
Aug 01 18:25:41 user nova-compute[72150]:       <entry name="uuid">3f123d4e-1aec-4aa1-8717-f31305a62a5d</entry>
Aug 01 18:25:41 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:25:41 user nova-compute[72150]:     </system>
Aug 01 18:25:41 user nova-compute[72150]:   </sysinfo>
Aug 01 18:25:41 user nova-compute[72150]:   <os>
Aug 01 18:25:41 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:25:41 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:25:41 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:25:41 user nova-compute[72150]:   </os>
Aug 01 18:25:41 user nova-compute[72150]:   <features>
Aug 01 18:25:41 user nova-compute[72150]:     <acpi/>
Aug 01 18:25:41 user nova-compute[72150]:     <apic/>
Aug 01 18:25:41 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:25:41 user nova-compute[72150]:   </features>
Aug 01 18:25:41 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:25:41 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:25:41 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:25:41 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:25:41 user nova-compute[72150]:   </clock>
Aug 01 18:25:41 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:25:41 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:25:41 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:25:41 user nova-compute[72150]:   </cpu>
Aug 01 18:25:41 user nova-compute[72150]:   <devices>
Aug 01 18:25:41 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:25:41 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:25:41 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk"/>
Aug 01 18:25:41 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:25:41 user nova-compute[72150]:     </disk>
Aug 01 18:25:41 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:25:41 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:25:41 user nova-compute[72150]:       <source dev="/dev/sdc"/>
Aug 01 18:25:41 user nova-compute[72150]:       <target dev="vdc" bus="virtio"/>
Aug 01 18:25:41 user nova-compute[72150]:       <serial>97e42f6b-03a1-4846-80a6-e8e08f236253</serial>
Aug 01 18:25:41 user nova-compute[72150]:     </disk>
Aug 01 18:25:41 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:25:41 user nova-compute[72150]:       <mac address="fa:16:3e:c9:fb:29"/>
Aug 01 18:25:41 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:25:41 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:25:41 user nova-compute[72150]:       <target dev="tapb3bc6d1a-9b"/>
Aug 01 18:25:41 user nova-compute[72150]:     </interface>
Aug 01 18:25:41 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:25:41 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/console.log" append="off"/>
Aug 01 18:25:41 user nova-compute[72150]:     </serial>
Aug 01 18:25:41 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:25:41 user nova-compute[72150]:     <video>
Aug 01 18:25:41 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:25:41 user nova-compute[72150]:     </video>
Aug 01 18:25:41 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:25:41 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:25:41 user nova-compute[72150]:     </rng>
Aug 01 18:25:41 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:25:41 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:25:41 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:25:41 user nova-compute[72150]:     </memballoon>
Aug 01 18:25:41 user nova-compute[72150]:   </devices>
Aug 01 18:25:41 user nova-compute[72150]: </domain>
Aug 01 18:25:41 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:25:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T18:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1003209770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1003209770',id=1,image_ref='57df6da1-0e8d-4695-8c9f-330d0cd907aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1020169864',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:21:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='493923414b464384bb3a1ce3e6f7a2f0',ramdisk_id='',reservation_id='r-6jxlw7xx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849821930',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849821930-project-member',shelved_at='2023-08-01T18:23:33.835905',shelved_host='user',shelved_image_id='57df6da1-0e8d-4695-8c9f-330d0cd907aa'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:25:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5804d69f9f18482f9fe0e0d4d73c4e92',uuid=3f123d4e-1aec-4aa1-8717-f31305a62a5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:25:41 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converting VIF {"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:25:41 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fb:29,bridge_name='br-int',has_traffic_filtering=True,id=b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc6d1a-9b') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:25:41 user nova-compute[72150]: DEBUG os_vif [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fb:29,bridge_name='br-int',has_traffic_filtering=True,id=b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc6d1a-9b') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:25:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:25:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:25:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3bc6d1a-9b, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:25:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3bc6d1a-9b, col_values=(('external_ids', {'iface-id': 'b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:fb:29', 'vm-uuid': '3f123d4e-1aec-4aa1-8717-f31305a62a5d'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:25:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:25:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:41 user nova-compute[72150]: INFO os_vif [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fb:29,bridge_name='br-int',has_traffic_filtering=True,id=b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc6d1a-9b')
Aug 01 18:25:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:25:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:25:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] No VIF found with MAC fa:16:3e:c9:fb:29, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:25:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:42 user nova-compute[72150]: DEBUG nova.compute.manager [req-cbd398f2-1bac-4c42-b214-687f38e19b17 req-df7ad013-f527-45ee-9c1e-6c23664f8848 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Received event network-vif-plugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-cbd398f2-1bac-4c42-b214-687f38e19b17 req-df7ad013-f527-45ee-9c1e-6c23664f8848 service nova] Acquiring lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-cbd398f2-1bac-4c42-b214-687f38e19b17 req-df7ad013-f527-45ee-9c1e-6c23664f8848 service nova] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-cbd398f2-1bac-4c42-b214-687f38e19b17 req-df7ad013-f527-45ee-9c1e-6c23664f8848 service nova] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:42 user nova-compute[72150]: DEBUG nova.compute.manager [req-cbd398f2-1bac-4c42-b214-687f38e19b17 req-df7ad013-f527-45ee-9c1e-6c23664f8848 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] No waiting events found dispatching network-vif-plugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:42 user nova-compute[72150]: WARNING nova.compute.manager [req-cbd398f2-1bac-4c42-b214-687f38e19b17 req-df7ad013-f527-45ee-9c1e-6c23664f8848 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Received unexpected event network-vif-plugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 18:25:43 user nova-compute[72150]: DEBUG nova.compute.manager [req-4c50929a-0331-40ce-b28b-b227c5e7fcf5 req-d94a2a8e-a464-4868-b45d-5f0dbf275ab7 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Received event network-changed-3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:43 user nova-compute[72150]: DEBUG nova.compute.manager [req-4c50929a-0331-40ce-b28b-b227c5e7fcf5 req-d94a2a8e-a464-4868-b45d-5f0dbf275ab7 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Refreshing instance network info cache due to event network-changed-3383d1ec-873d-4660-a685-3d71c2e0092c. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:25:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4c50929a-0331-40ce-b28b-b227c5e7fcf5 req-d94a2a8e-a464-4868-b45d-5f0dbf275ab7 service nova] Acquiring lock "refresh_cache-9a4c69c1-6d13-4428-9460-be5988aa0b16" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:25:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4c50929a-0331-40ce-b28b-b227c5e7fcf5 req-d94a2a8e-a464-4868-b45d-5f0dbf275ab7 service nova] Acquired lock "refresh_cache-9a4c69c1-6d13-4428-9460-be5988aa0b16" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:25:43 user nova-compute[72150]: DEBUG nova.network.neutron [req-4c50929a-0331-40ce-b28b-b227c5e7fcf5 req-d94a2a8e-a464-4868-b45d-5f0dbf275ab7 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Refreshing network info cache for port 3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:25:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:44 user nova-compute[72150]: DEBUG nova.network.neutron [req-4c50929a-0331-40ce-b28b-b227c5e7fcf5 req-d94a2a8e-a464-4868-b45d-5f0dbf275ab7 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Updated VIF entry in instance network info cache for port 3383d1ec-873d-4660-a685-3d71c2e0092c. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:25:44 user nova-compute[72150]: DEBUG nova.network.neutron [req-4c50929a-0331-40ce-b28b-b227c5e7fcf5 req-d94a2a8e-a464-4868-b45d-5f0dbf275ab7 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Updating instance_info_cache with network_info: [{"id": "3383d1ec-873d-4660-a685-3d71c2e0092c", "address": "fa:16:3e:ab:5f:8a", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3383d1ec-87", "ovs_interfaceid": "3383d1ec-873d-4660-a685-3d71c2e0092c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:25:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4c50929a-0331-40ce-b28b-b227c5e7fcf5 req-d94a2a8e-a464-4868-b45d-5f0dbf275ab7 service nova] Releasing lock "refresh_cache-9a4c69c1-6d13-4428-9460-be5988aa0b16" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:25:44 user nova-compute[72150]: INFO nova.compute.manager [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Rebuilding instance
Aug 01 18:25:44 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9a4c69c1-6d13-4428-9460-be5988aa0b16 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:25:44 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:25:44 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lazy-loading 'pci_requests' on Instance uuid 9a4c69c1-6d13-4428-9460-be5988aa0b16 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:25:44 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a4c69c1-6d13-4428-9460-be5988aa0b16 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:25:44 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lazy-loading 'resources' on Instance uuid 9a4c69c1-6d13-4428-9460-be5988aa0b16 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:25:44 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lazy-loading 'migration_context' on Instance uuid 9a4c69c1-6d13-4428-9460-be5988aa0b16 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:25:44 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72150) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 18:25:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Acquiring lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Acquiring lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:44 user nova-compute[72150]: INFO nova.compute.manager [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Terminating instance
Aug 01 18:25:44 user nova-compute[72150]: DEBUG nova.compute.manager [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-6e79e100-d759-4c3e-afe1-609e08297308 req-2e8050e2-870b-460a-9f63-b456185d8d6e service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Received event network-vif-plugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6e79e100-d759-4c3e-afe1-609e08297308 req-2e8050e2-870b-460a-9f63-b456185d8d6e service nova] Acquiring lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6e79e100-d759-4c3e-afe1-609e08297308 req-2e8050e2-870b-460a-9f63-b456185d8d6e service nova] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6e79e100-d759-4c3e-afe1-609e08297308 req-2e8050e2-870b-460a-9f63-b456185d8d6e service nova] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-6e79e100-d759-4c3e-afe1-609e08297308 req-2e8050e2-870b-460a-9f63-b456185d8d6e service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] No waiting events found dispatching network-vif-plugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:45 user nova-compute[72150]: WARNING nova.compute.manager [req-6e79e100-d759-4c3e-afe1-609e08297308 req-2e8050e2-870b-460a-9f63-b456185d8d6e service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Received unexpected event network-vif-plugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 18:25:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914345.2511256, 3f123d4e-1aec-4aa1-8717-f31305a62a5d => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:25:45 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] VM Resumed (Lifecycle Event)
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.compute.manager [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-f478122b-1c6f-47d2-9a87-245433624983 req-db31aa4e-3568-4edd-aeb2-1964e1ab727b service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Received event network-vif-unplugged-3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f478122b-1c6f-47d2-9a87-245433624983 req-db31aa4e-3568-4edd-aeb2-1964e1ab727b service nova] Acquiring lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f478122b-1c6f-47d2-9a87-245433624983 req-db31aa4e-3568-4edd-aeb2-1964e1ab727b service nova] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f478122b-1c6f-47d2-9a87-245433624983 req-db31aa4e-3568-4edd-aeb2-1964e1ab727b service nova] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-f478122b-1c6f-47d2-9a87-245433624983 req-db31aa4e-3568-4edd-aeb2-1964e1ab727b service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] No waiting events found dispatching network-vif-unplugged-3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:45 user nova-compute[72150]: WARNING nova.compute.manager [req-f478122b-1c6f-47d2-9a87-245433624983 req-db31aa4e-3568-4edd-aeb2-1964e1ab727b service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Received unexpected event network-vif-unplugged-3383d1ec-873d-4660-a685-3d71c2e0092c for instance with vm_state active and task_state rebuilding.
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-f478122b-1c6f-47d2-9a87-245433624983 req-db31aa4e-3568-4edd-aeb2-1964e1ab727b service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Received event network-vif-plugged-3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f478122b-1c6f-47d2-9a87-245433624983 req-db31aa4e-3568-4edd-aeb2-1964e1ab727b service nova] Acquiring lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f478122b-1c6f-47d2-9a87-245433624983 req-db31aa4e-3568-4edd-aeb2-1964e1ab727b service nova] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f478122b-1c6f-47d2-9a87-245433624983 req-db31aa4e-3568-4edd-aeb2-1964e1ab727b service nova] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-f478122b-1c6f-47d2-9a87-245433624983 req-db31aa4e-3568-4edd-aeb2-1964e1ab727b service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] No waiting events found dispatching network-vif-plugged-3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:45 user nova-compute[72150]: WARNING nova.compute.manager [req-f478122b-1c6f-47d2-9a87-245433624983 req-db31aa4e-3568-4edd-aeb2-1964e1ab727b service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Received unexpected event network-vif-plugged-3383d1ec-873d-4660-a685-3d71c2e0092c for instance with vm_state active and task_state rebuilding.
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:25:45 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Instance spawned successfully.
Aug 01 18:25:45 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Instance destroyed successfully.
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:25:45 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Instance destroyed successfully.
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:23:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1141577599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1283435186',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+Nn4jIkP7o81KAVSuEafYwZ26XCjfE3kKImFLpIJCuWu6CIp77lxBWVyFrwhzih2blhaPYtQDdQOnjy77eqEv5UzljWf90RHtb08BFC6XddfTDCcic8R7KEtRpk3mn7g==',key_name='tempest-keypair-1383383211',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:24:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4cec5474a64d46c2bfc92435c677abf2',ramdisk_id='',reservation_id='r-wxny26dq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1421721381',owner_user_name='tempest-ServerActionsV293TestJSON-1421721381-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:25:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e312b378dd2b43798193756afb51e343',uuid=9a4c69c1-6d13-4428-9460-be5988aa0b16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3383d1ec-873d-4660-a685-3d71c2e0092c", "address": "fa:16:3e:ab:5f:8a", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3383d1ec-87", "ovs_interfaceid": "3383d1ec-873d-4660-a685-3d71c2e0092c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Converting VIF {"id": "3383d1ec-873d-4660-a685-3d71c2e0092c", "address": "fa:16:3e:ab:5f:8a", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3383d1ec-87", "ovs_interfaceid": "3383d1ec-873d-4660-a685-3d71c2e0092c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:5f:8a,bridge_name='br-int',has_traffic_filtering=True,id=3383d1ec-873d-4660-a685-3d71c2e0092c,network=Network(ac6e56c1-0122-4bc2-b6b2-a76d80894c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3383d1ec-87') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG os_vif [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:5f:8a,bridge_name='br-int',has_traffic_filtering=True,id=3383d1ec-873d-4660-a685-3d71c2e0092c,network=Network(ac6e56c1-0122-4bc2-b6b2-a76d80894c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3383d1ec-87') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3383d1ec-87, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:25:45 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914345.2525704, 3f123d4e-1aec-4aa1-8717-f31305a62a5d => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:25:45 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] VM Started (Lifecycle Event)
Aug 01 18:25:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:45 user nova-compute[72150]: INFO os_vif [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:5f:8a,bridge_name='br-int',has_traffic_filtering=True,id=3383d1ec-873d-4660-a685-3d71c2e0092c,network=Network(ac6e56c1-0122-4bc2-b6b2-a76d80894c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3383d1ec-87')
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWXaJRkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:25:45 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 18:25:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cefaf0-1f29-48ed-a864-0a43f0f49075]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:45 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[02233ce7-1e81-4035-bbd5-d7bd1075335f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:25:45 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:25:45 user nova-compute[72150]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:25:45 user nova-compute[72150]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:25:45 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:25:45 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:25:45 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:25:45 user nova-compute[72150]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:25:45 user nova-compute[72150]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:25:45 user nova-compute[72150]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:25:45 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:25:45 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:25:45 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c1aa680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17'): ({'sdh'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Removing single pathed devices sdh {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1bb9f9-dbe8-493b-b8ea-3b3e29be4209]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.041s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce350f4b-c83a-4ebb-91c8-7bcd7b488fed]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Flushing IO for device /dev/sdh {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ca9eac-ce4e-4fbe-ab3e-6b7409083361]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.083s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.compute.manager [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[246db0e7-8e51-47f9-bb50-d8cbc9464872]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] SCSI volumes sdh have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO20905119-840c1c549079fdd6', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_20905119', '/dev/disk/by-id/scsi-23834306331633534') {{(pid=82940) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c5a5a0-038d-4cfc-a7ab-725a3a816bd9]: (4, None) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[557efdc8-eae7-4a49-8a2d-d9acfb91fe94]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:45 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Instance destroyed successfully.
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.objects.instance [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lazy-loading 'resources' on Instance uuid ad033976-bfc8-46b9-89bf-f752ae0cdf01 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-023aa9aa-7061-44ea-b6f0-72f2191b6049 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.314s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c655ebc-c123-411a-94a9-e66d4527647f]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17, portal: 172.16.0.220,3260]
Aug 01 18:25:45 user nova-compute[72150]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17, portal: 172.16.0.220,3260] successful.
Aug 01 18:25:45 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-983852594',display_name='tempest-TestVolumeSwap-server-983852594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-983852594',id=6,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKN3UJDBvsSCDyxyiABJEe+o7rPvNztF+1CDAjZJdHP3OssRDUtMd4FG3xdPbLXlSgKzwOuj8SVkT3kqGEnKCNOj1qIXrc1OJPhlUiYwemnjTrNa9g73Dds3kAktpXYWg==',key_name='tempest-keypair-523819296',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:22:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6b8e37a30724a0186d9b7f126a46b0d',ramdisk_id='',reservation_id='r-otyndced',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1013643713',owner_user_name='tempest-TestVolumeSwap-1013643713-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:22:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d068c0606cd411ca3b5641509825b7b',uuid=ad033976-bfc8-46b9-89bf-f752ae0cdf01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "address": "fa:16:3e:86:2e:4d", "network": {"id": "64d2a931-7450-40f4-827a-e54a5db845a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-125648202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b8e37a30724a0186d9b7f126a46b0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8509ce7f-8c", "ovs_interfaceid": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Converting VIF {"id": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "address": "fa:16:3e:86:2e:4d", "network": {"id": "64d2a931-7450-40f4-827a-e54a5db845a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-125648202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b8e37a30724a0186d9b7f126a46b0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8509ce7f-8c", "ovs_interfaceid": "8509ce7f-8cec-4926-a30d-5900fbddac8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:2e:4d,bridge_name='br-int',has_traffic_filtering=True,id=8509ce7f-8cec-4926-a30d-5900fbddac8a,network=Network(64d2a931-7450-40f4-827a-e54a5db845a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8509ce7f-8c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG os_vif [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:2e:4d,bridge_name='br-int',has_traffic_filtering=True,id=8509ce7f-8cec-4926-a30d-5900fbddac8a,network=Network(64d2a931-7450-40f4-827a-e54a5db845a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8509ce7f-8c') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8509ce7f-8c, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:45 user nova-compute[72150]: INFO os_vif [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:2e:4d,bridge_name='br-int',has_traffic_filtering=True,id=8509ce7f-8cec-4926-a30d-5900fbddac8a,network=Network(64d2a931-7450-40f4-827a-e54a5db845a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8509ce7f-8c')
Aug 01 18:25:45 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Deleting instance files /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01_del
Aug 01 18:25:45 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Deletion of /opt/stack/data/nova/instances/ad033976-bfc8-46b9-89bf-f752ae0cdf01_del complete
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ff267e-9c62-4558-a680-1b0a1ae8b843]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.470s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] <== disconnect_volume: return (472ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:25:45 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Deleting instance files /opt/stack/data/nova/instances/9a4c69c1-6d13-4428-9460-be5988aa0b16_del
Aug 01 18:25:45 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Deletion of /opt/stack/data/nova/instances/9a4c69c1-6d13-4428-9460-be5988aa0b16_del complete
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:25:45 user nova-compute[72150]: INFO nova.compute.manager [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:45 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:25:45 user nova-compute[72150]: INFO nova.compute.claims [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Claim successful on node user
Aug 01 18:25:46 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 9a4c69c1-6d13-4428-9460-be5988aa0b16 could not be found.
Aug 01 18:25:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:25:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWXaJRkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:25:46 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 18:25:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:25:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:25:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:25:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7478387e-07a6-4ab6-996e-a9be1a6d87f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4181e3c-c2bb-4cfb-8726-6d8a4905e89c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:25:46 user nova-compute[72150]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:25:46 user nova-compute[72150]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:25:46 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:25:46 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:25:46 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:25:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:25:46 user nova-compute[72150]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:25:46 user nova-compute[72150]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:25:46 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:25:46 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:25:46 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:25:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec6e31c0>, {}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:25:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Disconnecting from: [] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:25:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.061s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:25:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] <== disconnect_volume: return (64ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:25:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:25:46 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:25:46 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:25:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.747s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:25:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:25:46 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:25:46 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:25:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:25:47 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Creating image(s)
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "/opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "/opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "/opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG nova.policy [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8264f17490ec46638cf38187aab3ce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41181268f4754733811b1abdad7eeb21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.221s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-9fb0f68b-ff1f-420b-bdb3-8f50b3617d7c req-17d31420-1682-4924-be69-e0bad2f899ea service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Received event network-vif-unplugged-8509ce7f-8cec-4926-a30d-5900fbddac8a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9fb0f68b-ff1f-420b-bdb3-8f50b3617d7c req-17d31420-1682-4924-be69-e0bad2f899ea service nova] Acquiring lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9fb0f68b-ff1f-420b-bdb3-8f50b3617d7c req-17d31420-1682-4924-be69-e0bad2f899ea service nova] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9fb0f68b-ff1f-420b-bdb3-8f50b3617d7c req-17d31420-1682-4924-be69-e0bad2f899ea service nova] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-9fb0f68b-ff1f-420b-bdb3-8f50b3617d7c req-17d31420-1682-4924-be69-e0bad2f899ea service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] No waiting events found dispatching network-vif-unplugged-8509ce7f-8cec-4926-a30d-5900fbddac8a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-9fb0f68b-ff1f-420b-bdb3-8f50b3617d7c req-17d31420-1682-4924-be69-e0bad2f899ea service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Received event network-vif-unplugged-8509ce7f-8cec-4926-a30d-5900fbddac8a for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-9fb0f68b-ff1f-420b-bdb3-8f50b3617d7c req-17d31420-1682-4924-be69-e0bad2f899ea service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Received event network-vif-plugged-8509ce7f-8cec-4926-a30d-5900fbddac8a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9fb0f68b-ff1f-420b-bdb3-8f50b3617d7c req-17d31420-1682-4924-be69-e0bad2f899ea service nova] Acquiring lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9fb0f68b-ff1f-420b-bdb3-8f50b3617d7c req-17d31420-1682-4924-be69-e0bad2f899ea service nova] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9fb0f68b-ff1f-420b-bdb3-8f50b3617d7c req-17d31420-1682-4924-be69-e0bad2f899ea service nova] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-9fb0f68b-ff1f-420b-bdb3-8f50b3617d7c req-17d31420-1682-4924-be69-e0bad2f899ea service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] No waiting events found dispatching network-vif-plugged-8509ce7f-8cec-4926-a30d-5900fbddac8a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:47 user nova-compute[72150]: WARNING nova.compute.manager [req-9fb0f68b-ff1f-420b-bdb3-8f50b3617d7c req-17d31420-1682-4924-be69-e0bad2f899ea service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Received unexpected event network-vif-plugged-8509ce7f-8cec-4926-a30d-5900fbddac8a for instance with vm_state active and task_state deleting.
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.191s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk 1073741824" returned: 0 in 0.067s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.162s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Cannot resize image /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG nova.objects.instance [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lazy-loading 'migration_context' on Instance uuid bcbfca8c-8bdb-47d2-addc-e1cec3166dc5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Ensure instance console log exists: /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-15f893c6-b550-41b9-a510-8301749e410a req-4be38df5-34e0-4b20-affa-8844cc6af7fe service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Received event network-vif-deleted-8509ce7f-8cec-4926-a30d-5900fbddac8a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:47 user nova-compute[72150]: INFO nova.compute.manager [req-15f893c6-b550-41b9-a510-8301749e410a req-4be38df5-34e0-4b20-affa-8844cc6af7fe service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Neutron deleted interface 8509ce7f-8cec-4926-a30d-5900fbddac8a; detaching it from the instance and deleting it from the info cache
Aug 01 18:25:47 user nova-compute[72150]: DEBUG nova.network.neutron [req-15f893c6-b550-41b9-a510-8301749e410a req-4be38df5-34e0-4b20-affa-8844cc6af7fe service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:25:47 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Took 1.94 seconds to deallocate network for instance.
Aug 01 18:25:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-15f893c6-b550-41b9-a510-8301749e410a req-4be38df5-34e0-4b20-affa-8844cc6af7fe service nova] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Detach interface failed, port_id=8509ce7f-8cec-4926-a30d-5900fbddac8a, reason: Instance ad033976-bfc8-46b9-89bf-f752ae0cdf01 could not be found. {{(pid=72150) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:48 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Successfully created port: 242e141b-d5fa-4e86-82ae-26b993342476 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:25:48 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:25:48 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:25:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.564s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:48 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Deleted allocations for instance ad033976-bfc8-46b9-89bf-f752ae0cdf01
Aug 01 18:25:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-401591b3-a91d-435c-9150-bc3ecd0d2508 tempest-TestVolumeSwap-1013643713 tempest-TestVolumeSwap-1013643713-project-member] Lock "ad033976-bfc8-46b9-89bf-f752ae0cdf01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.760s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Successfully updated port: 242e141b-d5fa-4e86-82ae-26b993342476 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "refresh_cache-bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquired lock "refresh_cache-bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.compute.manager [req-cd7c6278-7832-4daa-b434-80a7951d0681 req-58337dc7-f4bb-421e-a480-c68c4fd86051 service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Received event network-changed-242e141b-d5fa-4e86-82ae-26b993342476 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.compute.manager [req-cd7c6278-7832-4daa-b434-80a7951d0681 req-58337dc7-f4bb-421e-a480-c68c4fd86051 service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Refreshing instance network info cache due to event network-changed-242e141b-d5fa-4e86-82ae-26b993342476. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-cd7c6278-7832-4daa-b434-80a7951d0681 req-58337dc7-f4bb-421e-a480-c68c4fd86051 service nova] Acquiring lock "refresh_cache-bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Updating instance_info_cache with network_info: [{"id": "242e141b-d5fa-4e86-82ae-26b993342476", "address": "fa:16:3e:26:8b:9c", "network": {"id": "633e7e89-16a6-4a46-8d94-0a1cc6891579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211447573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41181268f4754733811b1abdad7eeb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242e141b-d5", "ovs_interfaceid": "242e141b-d5fa-4e86-82ae-26b993342476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Releasing lock "refresh_cache-bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Instance network_info: |[{"id": "242e141b-d5fa-4e86-82ae-26b993342476", "address": "fa:16:3e:26:8b:9c", "network": {"id": "633e7e89-16a6-4a46-8d94-0a1cc6891579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211447573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41181268f4754733811b1abdad7eeb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242e141b-d5", "ovs_interfaceid": "242e141b-d5fa-4e86-82ae-26b993342476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-cd7c6278-7832-4daa-b434-80a7951d0681 req-58337dc7-f4bb-421e-a480-c68c4fd86051 service nova] Acquired lock "refresh_cache-bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.network.neutron [req-cd7c6278-7832-4daa-b434-80a7951d0681 req-58337dc7-f4bb-421e-a480-c68c4fd86051 service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Refreshing network info cache for port 242e141b-d5fa-4e86-82ae-26b993342476 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Start _get_guest_xml network_info=[{"id": "242e141b-d5fa-4e86-82ae-26b993342476", "address": "fa:16:3e:26:8b:9c", "network": {"id": "633e7e89-16a6-4a46-8d94-0a1cc6891579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211447573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41181268f4754733811b1abdad7eeb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242e141b-d5", "ovs_interfaceid": "242e141b-d5fa-4e86-82ae-26b993342476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:25:49 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:25:49 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:25:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-305923291',display_name='tempest-VolumesAdminNegativeTest-server-305923291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-305923291',id=14,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhI0J2LgLlhmz64E9H3ZZx9WG9/v4mH1FMBdr6DCcGeiFSI+aP8/S9hKog9/dYzZA5h1KB1uzFWuxUcpa4s90okkwf4TI4ic4BjmqODxa8v8DAFodiCuBSAbN5gmpPjJQ==',key_name='tempest-keypair-664633611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41181268f4754733811b1abdad7eeb21',ramdisk_id='',reservation_id='r-lbrpjdbq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-38137380',owner_user_name='tempest-VolumesAdminNegativeTest-38137380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:25:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8264f17490ec46638cf38187aab3ce4c',uuid=bcbfca8c-8bdb-47d2-addc-e1cec3166dc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "242e141b-d5fa-4e86-82ae-26b993342476", "address": "fa:16:3e:26:8b:9c", "network": {"id": "633e7e89-16a6-4a46-8d94-0a1cc6891579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211447573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41181268f4754733811b1abdad7eeb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242e141b-d5", "ovs_interfaceid": "242e141b-d5fa-4e86-82ae-26b993342476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Converting VIF {"id": "242e141b-d5fa-4e86-82ae-26b993342476", "address": "fa:16:3e:26:8b:9c", "network": {"id": "633e7e89-16a6-4a46-8d94-0a1cc6891579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211447573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41181268f4754733811b1abdad7eeb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242e141b-d5", "ovs_interfaceid": "242e141b-d5fa-4e86-82ae-26b993342476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:8b:9c,bridge_name='br-int',has_traffic_filtering=True,id=242e141b-d5fa-4e86-82ae-26b993342476,network=Network(633e7e89-16a6-4a46-8d94-0a1cc6891579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap242e141b-d5') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:25:49 user nova-compute[72150]: DEBUG nova.objects.instance [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lazy-loading 'pci_devices' on Instance uuid bcbfca8c-8bdb-47d2-addc-e1cec3166dc5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:25:50 user nova-compute[72150]:   <uuid>bcbfca8c-8bdb-47d2-addc-e1cec3166dc5</uuid>
Aug 01 18:25:50 user nova-compute[72150]:   <name>instance-0000000e</name>
Aug 01 18:25:50 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:25:50 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:25:50 user nova-compute[72150]:   <metadata>
Aug 01 18:25:50 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:25:50 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:25:50 user nova-compute[72150]:       <nova:name>tempest-VolumesAdminNegativeTest-server-305923291</nova:name>
Aug 01 18:25:50 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:25:49</nova:creationTime>
Aug 01 18:25:50 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:25:50 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:25:50 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:25:50 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:25:50 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:25:50 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:25:50 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:25:50 user nova-compute[72150]:       <nova:owner>
Aug 01 18:25:50 user nova-compute[72150]:         <nova:user uuid="8264f17490ec46638cf38187aab3ce4c">tempest-VolumesAdminNegativeTest-38137380-project-member</nova:user>
Aug 01 18:25:50 user nova-compute[72150]:         <nova:project uuid="41181268f4754733811b1abdad7eeb21">tempest-VolumesAdminNegativeTest-38137380</nova:project>
Aug 01 18:25:50 user nova-compute[72150]:       </nova:owner>
Aug 01 18:25:50 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:25:50 user nova-compute[72150]:       <nova:ports>
Aug 01 18:25:50 user nova-compute[72150]:         <nova:port uuid="242e141b-d5fa-4e86-82ae-26b993342476">
Aug 01 18:25:50 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 18:25:50 user nova-compute[72150]:         </nova:port>
Aug 01 18:25:50 user nova-compute[72150]:       </nova:ports>
Aug 01 18:25:50 user nova-compute[72150]:     </nova:instance>
Aug 01 18:25:50 user nova-compute[72150]:   </metadata>
Aug 01 18:25:50 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:25:50 user nova-compute[72150]:     <system>
Aug 01 18:25:50 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:25:50 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:25:50 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:25:50 user nova-compute[72150]:       <entry name="serial">bcbfca8c-8bdb-47d2-addc-e1cec3166dc5</entry>
Aug 01 18:25:50 user nova-compute[72150]:       <entry name="uuid">bcbfca8c-8bdb-47d2-addc-e1cec3166dc5</entry>
Aug 01 18:25:50 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:25:50 user nova-compute[72150]:     </system>
Aug 01 18:25:50 user nova-compute[72150]:   </sysinfo>
Aug 01 18:25:50 user nova-compute[72150]:   <os>
Aug 01 18:25:50 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:25:50 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:25:50 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:25:50 user nova-compute[72150]:   </os>
Aug 01 18:25:50 user nova-compute[72150]:   <features>
Aug 01 18:25:50 user nova-compute[72150]:     <acpi/>
Aug 01 18:25:50 user nova-compute[72150]:     <apic/>
Aug 01 18:25:50 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:25:50 user nova-compute[72150]:   </features>
Aug 01 18:25:50 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:25:50 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:25:50 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:25:50 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:25:50 user nova-compute[72150]:   </clock>
Aug 01 18:25:50 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:25:50 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:25:50 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:25:50 user nova-compute[72150]:   </cpu>
Aug 01 18:25:50 user nova-compute[72150]:   <devices>
Aug 01 18:25:50 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:25:50 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:25:50 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk"/>
Aug 01 18:25:50 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:25:50 user nova-compute[72150]:     </disk>
Aug 01 18:25:50 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:25:50 user nova-compute[72150]:       <mac address="fa:16:3e:26:8b:9c"/>
Aug 01 18:25:50 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:25:50 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:25:50 user nova-compute[72150]:       <target dev="tap242e141b-d5"/>
Aug 01 18:25:50 user nova-compute[72150]:     </interface>
Aug 01 18:25:50 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:25:50 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/console.log" append="off"/>
Aug 01 18:25:50 user nova-compute[72150]:     </serial>
Aug 01 18:25:50 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:25:50 user nova-compute[72150]:     <video>
Aug 01 18:25:50 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:25:50 user nova-compute[72150]:     </video>
Aug 01 18:25:50 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:25:50 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:25:50 user nova-compute[72150]:     </rng>
Aug 01 18:25:50 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:25:50 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:25:50 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:25:50 user nova-compute[72150]:     </memballoon>
Aug 01 18:25:50 user nova-compute[72150]:   </devices>
Aug 01 18:25:50 user nova-compute[72150]: </domain>
Aug 01 18:25:50 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:25:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-305923291',display_name='tempest-VolumesAdminNegativeTest-server-305923291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-305923291',id=14,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhI0J2LgLlhmz64E9H3ZZx9WG9/v4mH1FMBdr6DCcGeiFSI+aP8/S9hKog9/dYzZA5h1KB1uzFWuxUcpa4s90okkwf4TI4ic4BjmqODxa8v8DAFodiCuBSAbN5gmpPjJQ==',key_name='tempest-keypair-664633611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41181268f4754733811b1abdad7eeb21',ramdisk_id='',reservation_id='r-lbrpjdbq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-38137380',owner_user_name='tempest-VolumesAdminNegativeTest-38137380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:25:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8264f17490ec46638cf38187aab3ce4c',uuid=bcbfca8c-8bdb-47d2-addc-e1cec3166dc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "242e141b-d5fa-4e86-82ae-26b993342476", "address": "fa:16:3e:26:8b:9c", "network": {"id": "633e7e89-16a6-4a46-8d94-0a1cc6891579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211447573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41181268f4754733811b1abdad7eeb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242e141b-d5", "ovs_interfaceid": "242e141b-d5fa-4e86-82ae-26b993342476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Converting VIF {"id": "242e141b-d5fa-4e86-82ae-26b993342476", "address": "fa:16:3e:26:8b:9c", "network": {"id": "633e7e89-16a6-4a46-8d94-0a1cc6891579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211447573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41181268f4754733811b1abdad7eeb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242e141b-d5", "ovs_interfaceid": "242e141b-d5fa-4e86-82ae-26b993342476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:8b:9c,bridge_name='br-int',has_traffic_filtering=True,id=242e141b-d5fa-4e86-82ae-26b993342476,network=Network(633e7e89-16a6-4a46-8d94-0a1cc6891579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap242e141b-d5') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG os_vif [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:8b:9c,bridge_name='br-int',has_traffic_filtering=True,id=242e141b-d5fa-4e86-82ae-26b993342476,network=Network(633e7e89-16a6-4a46-8d94-0a1cc6891579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap242e141b-d5') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap242e141b-d5, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap242e141b-d5, col_values=(('external_ids', {'iface-id': '242e141b-d5fa-4e86-82ae-26b993342476', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:8b:9c', 'vm-uuid': 'bcbfca8c-8bdb-47d2-addc-e1cec3166dc5'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:50 user nova-compute[72150]: INFO os_vif [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:8b:9c,bridge_name='br-int',has_traffic_filtering=True,id=242e141b-d5fa-4e86-82ae-26b993342476,network=Network(633e7e89-16a6-4a46-8d94-0a1cc6891579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap242e141b-d5')
Aug 01 18:25:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] No VIF found with MAC fa:16:3e:26:8b:9c, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-7edbf8df-762c-4524-8abd-e08edecd6f69 req-a15331d5-862e-4891-bbe4-5a7a04ffc3cd service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Received event network-changed-10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-7edbf8df-762c-4524-8abd-e08edecd6f69 req-a15331d5-862e-4891-bbe4-5a7a04ffc3cd service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Refreshing instance network info cache due to event network-changed-10176957-b4a6-4052-9a16-21152c8c3da5. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7edbf8df-762c-4524-8abd-e08edecd6f69 req-a15331d5-862e-4891-bbe4-5a7a04ffc3cd service nova] Acquiring lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7edbf8df-762c-4524-8abd-e08edecd6f69 req-a15331d5-862e-4891-bbe4-5a7a04ffc3cd service nova] Acquired lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG nova.network.neutron [req-7edbf8df-762c-4524-8abd-e08edecd6f69 req-a15331d5-862e-4891-bbe4-5a7a04ffc3cd service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Refreshing network info cache for port 10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG nova.network.neutron [req-cd7c6278-7832-4daa-b434-80a7951d0681 req-58337dc7-f4bb-421e-a480-c68c4fd86051 service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Updated VIF entry in instance network info cache for port 242e141b-d5fa-4e86-82ae-26b993342476. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG nova.network.neutron [req-cd7c6278-7832-4daa-b434-80a7951d0681 req-58337dc7-f4bb-421e-a480-c68c4fd86051 service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Updating instance_info_cache with network_info: [{"id": "242e141b-d5fa-4e86-82ae-26b993342476", "address": "fa:16:3e:26:8b:9c", "network": {"id": "633e7e89-16a6-4a46-8d94-0a1cc6891579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211447573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41181268f4754733811b1abdad7eeb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242e141b-d5", "ovs_interfaceid": "242e141b-d5fa-4e86-82ae-26b993342476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-cd7c6278-7832-4daa-b434-80a7951d0681 req-58337dc7-f4bb-421e-a480-c68c4fd86051 service nova] Releasing lock "refresh_cache-bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-f632e9a0-5f5f-4c88-8661-02a27b94b9f1 req-96eaf514-a041-484d-853b-4d33ed4d967d service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-changed-39a977ce-d734-4852-838b-6dfbb51c0bf8 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-f632e9a0-5f5f-4c88-8661-02a27b94b9f1 req-96eaf514-a041-484d-853b-4d33ed4d967d service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Refreshing instance network info cache due to event network-changed-39a977ce-d734-4852-838b-6dfbb51c0bf8. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f632e9a0-5f5f-4c88-8661-02a27b94b9f1 req-96eaf514-a041-484d-853b-4d33ed4d967d service nova] Acquiring lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f632e9a0-5f5f-4c88-8661-02a27b94b9f1 req-96eaf514-a041-484d-853b-4d33ed4d967d service nova] Acquired lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:25:50 user nova-compute[72150]: DEBUG nova.network.neutron [req-f632e9a0-5f5f-4c88-8661-02a27b94b9f1 req-96eaf514-a041-484d-853b-4d33ed4d967d service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Refreshing network info cache for port 39a977ce-d734-4852-838b-6dfbb51c0bf8 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:25:51 user nova-compute[72150]: DEBUG nova.network.neutron [req-7edbf8df-762c-4524-8abd-e08edecd6f69 req-a15331d5-862e-4891-bbe4-5a7a04ffc3cd service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Updated VIF entry in instance network info cache for port 10176957-b4a6-4052-9a16-21152c8c3da5. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:25:51 user nova-compute[72150]: DEBUG nova.network.neutron [req-7edbf8df-762c-4524-8abd-e08edecd6f69 req-a15331d5-862e-4891-bbe4-5a7a04ffc3cd service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Updating instance_info_cache with network_info: [{"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:25:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7edbf8df-762c-4524-8abd-e08edecd6f69 req-a15331d5-862e-4891-bbe4-5a7a04ffc3cd service nova] Releasing lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:25:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:52 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Preparing to wait for external event volume-reimaged-99176d6f-ea51-4322-b763-9a4f8a154d17 {{(pid=72150) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 01 18:25:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:52 user nova-compute[72150]: DEBUG nova.compute.manager [req-36bd3d12-2e47-4aa2-be5e-8bd7cd95488f req-3aa4e21c-2202-49dd-baad-446d1b5a46a2 service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Received event network-vif-plugged-242e141b-d5fa-4e86-82ae-26b993342476 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-36bd3d12-2e47-4aa2-be5e-8bd7cd95488f req-3aa4e21c-2202-49dd-baad-446d1b5a46a2 service nova] Acquiring lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-36bd3d12-2e47-4aa2-be5e-8bd7cd95488f req-3aa4e21c-2202-49dd-baad-446d1b5a46a2 service nova] Lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-36bd3d12-2e47-4aa2-be5e-8bd7cd95488f req-3aa4e21c-2202-49dd-baad-446d1b5a46a2 service nova] Lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:52 user nova-compute[72150]: DEBUG nova.compute.manager [req-36bd3d12-2e47-4aa2-be5e-8bd7cd95488f req-3aa4e21c-2202-49dd-baad-446d1b5a46a2 service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] No waiting events found dispatching network-vif-plugged-242e141b-d5fa-4e86-82ae-26b993342476 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:52 user nova-compute[72150]: WARNING nova.compute.manager [req-36bd3d12-2e47-4aa2-be5e-8bd7cd95488f req-3aa4e21c-2202-49dd-baad-446d1b5a46a2 service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Received unexpected event network-vif-plugged-242e141b-d5fa-4e86-82ae-26b993342476 for instance with vm_state building and task_state spawning.
Aug 01 18:25:53 user nova-compute[72150]: DEBUG nova.network.neutron [req-f632e9a0-5f5f-4c88-8661-02a27b94b9f1 req-96eaf514-a041-484d-853b-4d33ed4d967d service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Updated VIF entry in instance network info cache for port 39a977ce-d734-4852-838b-6dfbb51c0bf8. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:25:53 user nova-compute[72150]: DEBUG nova.network.neutron [req-f632e9a0-5f5f-4c88-8661-02a27b94b9f1 req-96eaf514-a041-484d-853b-4d33ed4d967d service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Updating instance_info_cache with network_info: [{"id": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "address": "fa:16:3e:dc:77:d0", "network": {"id": "f9631fa1-8ca7-453e-a8c2-a550baa29167", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2010840575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a977ce-d7", "ovs_interfaceid": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77546d5a-e74c-4058-9008-a09a455ba8d0", "address": "fa:16:3e:87:f5:13", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77546d5a-e7", "ovs_interfaceid": "77546d5a-e74c-4058-9008-a09a455ba8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fab43aac-fc06-4876-8c52-6f3e5a492217", "address": "fa:16:3e:9c:44:4d", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab43aac-fc", "ovs_interfaceid": "fab43aac-fc06-4876-8c52-6f3e5a492217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "541680e9-0c34-47e2-b297-b3365281b90a", "address": "fa:16:3e:7f:67:77", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541680e9-0c", "ovs_interfaceid": "541680e9-0c34-47e2-b297-b3365281b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "address": "fa:16:3e:a8:fc:df", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6546d6-8f", "ovs_interfaceid": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "650c8b02-2525-403f-88d4-450a0903b33c", "address": "fa:16:3e:72:45:67", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650c8b02-25", "ovs_interfaceid": "650c8b02-2525-403f-88d4-450a0903b33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c024ac3e-43d1-4453-8715-9b49c747fb08", "address": "fa:16:3e:c3:8d:39", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc024ac3e-43", "ovs_interfaceid": "c024ac3e-43d1-4453-8715-9b49c747fb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:25:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f632e9a0-5f5f-4c88-8661-02a27b94b9f1 req-96eaf514-a041-484d-853b-4d33ed4d967d service nova] Releasing lock "refresh_cache-39ed0e93-df10-4f34-b13a-66a1825d21b9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:25:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914354.3740337, bcbfca8c-8bdb-47d2-addc-e1cec3166dc5 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:25:54 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] VM Resumed (Lifecycle Event)
Aug 01 18:25:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:25:54 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Instance spawned successfully.
Aug 01 18:25:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:25:54 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:25:54 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914354.3742847, bcbfca8c-8bdb-47d2-addc-e1cec3166dc5 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:25:54 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] VM Started (Lifecycle Event)
Aug 01 18:25:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:25:54 user nova-compute[72150]: INFO nova.compute.manager [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Took 7.49 seconds to spawn the instance on the hypervisor.
Aug 01 18:25:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:25:54 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:25:54 user nova-compute[72150]: INFO nova.compute.manager [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Took 8.65 seconds to build instance.
Aug 01 18:25:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ed5a9df7-e02f-4da7-87f5-7856a5e7c5f0 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.792s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG nova.compute.manager [req-10d4c5d5-6f78-4a08-9edd-f94e2efea43b req-bdd58198-4e7a-437c-bd4e-e6ae3a45afad service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Received event network-vif-plugged-242e141b-d5fa-4e86-82ae-26b993342476 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-10d4c5d5-6f78-4a08-9edd-f94e2efea43b req-bdd58198-4e7a-437c-bd4e-e6ae3a45afad service nova] Acquiring lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-10d4c5d5-6f78-4a08-9edd-f94e2efea43b req-bdd58198-4e7a-437c-bd4e-e6ae3a45afad service nova] Lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-10d4c5d5-6f78-4a08-9edd-f94e2efea43b req-bdd58198-4e7a-437c-bd4e-e6ae3a45afad service nova] Lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG nova.compute.manager [req-10d4c5d5-6f78-4a08-9edd-f94e2efea43b req-bdd58198-4e7a-437c-bd4e-e6ae3a45afad service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] No waiting events found dispatching network-vif-plugged-242e141b-d5fa-4e86-82ae-26b993342476 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:54 user nova-compute[72150]: WARNING nova.compute.manager [req-10d4c5d5-6f78-4a08-9edd-f94e2efea43b req-bdd58198-4e7a-437c-bd4e-e6ae3a45afad service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Received unexpected event network-vif-plugged-242e141b-d5fa-4e86-82ae-26b993342476 for instance with vm_state active and task_state None.
Aug 01 18:25:54 user nova-compute[72150]: DEBUG nova.compute.manager [req-10d4c5d5-6f78-4a08-9edd-f94e2efea43b req-bdd58198-4e7a-437c-bd4e-e6ae3a45afad service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Received event network-changed-10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG nova.compute.manager [req-10d4c5d5-6f78-4a08-9edd-f94e2efea43b req-bdd58198-4e7a-437c-bd4e-e6ae3a45afad service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Refreshing instance network info cache due to event network-changed-10176957-b4a6-4052-9a16-21152c8c3da5. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-10d4c5d5-6f78-4a08-9edd-f94e2efea43b req-bdd58198-4e7a-437c-bd4e-e6ae3a45afad service nova] Acquiring lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-10d4c5d5-6f78-4a08-9edd-f94e2efea43b req-bdd58198-4e7a-437c-bd4e-e6ae3a45afad service nova] Acquired lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG nova.network.neutron [req-10d4c5d5-6f78-4a08-9edd-f94e2efea43b req-bdd58198-4e7a-437c-bd4e-e6ae3a45afad service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Refreshing network info cache for port 10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:54 user nova-compute[72150]: INFO nova.compute.manager [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Terminating instance
Aug 01 18:25:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG nova.compute.manager [req-66380d98-5184-428a-9af6-bd83f8aae3b7 req-a8eb6b69-53fd-4ca5-aa6c-e8a3361364fc service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-unplugged-39a977ce-d734-4852-838b-6dfbb51c0bf8 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-66380d98-5184-428a-9af6-bd83f8aae3b7 req-a8eb6b69-53fd-4ca5-aa6c-e8a3361364fc service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-66380d98-5184-428a-9af6-bd83f8aae3b7 req-a8eb6b69-53fd-4ca5-aa6c-e8a3361364fc service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-66380d98-5184-428a-9af6-bd83f8aae3b7 req-a8eb6b69-53fd-4ca5-aa6c-e8a3361364fc service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG nova.compute.manager [req-66380d98-5184-428a-9af6-bd83f8aae3b7 req-a8eb6b69-53fd-4ca5-aa6c-e8a3361364fc service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-unplugged-39a977ce-d734-4852-838b-6dfbb51c0bf8 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG nova.compute.manager [req-66380d98-5184-428a-9af6-bd83f8aae3b7 req-a8eb6b69-53fd-4ca5-aa6c-e8a3361364fc service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-unplugged-39a977ce-d734-4852-838b-6dfbb51c0bf8 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG nova.network.neutron [req-10d4c5d5-6f78-4a08-9edd-f94e2efea43b req-bdd58198-4e7a-437c-bd4e-e6ae3a45afad service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Updated VIF entry in instance network info cache for port 10176957-b4a6-4052-9a16-21152c8c3da5. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG nova.network.neutron [req-10d4c5d5-6f78-4a08-9edd-f94e2efea43b req-bdd58198-4e7a-437c-bd4e-e6ae3a45afad service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Updating instance_info_cache with network_info: [{"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-10d4c5d5-6f78-4a08-9edd-f94e2efea43b req-bdd58198-4e7a-437c-bd4e-e6ae3a45afad service nova] Releasing lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:25:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-83353214-a81a-4f32-ba28-a31971581659 req-eca69b9d-4f95-46df-b268-83e19a2f2833 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-unplugged-fab43aac-fc06-4876-8c52-6f3e5a492217 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-83353214-a81a-4f32-ba28-a31971581659 req-eca69b9d-4f95-46df-b268-83e19a2f2833 service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-83353214-a81a-4f32-ba28-a31971581659 req-eca69b9d-4f95-46df-b268-83e19a2f2833 service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-83353214-a81a-4f32-ba28-a31971581659 req-eca69b9d-4f95-46df-b268-83e19a2f2833 service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-83353214-a81a-4f32-ba28-a31971581659 req-eca69b9d-4f95-46df-b268-83e19a2f2833 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-unplugged-fab43aac-fc06-4876-8c52-6f3e5a492217 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-83353214-a81a-4f32-ba28-a31971581659 req-eca69b9d-4f95-46df-b268-83e19a2f2833 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-unplugged-fab43aac-fc06-4876-8c52-6f3e5a492217 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:25:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-1e3c20da-ec8f-4b32-b044-34fcb5bb94bb req-b7c8a27f-f65d-4e28-a780-b4942d079e20 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-unplugged-1e6546d6-8fa5-4298-851b-3fb6efa9420c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1e3c20da-ec8f-4b32-b044-34fcb5bb94bb req-b7c8a27f-f65d-4e28-a780-b4942d079e20 service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1e3c20da-ec8f-4b32-b044-34fcb5bb94bb req-b7c8a27f-f65d-4e28-a780-b4942d079e20 service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1e3c20da-ec8f-4b32-b044-34fcb5bb94bb req-b7c8a27f-f65d-4e28-a780-b4942d079e20 service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-1e3c20da-ec8f-4b32-b044-34fcb5bb94bb req-b7c8a27f-f65d-4e28-a780-b4942d079e20 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-unplugged-1e6546d6-8fa5-4298-851b-3fb6efa9420c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-1e3c20da-ec8f-4b32-b044-34fcb5bb94bb req-b7c8a27f-f65d-4e28-a780-b4942d079e20 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-unplugged-1e6546d6-8fa5-4298-851b-3fb6efa9420c for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:25:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-1e3c20da-ec8f-4b32-b044-34fcb5bb94bb req-b7c8a27f-f65d-4e28-a780-b4942d079e20 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-plugged-1e6546d6-8fa5-4298-851b-3fb6efa9420c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1e3c20da-ec8f-4b32-b044-34fcb5bb94bb req-b7c8a27f-f65d-4e28-a780-b4942d079e20 service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1e3c20da-ec8f-4b32-b044-34fcb5bb94bb req-b7c8a27f-f65d-4e28-a780-b4942d079e20 service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1e3c20da-ec8f-4b32-b044-34fcb5bb94bb req-b7c8a27f-f65d-4e28-a780-b4942d079e20 service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-1e3c20da-ec8f-4b32-b044-34fcb5bb94bb req-b7c8a27f-f65d-4e28-a780-b4942d079e20 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-plugged-1e6546d6-8fa5-4298-851b-3fb6efa9420c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:56 user nova-compute[72150]: WARNING nova.compute.manager [req-1e3c20da-ec8f-4b32-b044-34fcb5bb94bb req-b7c8a27f-f65d-4e28-a780-b4942d079e20 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received unexpected event network-vif-plugged-1e6546d6-8fa5-4298-851b-3fb6efa9420c for instance with vm_state active and task_state deleting.
Aug 01 18:25:57 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Instance destroyed successfully.
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.objects.instance [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lazy-loading 'resources' on Instance uuid 39ed0e93-df10-4f34-b13a-66a1825d21b9 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2014007240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2014007240',id=9,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ECeSPUMc++nSJlRUYvQf+7gQpST58K1TxWzhrTnrq13Jdlj7i5BJx01qhEK9DQjreJB1IajiL6K96JXmqZJ3UXS2MQQ5P0dRpaOGmLVmrEYZTyKLGY8SqcMnKBMPZPw==',key_name='tempest-keypair-57552355',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:23:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b60b336a42e94d27b1079bbf8732eb7d',ramdisk_id='',reservation_id='r-0402eoyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1666899254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1666899254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:24:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f62806f8d5534c86a3a1808daa5edbb4',uuid=39ed0e93-df10-4f34-b13a-66a1825d21b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "address": "fa:16:3e:dc:77:d0", "network": {"id": "f9631fa1-8ca7-453e-a8c2-a550baa29167", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2010840575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a977ce-d7", "ovs_interfaceid": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converting VIF {"id": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "address": "fa:16:3e:dc:77:d0", "network": {"id": "f9631fa1-8ca7-453e-a8c2-a550baa29167", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2010840575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a977ce-d7", "ovs_interfaceid": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:77:d0,bridge_name='br-int',has_traffic_filtering=True,id=39a977ce-d734-4852-838b-6dfbb51c0bf8,network=Network(f9631fa1-8ca7-453e-a8c2-a550baa29167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a977ce-d7') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG os_vif [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:77:d0,bridge_name='br-int',has_traffic_filtering=True,id=39a977ce-d734-4852-838b-6dfbb51c0bf8,network=Network(f9631fa1-8ca7-453e-a8c2-a550baa29167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a977ce-d7') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39a977ce-d7, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:57 user nova-compute[72150]: INFO os_vif [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:77:d0,bridge_name='br-int',has_traffic_filtering=True,id=39a977ce-d734-4852-838b-6dfbb51c0bf8,network=Network(f9631fa1-8ca7-453e-a8c2-a550baa29167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a977ce-d7')
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2014007240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2014007240',id=9,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ECeSPUMc++nSJlRUYvQf+7gQpST58K1TxWzhrTnrq13Jdlj7i5BJx01qhEK9DQjreJB1IajiL6K96JXmqZJ3UXS2MQQ5P0dRpaOGmLVmrEYZTyKLGY8SqcMnKBMPZPw==',key_name='tempest-keypair-57552355',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:23:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b60b336a42e94d27b1079bbf8732eb7d',ramdisk_id='',reservation_id='r-0402eoyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1666899254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1666899254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:24:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f62806f8d5534c86a3a1808daa5edbb4',uuid=39ed0e93-df10-4f34-b13a-66a1825d21b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77546d5a-e74c-4058-9008-a09a455ba8d0", "address": "fa:16:3e:87:f5:13", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77546d5a-e7", "ovs_interfaceid": "77546d5a-e74c-4058-9008-a09a455ba8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converting VIF {"id": "77546d5a-e74c-4058-9008-a09a455ba8d0", "address": "fa:16:3e:87:f5:13", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77546d5a-e7", "ovs_interfaceid": "77546d5a-e74c-4058-9008-a09a455ba8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f5:13,bridge_name='br-int',has_traffic_filtering=True,id=77546d5a-e74c-4058-9008-a09a455ba8d0,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77546d5a-e7') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG os_vif [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f5:13,bridge_name='br-int',has_traffic_filtering=True,id=77546d5a-e74c-4058-9008-a09a455ba8d0,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77546d5a-e7') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77546d5a-e7, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:57 user nova-compute[72150]: INFO os_vif [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f5:13,bridge_name='br-int',has_traffic_filtering=True,id=77546d5a-e74c-4058-9008-a09a455ba8d0,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77546d5a-e7')
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2014007240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2014007240',id=9,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ECeSPUMc++nSJlRUYvQf+7gQpST58K1TxWzhrTnrq13Jdlj7i5BJx01qhEK9DQjreJB1IajiL6K96JXmqZJ3UXS2MQQ5P0dRpaOGmLVmrEYZTyKLGY8SqcMnKBMPZPw==',key_name='tempest-keypair-57552355',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:23:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b60b336a42e94d27b1079bbf8732eb7d',ramdisk_id='',reservation_id='r-0402eoyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1666899254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1666899254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:24:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f62806f8d5534c86a3a1808daa5edbb4',uuid=39ed0e93-df10-4f34-b13a-66a1825d21b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fab43aac-fc06-4876-8c52-6f3e5a492217", "address": "fa:16:3e:9c:44:4d", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab43aac-fc", "ovs_interfaceid": "fab43aac-fc06-4876-8c52-6f3e5a492217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converting VIF {"id": "fab43aac-fc06-4876-8c52-6f3e5a492217", "address": "fa:16:3e:9c:44:4d", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab43aac-fc", "ovs_interfaceid": "fab43aac-fc06-4876-8c52-6f3e5a492217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:44:4d,bridge_name='br-int',has_traffic_filtering=True,id=fab43aac-fc06-4876-8c52-6f3e5a492217,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfab43aac-fc') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG os_vif [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:44:4d,bridge_name='br-int',has_traffic_filtering=True,id=fab43aac-fc06-4876-8c52-6f3e5a492217,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfab43aac-fc') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfab43aac-fc, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:57 user nova-compute[72150]: INFO os_vif [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:44:4d,bridge_name='br-int',has_traffic_filtering=True,id=fab43aac-fc06-4876-8c52-6f3e5a492217,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfab43aac-fc')
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2014007240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2014007240',id=9,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ECeSPUMc++nSJlRUYvQf+7gQpST58K1TxWzhrTnrq13Jdlj7i5BJx01qhEK9DQjreJB1IajiL6K96JXmqZJ3UXS2MQQ5P0dRpaOGmLVmrEYZTyKLGY8SqcMnKBMPZPw==',key_name='tempest-keypair-57552355',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:23:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b60b336a42e94d27b1079bbf8732eb7d',ramdisk_id='',reservation_id='r-0402eoyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1666899254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1666899254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:24:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f62806f8d5534c86a3a1808daa5edbb4',uuid=39ed0e93-df10-4f34-b13a-66a1825d21b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "541680e9-0c34-47e2-b297-b3365281b90a", "address": "fa:16:3e:7f:67:77", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541680e9-0c", "ovs_interfaceid": "541680e9-0c34-47e2-b297-b3365281b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converting VIF {"id": "541680e9-0c34-47e2-b297-b3365281b90a", "address": "fa:16:3e:7f:67:77", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541680e9-0c", "ovs_interfaceid": "541680e9-0c34-47e2-b297-b3365281b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:67:77,bridge_name='br-int',has_traffic_filtering=True,id=541680e9-0c34-47e2-b297-b3365281b90a,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap541680e9-0c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG os_vif [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:67:77,bridge_name='br-int',has_traffic_filtering=True,id=541680e9-0c34-47e2-b297-b3365281b90a,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap541680e9-0c') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap541680e9-0c, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:57 user nova-compute[72150]: INFO os_vif [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:67:77,bridge_name='br-int',has_traffic_filtering=True,id=541680e9-0c34-47e2-b297-b3365281b90a,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap541680e9-0c')
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2014007240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2014007240',id=9,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ECeSPUMc++nSJlRUYvQf+7gQpST58K1TxWzhrTnrq13Jdlj7i5BJx01qhEK9DQjreJB1IajiL6K96JXmqZJ3UXS2MQQ5P0dRpaOGmLVmrEYZTyKLGY8SqcMnKBMPZPw==',key_name='tempest-keypair-57552355',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:23:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b60b336a42e94d27b1079bbf8732eb7d',ramdisk_id='',reservation_id='r-0402eoyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1666899254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1666899254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:24:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f62806f8d5534c86a3a1808daa5edbb4',uuid=39ed0e93-df10-4f34-b13a-66a1825d21b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "address": "fa:16:3e:a8:fc:df", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6546d6-8f", "ovs_interfaceid": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converting VIF {"id": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "address": "fa:16:3e:a8:fc:df", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6546d6-8f", "ovs_interfaceid": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fc:df,bridge_name='br-int',has_traffic_filtering=True,id=1e6546d6-8fa5-4298-851b-3fb6efa9420c,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e6546d6-8f') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG os_vif [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fc:df,bridge_name='br-int',has_traffic_filtering=True,id=1e6546d6-8fa5-4298-851b-3fb6efa9420c,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e6546d6-8f') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e6546d6-8f, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:57 user nova-compute[72150]: INFO os_vif [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fc:df,bridge_name='br-int',has_traffic_filtering=True,id=1e6546d6-8fa5-4298-851b-3fb6efa9420c,network=Network(5cb49305-f063-42d1-85a8-0df638e9af28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e6546d6-8f')
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2014007240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2014007240',id=9,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ECeSPUMc++nSJlRUYvQf+7gQpST58K1TxWzhrTnrq13Jdlj7i5BJx01qhEK9DQjreJB1IajiL6K96JXmqZJ3UXS2MQQ5P0dRpaOGmLVmrEYZTyKLGY8SqcMnKBMPZPw==',key_name='tempest-keypair-57552355',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:23:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b60b336a42e94d27b1079bbf8732eb7d',ramdisk_id='',reservation_id='r-0402eoyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1666899254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1666899254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:24:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f62806f8d5534c86a3a1808daa5edbb4',uuid=39ed0e93-df10-4f34-b13a-66a1825d21b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "650c8b02-2525-403f-88d4-450a0903b33c", "address": "fa:16:3e:72:45:67", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650c8b02-25", "ovs_interfaceid": "650c8b02-2525-403f-88d4-450a0903b33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converting VIF {"id": "650c8b02-2525-403f-88d4-450a0903b33c", "address": "fa:16:3e:72:45:67", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650c8b02-25", "ovs_interfaceid": "650c8b02-2525-403f-88d4-450a0903b33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:45:67,bridge_name='br-int',has_traffic_filtering=True,id=650c8b02-2525-403f-88d4-450a0903b33c,network=Network(2738102a-fe12-412d-9dc2-a1ce7a79997a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap650c8b02-25') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG os_vif [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:45:67,bridge_name='br-int',has_traffic_filtering=True,id=650c8b02-2525-403f-88d4-450a0903b33c,network=Network(2738102a-fe12-412d-9dc2-a1ce7a79997a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap650c8b02-25') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap650c8b02-25, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:57 user nova-compute[72150]: INFO os_vif [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:45:67,bridge_name='br-int',has_traffic_filtering=True,id=650c8b02-2525-403f-88d4-450a0903b33c,network=Network(2738102a-fe12-412d-9dc2-a1ce7a79997a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap650c8b02-25')
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T18:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2014007240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2014007240',id=9,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ECeSPUMc++nSJlRUYvQf+7gQpST58K1TxWzhrTnrq13Jdlj7i5BJx01qhEK9DQjreJB1IajiL6K96JXmqZJ3UXS2MQQ5P0dRpaOGmLVmrEYZTyKLGY8SqcMnKBMPZPw==',key_name='tempest-keypair-57552355',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:23:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b60b336a42e94d27b1079bbf8732eb7d',ramdisk_id='',reservation_id='r-0402eoyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1666899254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1666899254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:24:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f62806f8d5534c86a3a1808daa5edbb4',uuid=39ed0e93-df10-4f34-b13a-66a1825d21b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c024ac3e-43d1-4453-8715-9b49c747fb08", "address": "fa:16:3e:c3:8d:39", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc024ac3e-43", "ovs_interfaceid": "c024ac3e-43d1-4453-8715-9b49c747fb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converting VIF {"id": "c024ac3e-43d1-4453-8715-9b49c747fb08", "address": "fa:16:3e:c3:8d:39", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc024ac3e-43", "ovs_interfaceid": "c024ac3e-43d1-4453-8715-9b49c747fb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:8d:39,bridge_name='br-int',has_traffic_filtering=True,id=c024ac3e-43d1-4453-8715-9b49c747fb08,network=Network(2738102a-fe12-412d-9dc2-a1ce7a79997a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc024ac3e-43') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG os_vif [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:8d:39,bridge_name='br-int',has_traffic_filtering=True,id=c024ac3e-43d1-4453-8715-9b49c747fb08,network=Network(2738102a-fe12-412d-9dc2-a1ce7a79997a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc024ac3e-43') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc024ac3e-43, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:25:57 user nova-compute[72150]: INFO os_vif [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:8d:39,bridge_name='br-int',has_traffic_filtering=True,id=c024ac3e-43d1-4453-8715-9b49c747fb08,network=Network(2738102a-fe12-412d-9dc2-a1ce7a79997a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc024ac3e-43')
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEgXxFPk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:25:57 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:25:57 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d89058-6e3c-4f7f-ba8a-95cb567683d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e51d3be-bbc3-4b7b-b8aa-41a2b60834ec]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:25:57 user nova-compute[72150]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:25:57 user nova-compute[72150]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:25:57 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:25:57 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:25:57 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:25:57 user nova-compute[72150]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:25:57 user nova-compute[72150]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:25:57 user nova-compute[72150]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 (non-flash)
Aug 01 18:25:57 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:25:57 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c2b6c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84'): ({'sde'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Removing single pathed devices sde {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-5c9dae9f-6fff-4b95-b692-57b75021131c req-7dc15365-1cc1-4a8d-9fd7-3044df9a03fe service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-plugged-39a977ce-d734-4852-838b-6dfbb51c0bf8 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5c9dae9f-6fff-4b95-b692-57b75021131c req-7dc15365-1cc1-4a8d-9fd7-3044df9a03fe service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5c9dae9f-6fff-4b95-b692-57b75021131c req-7dc15365-1cc1-4a8d-9fd7-3044df9a03fe service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5c9dae9f-6fff-4b95-b692-57b75021131c req-7dc15365-1cc1-4a8d-9fd7-3044df9a03fe service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-5c9dae9f-6fff-4b95-b692-57b75021131c req-7dc15365-1cc1-4a8d-9fd7-3044df9a03fe service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-plugged-39a977ce-d734-4852-838b-6dfbb51c0bf8 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:57 user nova-compute[72150]: WARNING nova.compute.manager [req-5c9dae9f-6fff-4b95-b692-57b75021131c req-7dc15365-1cc1-4a8d-9fd7-3044df9a03fe service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received unexpected event network-vif-plugged-39a977ce-d734-4852-838b-6dfbb51c0bf8 for instance with vm_state active and task_state deleting.
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-5c9dae9f-6fff-4b95-b692-57b75021131c req-7dc15365-1cc1-4a8d-9fd7-3044df9a03fe service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-unplugged-77546d5a-e74c-4058-9008-a09a455ba8d0 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5c9dae9f-6fff-4b95-b692-57b75021131c req-7dc15365-1cc1-4a8d-9fd7-3044df9a03fe service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5c9dae9f-6fff-4b95-b692-57b75021131c req-7dc15365-1cc1-4a8d-9fd7-3044df9a03fe service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5c9dae9f-6fff-4b95-b692-57b75021131c req-7dc15365-1cc1-4a8d-9fd7-3044df9a03fe service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-5c9dae9f-6fff-4b95-b692-57b75021131c req-7dc15365-1cc1-4a8d-9fd7-3044df9a03fe service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-unplugged-77546d5a-e74c-4058-9008-a09a455ba8d0 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-5c9dae9f-6fff-4b95-b692-57b75021131c req-7dc15365-1cc1-4a8d-9fd7-3044df9a03fe service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-unplugged-77546d5a-e74c-4058-9008-a09a455ba8d0 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-5c9dae9f-6fff-4b95-b692-57b75021131c req-7dc15365-1cc1-4a8d-9fd7-3044df9a03fe service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-plugged-77546d5a-e74c-4058-9008-a09a455ba8d0 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5c9dae9f-6fff-4b95-b692-57b75021131c req-7dc15365-1cc1-4a8d-9fd7-3044df9a03fe service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5c9dae9f-6fff-4b95-b692-57b75021131c req-7dc15365-1cc1-4a8d-9fd7-3044df9a03fe service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5c9dae9f-6fff-4b95-b692-57b75021131c req-7dc15365-1cc1-4a8d-9fd7-3044df9a03fe service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-5c9dae9f-6fff-4b95-b692-57b75021131c req-7dc15365-1cc1-4a8d-9fd7-3044df9a03fe service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-plugged-77546d5a-e74c-4058-9008-a09a455ba8d0 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:57 user nova-compute[72150]: WARNING nova.compute.manager [req-5c9dae9f-6fff-4b95-b692-57b75021131c req-7dc15365-1cc1-4a8d-9fd7-3044df9a03fe service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received unexpected event network-vif-plugged-77546d5a-e74c-4058-9008-a09a455ba8d0 for instance with vm_state active and task_state deleting.
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[92dc96dd-42af-4ee6-ae27-371d70ec9eb1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4022dc71-c7c0-4c5d-bc10-e8a33f8d2dd4]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Flushing IO for device /dev/sde {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[56244141-0c51-4b49-99e6-a09f6805b01e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb0e711-d1c5-4224-98c9-d60fd192d33a]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] SCSI volumes sde have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d58e55-eb7c-4d02-b2f7-dd993bfb39e5]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb6b1e9-fefd-45b7-95cf-883ec9f521b2]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84, portal: 172.16.0.220,3260]
Aug 01 18:25:57 user nova-compute[72150]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84, portal: 172.16.0.220,3260] successful.
Aug 01 18:25:57 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4265b021-38ab-4756-9284-466525908b84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.050s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f21b50-08d8-4db1-bc3a-cd29749276c1]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.453s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] <== disconnect_volume: return (455ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryBPznhu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:25:58 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.041s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b61aabf-105b-43c9-8a1b-052832ed1311]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[17891c9f-706d-4fc8-a59c-65251e60f7d3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:25:58 user nova-compute[72150]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:25:58 user nova-compute[72150]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:25:58 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:25:58 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:25:58 user nova-compute[72150]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:25:58 user nova-compute[72150]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:25:58 user nova-compute[72150]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 (non-flash)
Aug 01 18:25:58 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c2b79a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6'): ({'sdf'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Removing single pathed devices sdf {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaff8fe-4311-4da7-b392-d62c6ac4fc6f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa58559-b324-437c-ada9-bb234aad8ce1]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Flushing IO for device /dev/sdf {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c913df-0dcd-42f3-8bb4-df3555646c5e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-3f8fb010-8914-4d40-b9f3-0502fbb8a265 req-176a04b0-673c-45ff-90c2-ddfcded2814a service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-plugged-fab43aac-fc06-4876-8c52-6f3e5a492217 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3f8fb010-8914-4d40-b9f3-0502fbb8a265 req-176a04b0-673c-45ff-90c2-ddfcded2814a service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3f8fb010-8914-4d40-b9f3-0502fbb8a265 req-176a04b0-673c-45ff-90c2-ddfcded2814a service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3f8fb010-8914-4d40-b9f3-0502fbb8a265 req-176a04b0-673c-45ff-90c2-ddfcded2814a service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-3f8fb010-8914-4d40-b9f3-0502fbb8a265 req-176a04b0-673c-45ff-90c2-ddfcded2814a service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-plugged-fab43aac-fc06-4876-8c52-6f3e5a492217 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:58 user nova-compute[72150]: WARNING nova.compute.manager [req-3f8fb010-8914-4d40-b9f3-0502fbb8a265 req-176a04b0-673c-45ff-90c2-ddfcded2814a service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received unexpected event network-vif-plugged-fab43aac-fc06-4876-8c52-6f3e5a492217 for instance with vm_state active and task_state deleting.
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.067s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d5737d-6fad-4df2-9ff3-4508d8d2a2b3]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] SCSI volumes sdf have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa9eedc-e64f-4bc8-847f-4687eb1c73dd]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a50741e-c153-4075-8e36-454a638e0b3a]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6, portal: 172.16.0.220,3260]
Aug 01 18:25:58 user nova-compute[72150]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6, portal: 172.16.0.220,3260] successful.
Aug 01 18:25:58 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12312153-e821-4e64-820f-7db2a4b28ea6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fb2a6e-30c9-438f-9ad5-a9995b61054d]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] <== disconnect_volume: return (440ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qIRExtkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:25:58 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e798b4-dc03-4e57-a04c-c7629b39fb43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8020063d-80a4-4755-8238-3856be774a6b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:25:58 user nova-compute[72150]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:25:58 user nova-compute[72150]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:25:58 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 (non-flash)
Aug 01 18:25:58 user nova-compute[72150]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:25:58 user nova-compute[72150]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:25:58 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c2b79a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534'): ({'sdg'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Removing single pathed devices sdg {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4409e8-0c10-4b8a-96ad-4df44398d037]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6c91e3-3e77-48df-9f5a-05039616b9bf]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Flushing IO for device /dev/sdg {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5ba450-2fc7-4d19-afb3-8f90c6c6f772]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe71ec37-aead-4a0a-81f5-ee20f757b83a]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] SCSI volumes sdg have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9441eb39-ab11-4dea-aa74-2e060a5c60c0]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df6a86d-a293-44c4-bc72-adbbf5bcb7ee]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534, portal: 172.16.0.220,3260]
Aug 01 18:25:58 user nova-compute[72150]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534, portal: 172.16.0.220,3260] successful.
Aug 01 18:25:58 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a5cada3-ff99-466b-8de0-0ffa99d75534 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f5f7fe-db72-4a38-a569-7a737d0e833b]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] <== disconnect_volume: return (354ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:25:58 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Deleting instance files /opt/stack/data/nova/instances/39ed0e93-df10-4f34-b13a-66a1825d21b9_del
Aug 01 18:25:58 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Deletion of /opt/stack/data/nova/instances/39ed0e93-df10-4f34-b13a-66a1825d21b9_del complete
Aug 01 18:25:58 user nova-compute[72150]: INFO nova.compute.manager [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Took 3.97 seconds to destroy the instance on the hypervisor.
Aug 01 18:25:58 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:25:58 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-unplugged-650c8b02-2525-403f-88d4-450a0903b33c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-unplugged-650c8b02-2525-403f-88d4-450a0903b33c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-unplugged-650c8b02-2525-403f-88d4-450a0903b33c for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-plugged-650c8b02-2525-403f-88d4-450a0903b33c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-plugged-650c8b02-2525-403f-88d4-450a0903b33c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:59 user nova-compute[72150]: WARNING nova.compute.manager [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received unexpected event network-vif-plugged-650c8b02-2525-403f-88d4-450a0903b33c for instance with vm_state active and task_state deleting.
Aug 01 18:25:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-unplugged-c024ac3e-43d1-4453-8715-9b49c747fb08 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-unplugged-c024ac3e-43d1-4453-8715-9b49c747fb08 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-unplugged-c024ac3e-43d1-4453-8715-9b49c747fb08 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-plugged-c024ac3e-43d1-4453-8715-9b49c747fb08 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-plugged-c024ac3e-43d1-4453-8715-9b49c747fb08 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:59 user nova-compute[72150]: WARNING nova.compute.manager [req-fbc6f2f3-2f3d-4d44-a1ab-3b12f6490952 req-b21f9abc-80ca-45f4-8f15-fa7ec0c101ac service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received unexpected event network-vif-plugged-c024ac3e-43d1-4453-8715-9b49c747fb08 for instance with vm_state active and task_state deleting.
Aug 01 18:25:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-e2ff54a6-44f6-4c9d-8b26-e2ae1ddf6b1a req-d33966b0-b08c-45eb-b771-71470af9f9de service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-unplugged-541680e9-0c34-47e2-b297-b3365281b90a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e2ff54a6-44f6-4c9d-8b26-e2ae1ddf6b1a req-d33966b0-b08c-45eb-b771-71470af9f9de service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e2ff54a6-44f6-4c9d-8b26-e2ae1ddf6b1a req-d33966b0-b08c-45eb-b771-71470af9f9de service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e2ff54a6-44f6-4c9d-8b26-e2ae1ddf6b1a req-d33966b0-b08c-45eb-b771-71470af9f9de service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-e2ff54a6-44f6-4c9d-8b26-e2ae1ddf6b1a req-d33966b0-b08c-45eb-b771-71470af9f9de service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-unplugged-541680e9-0c34-47e2-b297-b3365281b90a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-e2ff54a6-44f6-4c9d-8b26-e2ae1ddf6b1a req-d33966b0-b08c-45eb-b771-71470af9f9de service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-unplugged-541680e9-0c34-47e2-b297-b3365281b90a for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-e2ff54a6-44f6-4c9d-8b26-e2ae1ddf6b1a req-d33966b0-b08c-45eb-b771-71470af9f9de service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-plugged-541680e9-0c34-47e2-b297-b3365281b90a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e2ff54a6-44f6-4c9d-8b26-e2ae1ddf6b1a req-d33966b0-b08c-45eb-b771-71470af9f9de service nova] Acquiring lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e2ff54a6-44f6-4c9d-8b26-e2ae1ddf6b1a req-d33966b0-b08c-45eb-b771-71470af9f9de service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e2ff54a6-44f6-4c9d-8b26-e2ae1ddf6b1a req-d33966b0-b08c-45eb-b771-71470af9f9de service nova] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:25:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-e2ff54a6-44f6-4c9d-8b26-e2ae1ddf6b1a req-d33966b0-b08c-45eb-b771-71470af9f9de service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] No waiting events found dispatching network-vif-plugged-541680e9-0c34-47e2-b297-b3365281b90a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:25:59 user nova-compute[72150]: WARNING nova.compute.manager [req-e2ff54a6-44f6-4c9d-8b26-e2ae1ddf6b1a req-d33966b0-b08c-45eb-b771-71470af9f9de service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received unexpected event network-vif-plugged-541680e9-0c34-47e2-b297-b3365281b90a for instance with vm_state active and task_state deleting.
Aug 01 18:26:00 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914345.2530394, 9a4c69c1-6d13-4428-9460-be5988aa0b16 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:26:00 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] VM Stopped (Lifecycle Event)
Aug 01 18:26:00 user nova-compute[72150]: DEBUG nova.compute.manager [None req-e9152f62-15b7-4d11-b63f-a9a7c8377bde None None] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:26:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:00 user nova-compute[72150]: INFO nova.compute.manager [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Rebooting instance
Aug 01 18:26:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:26:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquired lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:26:00 user nova-compute[72150]: DEBUG nova.network.neutron [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:26:00 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914345.7809117, ad033976-bfc8-46b9-89bf-f752ae0cdf01 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:26:00 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] VM Stopped (Lifecycle Event)
Aug 01 18:26:00 user nova-compute[72150]: DEBUG nova.compute.manager [None req-89703b75-8f59-4e8f-b602-255c17a4af8a None None] [instance: ad033976-bfc8-46b9-89bf-f752ae0cdf01] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:26:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:02 user nova-compute[72150]: DEBUG nova.network.neutron [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Updating instance_info_cache with network_info: [{"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:26:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Releasing lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:26:02 user nova-compute[72150]: DEBUG nova.compute.manager [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:26:03 user nova-compute[72150]: DEBUG nova.compute.manager [req-5daa9058-650f-42d4-83e7-64787c056769 req-468bee6e-948e-4892-8a8f-fd7060169d4f service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-deleted-541680e9-0c34-47e2-b297-b3365281b90a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:03 user nova-compute[72150]: INFO nova.compute.manager [req-5daa9058-650f-42d4-83e7-64787c056769 req-468bee6e-948e-4892-8a8f-fd7060169d4f service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Neutron deleted interface 541680e9-0c34-47e2-b297-b3365281b90a; detaching it from the instance and deleting it from the info cache
Aug 01 18:26:03 user nova-compute[72150]: DEBUG nova.network.neutron [req-5daa9058-650f-42d4-83e7-64787c056769 req-468bee6e-948e-4892-8a8f-fd7060169d4f service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Updating instance_info_cache with network_info: [{"id": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "address": "fa:16:3e:dc:77:d0", "network": {"id": "f9631fa1-8ca7-453e-a8c2-a550baa29167", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2010840575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a977ce-d7", "ovs_interfaceid": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77546d5a-e74c-4058-9008-a09a455ba8d0", "address": "fa:16:3e:87:f5:13", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77546d5a-e7", "ovs_interfaceid": "77546d5a-e74c-4058-9008-a09a455ba8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fab43aac-fc06-4876-8c52-6f3e5a492217", "address": "fa:16:3e:9c:44:4d", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab43aac-fc", "ovs_interfaceid": "fab43aac-fc06-4876-8c52-6f3e5a492217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "address": "fa:16:3e:a8:fc:df", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6546d6-8f", "ovs_interfaceid": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "650c8b02-2525-403f-88d4-450a0903b33c", "address": "fa:16:3e:72:45:67", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap650c8b02-25", "ovs_interfaceid": "650c8b02-2525-403f-88d4-450a0903b33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c024ac3e-43d1-4453-8715-9b49c747fb08", "address": "fa:16:3e:c3:8d:39", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc024ac3e-43", "ovs_interfaceid": "c024ac3e-43d1-4453-8715-9b49c747fb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:26:03 user nova-compute[72150]: DEBUG nova.compute.manager [req-5daa9058-650f-42d4-83e7-64787c056769 req-468bee6e-948e-4892-8a8f-fd7060169d4f service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Detach interface failed, port_id=541680e9-0c34-47e2-b297-b3365281b90a, reason: Instance 39ed0e93-df10-4f34-b13a-66a1825d21b9 could not be found. {{(pid=72150) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 18:26:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:03 user nova-compute[72150]: DEBUG nova.compute.manager [req-a677206f-285a-4c52-a1fd-ba66121a8c37 req-2b53b1ab-f242-4f46-ac94-9224bae61361 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Received event network-vif-unplugged-10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a677206f-285a-4c52-a1fd-ba66121a8c37 req-2b53b1ab-f242-4f46-ac94-9224bae61361 service nova] Acquiring lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a677206f-285a-4c52-a1fd-ba66121a8c37 req-2b53b1ab-f242-4f46-ac94-9224bae61361 service nova] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a677206f-285a-4c52-a1fd-ba66121a8c37 req-2b53b1ab-f242-4f46-ac94-9224bae61361 service nova] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:03 user nova-compute[72150]: DEBUG nova.compute.manager [req-a677206f-285a-4c52-a1fd-ba66121a8c37 req-2b53b1ab-f242-4f46-ac94-9224bae61361 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] No waiting events found dispatching network-vif-unplugged-10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:26:03 user nova-compute[72150]: WARNING nova.compute.manager [req-a677206f-285a-4c52-a1fd-ba66121a8c37 req-2b53b1ab-f242-4f46-ac94-9224bae61361 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Received unexpected event network-vif-unplugged-10176957-b4a6-4052-9a16-21152c8c3da5 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 18:26:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:04 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Instance destroyed successfully.
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.objects.instance [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lazy-loading 'resources' on Instance uuid e298ac85-ebe3-4aa1-ae1e-91134e13e230 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-994333634',display_name='tempest-TestMinimumBasicScenario-server-994333634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-994333634',id=10,image_ref='77f1cc65-b096-4fb4-9a06-228694cfa68c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbsn8B14gNBI86YJLjn/1VQez4DBB7aV+emX4GIXXc8vb1FExIR+LmGYrOj/H27n+sU8ppSkdq7Qd+qISkUEu9gB+bpJa5naC6wPuaKhrVxha5Jkg1IxeczFB5ECbdm1A==',key_name='tempest-TestMinimumBasicScenario-1137783295',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:23:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96498272792348f3a3c36ee8544100f2',ramdisk_id='',reservation_id='r-c4g57isj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77f1cc65-b096-4fb4-9a06-228694cfa68c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-879365140',owner_user_name='tempest-TestMinimumBasicScenario-879365140-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:26:03Z,user_data=None,user_id='3d89a05b857d43c48f0767eb073a2f37',uuid=e298ac85-ebe3-4aa1-ae1e-91134e13e230,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Converting VIF {"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:4e:93,bridge_name='br-int',has_traffic_filtering=True,id=10176957-b4a6-4052-9a16-21152c8c3da5,network=Network(e3a4003a-4248-4265-b270-f289b1c2810f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10176957-b4') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_vif [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:4e:93,bridge_name='br-int',has_traffic_filtering=True,id=10176957-b4a6-4052-9a16-21152c8c3da5,network=Network(e3a4003a-4248-4265-b270-f289b1c2810f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10176957-b4') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10176957-b4, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:26:04 user nova-compute[72150]: INFO os_vif [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:4e:93,bridge_name='br-int',has_traffic_filtering=True,id=10176957-b4a6-4052-9a16-21152c8c3da5,network=Network(e3a4003a-4248-4265-b270-f289b1c2810f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10176957-b4')
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVImtzaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:26:04 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b1970a-8eba-4ce0-80ee-e2fff647657e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2264dcd2-5d84-4cc0-8238-87108374ae40]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:26:04 user nova-compute[72150]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:26:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:26:04 user nova-compute[72150]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:26:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec5475b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a'): ({'sdb'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Removing single pathed devices sdb {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[48466592-9ef5-4138-8a5e-e50b76bdd4e0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[07773951-728d-4d66-a978-9a29db2c3734]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Flushing IO for device /dev/sdb {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7de8963-7cde-4a13-b3ec-a85ab6d943c1]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.067s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fb5c2c-07d5-4878-81d1-276bbfc6e754]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d622da8a-8faf-4273-88c1-a7b8d4c44cba]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2ac0ca-f32d-40f3-9ea1-b87219ce3ab2]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a, portal: 172.16.0.220,3260]
Aug 01 18:26:04 user nova-compute[72150]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a, portal: 172.16.0.220,3260] successful.
Aug 01 18:26:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bc35ed-22e4-4229-8215-1433c79bae0a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] <== disconnect_volume: return (402ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Start _get_guest_xml network_info=[{"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=77f1cc65-b096-4fb4-9a06-228694cfa68c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '77f1cc65-b096-4fb4-9a06-228694cfa68c'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f387545f-1fd0-4f60-8c6a-0f3dbbb7b14f', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVImtzaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e298ac85-ebe3-4aa1-ae1e-91134e13e230', 'attached_at': '', 'detached_at': '', 'volume_id': '4628e1ee-2e16-4255-95e8-c5cc4e6c775a', 'serial': '4628e1ee-2e16-4255-95e8-c5cc4e6c775a'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:26:04 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:26:04 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=77f1cc65-b096-4fb4-9a06-228694cfa68c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.objects.instance [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lazy-loading 'vcpu_model' on Instance uuid e298ac85-ebe3-4aa1-ae1e-91134e13e230 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVImtzaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:26:04 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:26:04 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:26:04 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[be54215d-b4d5-47a8-8f1c-2cc4de8d8e39]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:26:04 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bed34a3-401a-4eb9-a81c-65f5f334b0a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a] added
Aug 01 18:26:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[104a3046-c162-4c48-958b-bb30e354eae6]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b2c6be-f9fb-4e68-b2c6-79c7f3cf5e36]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XVImtzaC {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XVImtzaC" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8e35bc-dbe8-48e5-b656-a867fb65de4d]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XVImtzaC'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebc9253-9e32-4128-92d2-69d62c9de251]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea04cbc8-daf3-409f-8fcb-4e4e5c6fa9b2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:26:04 user nova-compute[72150]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:26:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:26:04 user nova-compute[72150]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:26:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5689ec8-df24-4974-b29b-1c83d1ae7e84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a, portal: 172.16.0.220,3260]
Aug 01 18:26:04 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a, portal: 172.16.0.220,3260] successful.
Aug 01 18:26:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a1eb6a-3ce8-4774-8e98-b5f0d966dda2]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7b8ed1-1df2-48b8-a248-85409f44db9d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:26:04 user nova-compute[72150]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:26:04 user nova-compute[72150]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:26:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:26:04 user nova-compute[72150]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:26:04 user nova-compute[72150]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:26:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:26:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[966aea26-9d08-4abe-80b6-a5cbd6cf9d08]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:05 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:26:05 user nova-compute[72150]: DEBUG nova.compute.manager [req-0c4a28c3-4549-4aa3-b703-1cc7ec6070ae req-ec9ed4ef-988e-4d8d-b589-5b71ca5bc710 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-deleted-650c8b02-2525-403f-88d4-450a0903b33c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:05 user nova-compute[72150]: INFO nova.compute.manager [req-0c4a28c3-4549-4aa3-b703-1cc7ec6070ae req-ec9ed4ef-988e-4d8d-b589-5b71ca5bc710 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Neutron deleted interface 650c8b02-2525-403f-88d4-450a0903b33c; detaching it from the instance and deleting it from the info cache
Aug 01 18:26:05 user nova-compute[72150]: DEBUG nova.network.neutron [req-0c4a28c3-4549-4aa3-b703-1cc7ec6070ae req-ec9ed4ef-988e-4d8d-b589-5b71ca5bc710 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Updating instance_info_cache with network_info: [{"id": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "address": "fa:16:3e:dc:77:d0", "network": {"id": "f9631fa1-8ca7-453e-a8c2-a550baa29167", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2010840575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a977ce-d7", "ovs_interfaceid": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77546d5a-e74c-4058-9008-a09a455ba8d0", "address": "fa:16:3e:87:f5:13", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77546d5a-e7", "ovs_interfaceid": "77546d5a-e74c-4058-9008-a09a455ba8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fab43aac-fc06-4876-8c52-6f3e5a492217", "address": "fa:16:3e:9c:44:4d", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab43aac-fc", "ovs_interfaceid": "fab43aac-fc06-4876-8c52-6f3e5a492217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "address": "fa:16:3e:a8:fc:df", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6546d6-8f", "ovs_interfaceid": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c024ac3e-43d1-4453-8715-9b49c747fb08", "address": "fa:16:3e:c3:8d:39", "network": {"id": "2738102a-fe12-412d-9dc2-a1ce7a79997a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1402326250", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc024ac3e-43", "ovs_interfaceid": "c024ac3e-43d1-4453-8715-9b49c747fb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:26:05 user nova-compute[72150]: DEBUG nova.compute.manager [req-0c4a28c3-4549-4aa3-b703-1cc7ec6070ae req-ec9ed4ef-988e-4d8d-b589-5b71ca5bc710 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Detach interface failed, port_id=650c8b02-2525-403f-88d4-450a0903b33c, reason: Instance 39ed0e93-df10-4f34-b13a-66a1825d21b9 could not be found. {{(pid=72150) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 18:26:05 user nova-compute[72150]: DEBUG nova.compute.manager [req-0c4a28c3-4549-4aa3-b703-1cc7ec6070ae req-ec9ed4ef-988e-4d8d-b589-5b71ca5bc710 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-deleted-c024ac3e-43d1-4453-8715-9b49c747fb08 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:05 user nova-compute[72150]: INFO nova.compute.manager [req-0c4a28c3-4549-4aa3-b703-1cc7ec6070ae req-ec9ed4ef-988e-4d8d-b589-5b71ca5bc710 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Neutron deleted interface c024ac3e-43d1-4453-8715-9b49c747fb08; detaching it from the instance and deleting it from the info cache
Aug 01 18:26:05 user nova-compute[72150]: DEBUG nova.network.neutron [req-0c4a28c3-4549-4aa3-b703-1cc7ec6070ae req-ec9ed4ef-988e-4d8d-b589-5b71ca5bc710 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Updating instance_info_cache with network_info: [{"id": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "address": "fa:16:3e:dc:77:d0", "network": {"id": "f9631fa1-8ca7-453e-a8c2-a550baa29167", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2010840575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a977ce-d7", "ovs_interfaceid": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77546d5a-e74c-4058-9008-a09a455ba8d0", "address": "fa:16:3e:87:f5:13", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77546d5a-e7", "ovs_interfaceid": "77546d5a-e74c-4058-9008-a09a455ba8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fab43aac-fc06-4876-8c52-6f3e5a492217", "address": "fa:16:3e:9c:44:4d", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab43aac-fc", "ovs_interfaceid": "fab43aac-fc06-4876-8c52-6f3e5a492217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "address": "fa:16:3e:a8:fc:df", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6546d6-8f", "ovs_interfaceid": "1e6546d6-8fa5-4298-851b-3fb6efa9420c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:26:05 user nova-compute[72150]: DEBUG nova.compute.manager [req-0c4a28c3-4549-4aa3-b703-1cc7ec6070ae req-ec9ed4ef-988e-4d8d-b589-5b71ca5bc710 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Detach interface failed, port_id=c024ac3e-43d1-4453-8715-9b49c747fb08, reason: Instance 39ed0e93-df10-4f34-b13a-66a1825d21b9 could not be found. {{(pid=72150) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 18:26:05 user nova-compute[72150]: DEBUG nova.compute.manager [req-0c4a28c3-4549-4aa3-b703-1cc7ec6070ae req-ec9ed4ef-988e-4d8d-b589-5b71ca5bc710 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-deleted-1e6546d6-8fa5-4298-851b-3fb6efa9420c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:05 user nova-compute[72150]: INFO nova.compute.manager [req-0c4a28c3-4549-4aa3-b703-1cc7ec6070ae req-ec9ed4ef-988e-4d8d-b589-5b71ca5bc710 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Neutron deleted interface 1e6546d6-8fa5-4298-851b-3fb6efa9420c; detaching it from the instance and deleting it from the info cache
Aug 01 18:26:05 user nova-compute[72150]: DEBUG nova.network.neutron [req-0c4a28c3-4549-4aa3-b703-1cc7ec6070ae req-ec9ed4ef-988e-4d8d-b589-5b71ca5bc710 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Updating instance_info_cache with network_info: [{"id": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "address": "fa:16:3e:dc:77:d0", "network": {"id": "f9631fa1-8ca7-453e-a8c2-a550baa29167", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2010840575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a977ce-d7", "ovs_interfaceid": "39a977ce-d734-4852-838b-6dfbb51c0bf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77546d5a-e74c-4058-9008-a09a455ba8d0", "address": "fa:16:3e:87:f5:13", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77546d5a-e7", "ovs_interfaceid": "77546d5a-e74c-4058-9008-a09a455ba8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fab43aac-fc06-4876-8c52-6f3e5a492217", "address": "fa:16:3e:9c:44:4d", "network": {"id": "5cb49305-f063-42d1-85a8-0df638e9af28", "bridge": "br-int", "label": "tempest-device-tagging-net1-913818651", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b60b336a42e94d27b1079bbf8732eb7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab43aac-fc", "ovs_interfaceid": "fab43aac-fc06-4876-8c52-6f3e5a492217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:26:05 user nova-compute[72150]: DEBUG nova.compute.manager [req-0c4a28c3-4549-4aa3-b703-1cc7ec6070ae req-ec9ed4ef-988e-4d8d-b589-5b71ca5bc710 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Detach interface failed, port_id=1e6546d6-8fa5-4298-851b-3fb6efa9420c, reason: Instance 39ed0e93-df10-4f34-b13a-66a1825d21b9 could not be found. {{(pid=72150) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 18:26:05 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:26:05 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Took 6.60 seconds to deallocate network for instance.
Aug 01 18:26:05 user nova-compute[72150]: DEBUG nova.compute.manager [req-4791a5ee-aa93-482c-94dd-551fd62b5fb4 req-590ecfab-318c-4d9f-a44e-29b20a1121b9 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Received event network-vif-plugged-10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4791a5ee-aa93-482c-94dd-551fd62b5fb4 req-590ecfab-318c-4d9f-a44e-29b20a1121b9 service nova] Acquiring lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4791a5ee-aa93-482c-94dd-551fd62b5fb4 req-590ecfab-318c-4d9f-a44e-29b20a1121b9 service nova] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4791a5ee-aa93-482c-94dd-551fd62b5fb4 req-590ecfab-318c-4d9f-a44e-29b20a1121b9 service nova] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:05 user nova-compute[72150]: DEBUG nova.compute.manager [req-4791a5ee-aa93-482c-94dd-551fd62b5fb4 req-590ecfab-318c-4d9f-a44e-29b20a1121b9 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] No waiting events found dispatching network-vif-plugged-10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:26:05 user nova-compute[72150]: WARNING nova.compute.manager [req-4791a5ee-aa93-482c-94dd-551fd62b5fb4 req-590ecfab-318c-4d9f-a44e-29b20a1121b9 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Received unexpected event network-vif-plugged-10176957-b4a6-4052-9a16-21152c8c3da5 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 18:26:06 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdd {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVImtzaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23732663034653666', 'path': '/dev/sdd'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732663034653666', 'path': '/dev/sdd'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-994333634',display_name='tempest-TestMinimumBasicScenario-server-994333634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-994333634',id=10,image_ref='77f1cc65-b096-4fb4-9a06-228694cfa68c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbsn8B14gNBI86YJLjn/1VQez4DBB7aV+emX4GIXXc8vb1FExIR+LmGYrOj/H27n+sU8ppSkdq7Qd+qISkUEu9gB+bpJa5naC6wPuaKhrVxha5Jkg1IxeczFB5ECbdm1A==',key_name='tempest-TestMinimumBasicScenario-1137783295',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:23:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96498272792348f3a3c36ee8544100f2',ramdisk_id='',reservation_id='r-c4g57isj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77f1cc65-b096-4fb4-9a06-228694cfa68c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-879365140',owner_user_name='tempest-TestMinimumBasicScenario-879365140-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:26:03Z,user_data=None,user_id='3d89a05b857d43c48f0767eb073a2f37',uuid=e298ac85-ebe3-4aa1-ae1e-91134e13e230,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Converting VIF {"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:4e:93,bridge_name='br-int',has_traffic_filtering=True,id=10176957-b4a6-4052-9a16-21152c8c3da5,network=Network(e3a4003a-4248-4265-b270-f289b1c2810f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10176957-b4') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG nova.objects.instance [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lazy-loading 'pci_devices' on Instance uuid e298ac85-ebe3-4aa1-ae1e-91134e13e230 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:26:06 user nova-compute[72150]:   <uuid>e298ac85-ebe3-4aa1-ae1e-91134e13e230</uuid>
Aug 01 18:26:06 user nova-compute[72150]:   <name>instance-0000000a</name>
Aug 01 18:26:06 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:26:06 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:26:06 user nova-compute[72150]:   <metadata>
Aug 01 18:26:06 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:26:06 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:26:06 user nova-compute[72150]:       <nova:name>tempest-TestMinimumBasicScenario-server-994333634</nova:name>
Aug 01 18:26:06 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:26:04</nova:creationTime>
Aug 01 18:26:06 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:26:06 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:26:06 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:26:06 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:26:06 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:26:06 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:26:06 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:26:06 user nova-compute[72150]:       <nova:owner>
Aug 01 18:26:06 user nova-compute[72150]:         <nova:user uuid="3d89a05b857d43c48f0767eb073a2f37">tempest-TestMinimumBasicScenario-879365140-project-member</nova:user>
Aug 01 18:26:06 user nova-compute[72150]:         <nova:project uuid="96498272792348f3a3c36ee8544100f2">tempest-TestMinimumBasicScenario-879365140</nova:project>
Aug 01 18:26:06 user nova-compute[72150]:       </nova:owner>
Aug 01 18:26:06 user nova-compute[72150]:       <nova:root type="image" uuid="77f1cc65-b096-4fb4-9a06-228694cfa68c"/>
Aug 01 18:26:06 user nova-compute[72150]:       <nova:ports>
Aug 01 18:26:06 user nova-compute[72150]:         <nova:port uuid="10176957-b4a6-4052-9a16-21152c8c3da5">
Aug 01 18:26:06 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 18:26:06 user nova-compute[72150]:         </nova:port>
Aug 01 18:26:06 user nova-compute[72150]:       </nova:ports>
Aug 01 18:26:06 user nova-compute[72150]:     </nova:instance>
Aug 01 18:26:06 user nova-compute[72150]:   </metadata>
Aug 01 18:26:06 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:26:06 user nova-compute[72150]:     <system>
Aug 01 18:26:06 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:26:06 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:26:06 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:26:06 user nova-compute[72150]:       <entry name="serial">e298ac85-ebe3-4aa1-ae1e-91134e13e230</entry>
Aug 01 18:26:06 user nova-compute[72150]:       <entry name="uuid">e298ac85-ebe3-4aa1-ae1e-91134e13e230</entry>
Aug 01 18:26:06 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:26:06 user nova-compute[72150]:     </system>
Aug 01 18:26:06 user nova-compute[72150]:   </sysinfo>
Aug 01 18:26:06 user nova-compute[72150]:   <os>
Aug 01 18:26:06 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:26:06 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:26:06 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:26:06 user nova-compute[72150]:   </os>
Aug 01 18:26:06 user nova-compute[72150]:   <features>
Aug 01 18:26:06 user nova-compute[72150]:     <acpi/>
Aug 01 18:26:06 user nova-compute[72150]:     <apic/>
Aug 01 18:26:06 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:26:06 user nova-compute[72150]:   </features>
Aug 01 18:26:06 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:26:06 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:26:06 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:26:06 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:26:06 user nova-compute[72150]:   </clock>
Aug 01 18:26:06 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:26:06 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:26:06 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:26:06 user nova-compute[72150]:   </cpu>
Aug 01 18:26:06 user nova-compute[72150]:   <devices>
Aug 01 18:26:06 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:26:06 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:26:06 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk"/>
Aug 01 18:26:06 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:26:06 user nova-compute[72150]:     </disk>
Aug 01 18:26:06 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:26:06 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:26:06 user nova-compute[72150]:       <source dev="/dev/sdd"/>
Aug 01 18:26:06 user nova-compute[72150]:       <target dev="vdb" bus="virtio"/>
Aug 01 18:26:06 user nova-compute[72150]:       <serial>4628e1ee-2e16-4255-95e8-c5cc4e6c775a</serial>
Aug 01 18:26:06 user nova-compute[72150]:     </disk>
Aug 01 18:26:06 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:26:06 user nova-compute[72150]:       <mac address="fa:16:3e:c1:4e:93"/>
Aug 01 18:26:06 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:26:06 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:26:06 user nova-compute[72150]:       <target dev="tap10176957-b4"/>
Aug 01 18:26:06 user nova-compute[72150]:     </interface>
Aug 01 18:26:06 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:26:06 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/console.log" append="off"/>
Aug 01 18:26:06 user nova-compute[72150]:     </serial>
Aug 01 18:26:06 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:26:06 user nova-compute[72150]:     <video>
Aug 01 18:26:06 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:26:06 user nova-compute[72150]:     </video>
Aug 01 18:26:06 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:26:06 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:26:06 user nova-compute[72150]:     </rng>
Aug 01 18:26:06 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:26:06 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:26:06 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:26:06 user nova-compute[72150]:     </memballoon>
Aug 01 18:26:06 user nova-compute[72150]:   </devices>
Aug 01 18:26:06 user nova-compute[72150]: </domain>
Aug 01 18:26:06 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG nova.objects.instance [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lazy-loading 'trusted_certs' on Instance uuid e298ac85-ebe3-4aa1-ae1e-91134e13e230 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49572197531b3fda7c0e699167df4e97b908aabe --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49572197531b3fda7c0e699167df4e97b908aabe --force-share --output=json" returned: 0 in 0.148s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Cannot resize image /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG nova.objects.instance [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lazy-loading 'migration_context' on Instance uuid e298ac85-ebe3-4aa1-ae1e-91134e13e230 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-994333634',display_name='tempest-TestMinimumBasicScenario-server-994333634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-994333634',id=10,image_ref='77f1cc65-b096-4fb4-9a06-228694cfa68c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbsn8B14gNBI86YJLjn/1VQez4DBB7aV+emX4GIXXc8vb1FExIR+LmGYrOj/H27n+sU8ppSkdq7Qd+qISkUEu9gB+bpJa5naC6wPuaKhrVxha5Jkg1IxeczFB5ECbdm1A==',key_name='tempest-TestMinimumBasicScenario-1137783295',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:23:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='96498272792348f3a3c36ee8544100f2',ramdisk_id='',reservation_id='r-c4g57isj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77f1cc65-b096-4fb4-9a06-228694cfa68c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-879365140',owner_user_name='tempest-TestMinimumBasicScenario-879365140-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:26:03Z,user_data=None,user_id='3d89a05b857d43c48f0767eb073a2f37',uuid=e298ac85-ebe3-4aa1-ae1e-91134e13e230,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Converting VIF {"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:4e:93,bridge_name='br-int',has_traffic_filtering=True,id=10176957-b4a6-4052-9a16-21152c8c3da5,network=Network(e3a4003a-4248-4265-b270-f289b1c2810f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10176957-b4') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG os_vif [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:4e:93,bridge_name='br-int',has_traffic_filtering=True,id=10176957-b4a6-4052-9a16-21152c8c3da5,network=Network(e3a4003a-4248-4265-b270-f289b1c2810f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10176957-b4') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10176957-b4, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap10176957-b4, col_values=(('external_ids', {'iface-id': '10176957-b4a6-4052-9a16-21152c8c3da5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:4e:93', 'vm-uuid': 'e298ac85-ebe3-4aa1-ae1e-91134e13e230'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:26:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:06 user nova-compute[72150]: INFO os_vif [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:4e:93,bridge_name='br-int',has_traffic_filtering=True,id=10176957-b4a6-4052-9a16-21152c8c3da5,network=Network(e3a4003a-4248-4265-b270-f289b1c2810f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10176957-b4')
Aug 01 18:26:07 user nova-compute[72150]: DEBUG nova.compute.manager [req-63ac5829-5639-4ba9-8ce8-7a67e0facf22 req-84a16f74-c72e-485a-b6ec-7cc9a2aae1e3 service nova] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Received event network-vif-deleted-39a977ce-d734-4852-838b-6dfbb51c0bf8 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:08 user nova-compute[72150]: DEBUG nova.compute.manager [req-2b66e653-6b3b-4851-8f2d-d3173c671a8c req-264bd782-08fa-43f0-bfb5-dd1bcddc67c5 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Received event network-vif-plugged-10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2b66e653-6b3b-4851-8f2d-d3173c671a8c req-264bd782-08fa-43f0-bfb5-dd1bcddc67c5 service nova] Acquiring lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2b66e653-6b3b-4851-8f2d-d3173c671a8c req-264bd782-08fa-43f0-bfb5-dd1bcddc67c5 service nova] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2b66e653-6b3b-4851-8f2d-d3173c671a8c req-264bd782-08fa-43f0-bfb5-dd1bcddc67c5 service nova] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:08 user nova-compute[72150]: DEBUG nova.compute.manager [req-2b66e653-6b3b-4851-8f2d-d3173c671a8c req-264bd782-08fa-43f0-bfb5-dd1bcddc67c5 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] No waiting events found dispatching network-vif-plugged-10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:26:08 user nova-compute[72150]: WARNING nova.compute.manager [req-2b66e653-6b3b-4851-8f2d-d3173c671a8c req-264bd782-08fa-43f0-bfb5-dd1bcddc67c5 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Received unexpected event network-vif-plugged-10176957-b4a6-4052-9a16-21152c8c3da5 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 18:26:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:11 user nova-compute[72150]: DEBUG nova.compute.manager [req-6ffddf7b-d952-4bc5-b8c3-3045a7a5e400 req-daf2084c-fcfe-432b-9ed3-75fdf09c20e5 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Received event network-vif-plugged-10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6ffddf7b-d952-4bc5-b8c3-3045a7a5e400 req-daf2084c-fcfe-432b-9ed3-75fdf09c20e5 service nova] Acquiring lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6ffddf7b-d952-4bc5-b8c3-3045a7a5e400 req-daf2084c-fcfe-432b-9ed3-75fdf09c20e5 service nova] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6ffddf7b-d952-4bc5-b8c3-3045a7a5e400 req-daf2084c-fcfe-432b-9ed3-75fdf09c20e5 service nova] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:11 user nova-compute[72150]: DEBUG nova.compute.manager [req-6ffddf7b-d952-4bc5-b8c3-3045a7a5e400 req-daf2084c-fcfe-432b-9ed3-75fdf09c20e5 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] No waiting events found dispatching network-vif-plugged-10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:26:11 user nova-compute[72150]: WARNING nova.compute.manager [req-6ffddf7b-d952-4bc5-b8c3-3045a7a5e400 req-daf2084c-fcfe-432b-9ed3-75fdf09c20e5 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Received unexpected event network-vif-plugged-10176957-b4a6-4052-9a16-21152c8c3da5 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 18:26:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Removed pending event for e298ac85-ebe3-4aa1-ae1e-91134e13e230 due to event {{(pid=72150) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 18:26:11 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914371.45814, e298ac85-ebe3-4aa1-ae1e-91134e13e230 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:26:11 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] VM Resumed (Lifecycle Event)
Aug 01 18:26:11 user nova-compute[72150]: DEBUG nova.compute.manager [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:26:11 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Instance rebooted successfully.
Aug 01 18:26:11 user nova-compute[72150]: DEBUG nova.compute.manager [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:26:11 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:26:11 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:26:11 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 01 18:26:11 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914371.4757836, e298ac85-ebe3-4aa1-ae1e-91134e13e230 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:26:11 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] VM Started (Lifecycle Event)
Aug 01 18:26:11 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:26:11 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:26:11 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 01 18:26:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-733cbf65-63c8-4cdb-9b32-77052cb227b7 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 11.402s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:12 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914357.1325285, 39ed0e93-df10-4f34-b13a-66a1825d21b9 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:26:12 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] VM Stopped (Lifecycle Event)
Aug 01 18:26:12 user nova-compute[72150]: DEBUG nova.compute.manager [None req-797df8fe-7ab0-468a-b0a1-da56f5f2280b None None] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:26:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:14 user nova-compute[72150]: INFO nova.compute.manager [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] [instance: 39ed0e93-df10-4f34-b13a-66a1825d21b9] Took 8.95 seconds to detach 3 volumes for instance.
Aug 01 18:26:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:14 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:26:14 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:26:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:15 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Deleted allocations for instance 39ed0e93-df10-4f34-b13a-66a1825d21b9
Aug 01 18:26:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-2d2811d8-f149-486b-9177-236c74b5cc00 tempest-TaggedBootDevicesTest_v242-1666899254 tempest-TaggedBootDevicesTest_v242-1666899254-project-member] Lock "39ed0e93-df10-4f34-b13a-66a1825d21b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 20.235s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG nova.compute.manager [req-9783d9ba-380b-4438-8386-bf6e5b210817 req-a380c244-a547-48ef-999a-83c454703d2d service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Received event volume-reimaged-99176d6f-ea51-4322-b763-9a4f8a154d17 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9783d9ba-380b-4438-8386-bf6e5b210817 req-a380c244-a547-48ef-999a-83c454703d2d service nova] Acquiring lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9783d9ba-380b-4438-8386-bf6e5b210817 req-a380c244-a547-48ef-999a-83c454703d2d service nova] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9783d9ba-380b-4438-8386-bf6e5b210817 req-a380c244-a547-48ef-999a-83c454703d2d service nova] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG nova.compute.manager [req-9783d9ba-380b-4438-8386-bf6e5b210817 req-a380c244-a547-48ef-999a-83c454703d2d service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Processing event volume-reimaged-99176d6f-ea51-4322-b763-9a4f8a154d17 {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Instance event wait completed in 23 seconds for volume-reimaged {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:26:16 user nova-compute[72150]: INFO nova.virt.block_device [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Booting with volume 99176d6f-ea51-4322-b763-9a4f8a154d17 at /dev/vda
Aug 01 18:26:16 user nova-compute[72150]: DEBUG os_brick.utils [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a72ba6b-ae25-4a5d-b1dc-3428fabef002]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[057db7d9-41e1-4cdd-9f1b-01085b2c1b9f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[34de3e67-c4b4-4366-a9b9-c162cd0d1fd7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2754a4-fa4a-491e-aabd-9b96ae274ffb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:26:16 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:26:16 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[66aa55d5-eb09-4217-8b3b-a666f2ba8425]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG os_brick.utils [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Updating existing volume attachment record: 9ef8fb7a-6677-4375-80e1-6a3ba634e83b {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:26:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:26:25 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Creating image(s)
Aug 01 18:26:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Did not create local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Ensure instance console log exists: /opt/stack/data/nova/instances/9a4c69c1-6d13-4428-9460-be5988aa0b16/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Start _get_guest_xml network_info=[{"id": "3383d1ec-873d-4660-a685-3d71c2e0092c", "address": "fa:16:3e:ab:5f:8a", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3383d1ec-87", "ovs_interfaceid": "3383d1ec-873d-4660-a685-3d71c2e0092c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9ef8fb7a-6677-4375-80e1-6a3ba634e83b', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWXaJRkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9a4c69c1-6d13-4428-9460-be5988aa0b16', 'attached_at': '', 'detached_at': '', 'volume_id': '99176d6f-ea51-4322-b763-9a4f8a154d17', 'serial': '99176d6f-ea51-4322-b763-9a4f8a154d17'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:26:25 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 18:26:25 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 18:26:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9a4c69c1-6d13-4428-9460-be5988aa0b16 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWXaJRkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:26:25 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:26:25 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:26:25 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e937ad29-dfc9-4a0b-aebb-dba8aa4f4725]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:26:25 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee27884b-61f5-4bf4-8253-c9916d6b7fa0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17] added
Aug 01 18:26:25 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[880d988a-b78b-4c0c-bb6b-140f8a82b409]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a42b25-0fa5-46eb-8594-bb7827077d1b]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oWXaJRkr {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oWXaJRkr" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffc591b-5f00-416c-99cf-f498bec8b247]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oWXaJRkr'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c579ff7-31e5-406e-a784-1cc0dcb18249]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00ab90a-1ad2-4126-856a-68a864f590a6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:26:25 user nova-compute[72150]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:26:25 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:26:25 user nova-compute[72150]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:26:25 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4100de-6aa0-497f-8c65-6b0ccd3304a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17, portal: 172.16.0.220,3260]
Aug 01 18:26:25 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17, portal: 172.16.0.220,3260] successful.
Aug 01 18:26:25 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a723d8-bea1-4211-b136-5ef945ee6bf4]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4158e1-fb6d-41ca-b620-1a61f439383e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:26:25 user nova-compute[72150]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:26:25 user nova-compute[72150]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:26:25 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:26:25 user nova-compute[72150]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:26:25 user nova-compute[72150]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:26:25 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b371c0e-a564-47cf-9961-1b42b654c66e]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdb {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:26:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWXaJRkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:26:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:26 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:26:26 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23834306331633534', 'path': '/dev/sdb'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:26:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834306331633534', 'path': '/dev/sdb'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:26:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T18:23:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1141577599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1283435186',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+Nn4jIkP7o81KAVSuEafYwZ26XCjfE3kKImFLpIJCuWu6CIp77lxBWVyFrwhzih2blhaPYtQDdQOnjy77eqEv5UzljWf90RHtb08BFC6XddfTDCcic8R7KEtRpk3mn7g==',key_name='tempest-keypair-1383383211',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:24:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4cec5474a64d46c2bfc92435c677abf2',ramdisk_id='',reservation_id='r-wxny26dq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1421721381',owner_user_name='tempest-ServerActionsV293TestJSON-1421721381-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:26:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e312b378dd2b43798193756afb51e343',uuid=9a4c69c1-6d13-4428-9460-be5988aa0b16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3383d1ec-873d-4660-a685-3d71c2e0092c", "address": "fa:16:3e:ab:5f:8a", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3383d1ec-87", "ovs_interfaceid": "3383d1ec-873d-4660-a685-3d71c2e0092c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:26:26 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Converting VIF {"id": "3383d1ec-873d-4660-a685-3d71c2e0092c", "address": "fa:16:3e:ab:5f:8a", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3383d1ec-87", "ovs_interfaceid": "3383d1ec-873d-4660-a685-3d71c2e0092c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:26:26 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:5f:8a,bridge_name='br-int',has_traffic_filtering=True,id=3383d1ec-873d-4660-a685-3d71c2e0092c,network=Network(ac6e56c1-0122-4bc2-b6b2-a76d80894c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3383d1ec-87') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:26:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:26:26 user nova-compute[72150]:   <uuid>9a4c69c1-6d13-4428-9460-be5988aa0b16</uuid>
Aug 01 18:26:26 user nova-compute[72150]:   <name>instance-0000000b</name>
Aug 01 18:26:26 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:26:26 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:26:26 user nova-compute[72150]:   <metadata>
Aug 01 18:26:26 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:26:26 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:26:26 user nova-compute[72150]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1141577599</nova:name>
Aug 01 18:26:26 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:26:25</nova:creationTime>
Aug 01 18:26:26 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:26:26 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:26:26 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:26:26 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:26:26 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:26:26 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:26:26 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:26:26 user nova-compute[72150]:       <nova:owner>
Aug 01 18:26:26 user nova-compute[72150]:         <nova:user uuid="e312b378dd2b43798193756afb51e343">tempest-ServerActionsV293TestJSON-1421721381-project-member</nova:user>
Aug 01 18:26:26 user nova-compute[72150]:         <nova:project uuid="4cec5474a64d46c2bfc92435c677abf2">tempest-ServerActionsV293TestJSON-1421721381</nova:project>
Aug 01 18:26:26 user nova-compute[72150]:       </nova:owner>
Aug 01 18:26:26 user nova-compute[72150]:       <nova:ports>
Aug 01 18:26:26 user nova-compute[72150]:         <nova:port uuid="3383d1ec-873d-4660-a685-3d71c2e0092c">
Aug 01 18:26:26 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 18:26:26 user nova-compute[72150]:         </nova:port>
Aug 01 18:26:26 user nova-compute[72150]:       </nova:ports>
Aug 01 18:26:26 user nova-compute[72150]:     </nova:instance>
Aug 01 18:26:26 user nova-compute[72150]:   </metadata>
Aug 01 18:26:26 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:26:26 user nova-compute[72150]:     <system>
Aug 01 18:26:26 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:26:26 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:26:26 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:26:26 user nova-compute[72150]:       <entry name="serial">9a4c69c1-6d13-4428-9460-be5988aa0b16</entry>
Aug 01 18:26:26 user nova-compute[72150]:       <entry name="uuid">9a4c69c1-6d13-4428-9460-be5988aa0b16</entry>
Aug 01 18:26:26 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:26:26 user nova-compute[72150]:     </system>
Aug 01 18:26:26 user nova-compute[72150]:   </sysinfo>
Aug 01 18:26:26 user nova-compute[72150]:   <os>
Aug 01 18:26:26 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:26:26 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:26:26 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:26:26 user nova-compute[72150]:   </os>
Aug 01 18:26:26 user nova-compute[72150]:   <features>
Aug 01 18:26:26 user nova-compute[72150]:     <acpi/>
Aug 01 18:26:26 user nova-compute[72150]:     <apic/>
Aug 01 18:26:26 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:26:26 user nova-compute[72150]:   </features>
Aug 01 18:26:26 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:26:26 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:26:26 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:26:26 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:26:26 user nova-compute[72150]:   </clock>
Aug 01 18:26:26 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:26:26 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:26:26 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:26:26 user nova-compute[72150]:   </cpu>
Aug 01 18:26:26 user nova-compute[72150]:   <devices>
Aug 01 18:26:26 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:26:26 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:26:26 user nova-compute[72150]:       <source dev="/dev/sdb"/>
Aug 01 18:26:26 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:26:26 user nova-compute[72150]:       <serial>99176d6f-ea51-4322-b763-9a4f8a154d17</serial>
Aug 01 18:26:26 user nova-compute[72150]:     </disk>
Aug 01 18:26:26 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:26:26 user nova-compute[72150]:       <mac address="fa:16:3e:ab:5f:8a"/>
Aug 01 18:26:26 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:26:26 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:26:26 user nova-compute[72150]:       <target dev="tap3383d1ec-87"/>
Aug 01 18:26:26 user nova-compute[72150]:     </interface>
Aug 01 18:26:26 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:26:26 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/9a4c69c1-6d13-4428-9460-be5988aa0b16/console.log" append="off"/>
Aug 01 18:26:26 user nova-compute[72150]:     </serial>
Aug 01 18:26:26 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:26:26 user nova-compute[72150]:     <video>
Aug 01 18:26:26 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:26:26 user nova-compute[72150]:     </video>
Aug 01 18:26:26 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:26:26 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:26:26 user nova-compute[72150]:     </rng>
Aug 01 18:26:26 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:26:26 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:26:26 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:26:26 user nova-compute[72150]:     </memballoon>
Aug 01 18:26:26 user nova-compute[72150]:   </devices>
Aug 01 18:26:26 user nova-compute[72150]: </domain>
Aug 01 18:26:26 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:26:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T18:23:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1141577599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1283435186',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+Nn4jIkP7o81KAVSuEafYwZ26XCjfE3kKImFLpIJCuWu6CIp77lxBWVyFrwhzih2blhaPYtQDdQOnjy77eqEv5UzljWf90RHtb08BFC6XddfTDCcic8R7KEtRpk3mn7g==',key_name='tempest-keypair-1383383211',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:24:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4cec5474a64d46c2bfc92435c677abf2',ramdisk_id='',reservation_id='r-wxny26dq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1421721381',owner_user_name='tempest-ServerActionsV293TestJSON-1421721381-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:26:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e312b378dd2b43798193756afb51e343',uuid=9a4c69c1-6d13-4428-9460-be5988aa0b16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3383d1ec-873d-4660-a685-3d71c2e0092c", "address": "fa:16:3e:ab:5f:8a", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3383d1ec-87", "ovs_interfaceid": "3383d1ec-873d-4660-a685-3d71c2e0092c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:26:26 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Converting VIF {"id": "3383d1ec-873d-4660-a685-3d71c2e0092c", "address": "fa:16:3e:ab:5f:8a", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3383d1ec-87", "ovs_interfaceid": "3383d1ec-873d-4660-a685-3d71c2e0092c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:26:26 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:5f:8a,bridge_name='br-int',has_traffic_filtering=True,id=3383d1ec-873d-4660-a685-3d71c2e0092c,network=Network(ac6e56c1-0122-4bc2-b6b2-a76d80894c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3383d1ec-87') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:26:26 user nova-compute[72150]: DEBUG os_vif [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:5f:8a,bridge_name='br-int',has_traffic_filtering=True,id=3383d1ec-873d-4660-a685-3d71c2e0092c,network=Network(ac6e56c1-0122-4bc2-b6b2-a76d80894c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3383d1ec-87') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:26:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:26:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:26:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3383d1ec-87, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:26:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3383d1ec-87, col_values=(('external_ids', {'iface-id': '3383d1ec-873d-4660-a685-3d71c2e0092c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:5f:8a', 'vm-uuid': '9a4c69c1-6d13-4428-9460-be5988aa0b16'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:26:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:26:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:26 user nova-compute[72150]: INFO os_vif [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:5f:8a,bridge_name='br-int',has_traffic_filtering=True,id=3383d1ec-873d-4660-a685-3d71c2e0092c,network=Network(ac6e56c1-0122-4bc2-b6b2-a76d80894c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3383d1ec-87')
Aug 01 18:26:27 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:26:27 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] No VIF found with MAC fa:16:3e:ab:5f:8a, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:26:27 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:26:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:27 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:26:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "08851ec4-6f71-4ec1-a092-42aab83ee87f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "08851ec4-6f71-4ec1-a092-42aab83ee87f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:27 user nova-compute[72150]: DEBUG nova.compute.manager [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:26:28 user nova-compute[72150]: INFO nova.compute.claims [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Claim successful on node user
Aug 01 18:26:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.200s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:26:28 user nova-compute[72150]: INFO nova.compute.claims [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Claim successful on node user
Aug 01 18:26:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG nova.network.neutron [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:26:28 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:26:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:26:28 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Creating image(s)
Aug 01 18:26:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "/opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "/opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "/opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG nova.policy [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc00b9006f5842c6b875c5d25538b718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad8ef64d051424e9fe644a1fb40fcb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.175s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.573s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.158s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk 1073741824" returned: 0 in 0.065s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG nova.network.neutron [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:26:29 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-de0717c2-21c0-48fe-9e1b-9dc155187be9 req-1142f11e-f425-46b1-94ce-37d1b0604986 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Received event network-vif-plugged-3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-de0717c2-21c0-48fe-9e1b-9dc155187be9 req-1142f11e-f425-46b1-94ce-37d1b0604986 service nova] Acquiring lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-de0717c2-21c0-48fe-9e1b-9dc155187be9 req-1142f11e-f425-46b1-94ce-37d1b0604986 service nova] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-de0717c2-21c0-48fe-9e1b-9dc155187be9 req-1142f11e-f425-46b1-94ce-37d1b0604986 service nova] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-de0717c2-21c0-48fe-9e1b-9dc155187be9 req-1142f11e-f425-46b1-94ce-37d1b0604986 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] No waiting events found dispatching network-vif-plugged-3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:26:29 user nova-compute[72150]: WARNING nova.compute.manager [req-de0717c2-21c0-48fe-9e1b-9dc155187be9 req-1142f11e-f425-46b1-94ce-37d1b0604986 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Received unexpected event network-vif-plugged-3383d1ec-873d-4660-a685-3d71c2e0092c for instance with vm_state active and task_state rebuild_spawning.
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.161s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:29 user nova-compute[72150]: INFO nova.virt.block_device [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Booting with volume snapshot 6112770b-a3ba-4ddc-b629-aec971464e1f at /dev/vda
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG nova.network.neutron [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Successfully created port: 8c860dfa-7333-4fec-8d5c-573c1c53063f {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Cannot resize image /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG nova.objects.instance [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'migration_context' on Instance uuid 08851ec4-6f71-4ec1-a092-42aab83ee87f {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Ensure instance console log exists: /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG nova.policy [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92c7ef0ed6814f8880de76adb913a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ca44f23b114893afcfe57c52f693b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:26:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:26:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:30 user nova-compute[72150]: DEBUG nova.network.neutron [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Successfully updated port: 8c860dfa-7333-4fec-8d5c-573c1c53063f {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "refresh_cache-08851ec4-6f71-4ec1-a092-42aab83ee87f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquired lock "refresh_cache-08851ec4-6f71-4ec1-a092-42aab83ee87f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.network.neutron [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.compute.manager [req-c66c51ef-5239-4281-8789-f1aadf57e8c9 req-1472642e-ad0d-4276-841e-10a021f0a1f9 service nova] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Received event network-changed-8c860dfa-7333-4fec-8d5c-573c1c53063f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.compute.manager [req-c66c51ef-5239-4281-8789-f1aadf57e8c9 req-1472642e-ad0d-4276-841e-10a021f0a1f9 service nova] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Refreshing instance network info cache due to event network-changed-8c860dfa-7333-4fec-8d5c-573c1c53063f. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c66c51ef-5239-4281-8789-f1aadf57e8c9 req-1472642e-ad0d-4276-841e-10a021f0a1f9 service nova] Acquiring lock "refresh_cache-08851ec4-6f71-4ec1-a092-42aab83ee87f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.network.neutron [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914391.1311421, 9a4c69c1-6d13-4428-9460-be5988aa0b16 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:26:31 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] VM Resumed (Lifecycle Event)
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:26:31 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Instance spawned successfully.
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:31 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914391.1373696, 9a4c69c1-6d13-4428-9460-be5988aa0b16 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:26:31 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] VM Started (Lifecycle Event)
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.network.neutron [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Successfully created port: 08ad3719-57b0-43f4-bd06-91c9a68bd67f {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:31 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72150) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.compute.manager [req-6323ea4c-3615-449d-bff5-392a779a9d78 req-1b0f5249-a0d4-4642-99ce-8aa96e05b0a7 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Received event network-vif-plugged-3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6323ea4c-3615-449d-bff5-392a779a9d78 req-1b0f5249-a0d4-4642-99ce-8aa96e05b0a7 service nova] Acquiring lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6323ea4c-3615-449d-bff5-392a779a9d78 req-1b0f5249-a0d4-4642-99ce-8aa96e05b0a7 service nova] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6323ea4c-3615-449d-bff5-392a779a9d78 req-1b0f5249-a0d4-4642-99ce-8aa96e05b0a7 service nova] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.compute.manager [req-6323ea4c-3615-449d-bff5-392a779a9d78 req-1b0f5249-a0d4-4642-99ce-8aa96e05b0a7 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] No waiting events found dispatching network-vif-plugged-3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:26:31 user nova-compute[72150]: WARNING nova.compute.manager [req-6323ea4c-3615-449d-bff5-392a779a9d78 req-1b0f5249-a0d4-4642-99ce-8aa96e05b0a7 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Received unexpected event network-vif-plugged-3383d1ec-873d-4660-a685-3d71c2e0092c for instance with vm_state active and task_state None.
Aug 01 18:26:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9783d9ba-380b-4438-8386-bf6e5b210817 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.553s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:31 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:26:31 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:26:31 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=7670MB free_disk=25.756114959716797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 050260e0-53e0-43dd-a301-a4e3e411f34d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance e298ac85-ebe3-4aa1-ae1e-91134e13e230 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 9a4c69c1-6d13-4428-9460-be5988aa0b16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 769690c8-53c5-4057-88a5-fbdbcb930e32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ea68420b-8362-4df3-b710-cd1cf76adba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 3f123d4e-1aec-4aa1-8717-f31305a62a5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance bcbfca8c-8bdb-47d2-addc-e1cec3166dc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 08851ec4-6f71-4ec1-a092-42aab83ee87f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance fef6a232-f401-4dbb-b19b-b5a05cfdb1c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.network.neutron [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Successfully updated port: 08ad3719-57b0-43f4-bd06-91c9a68bd67f {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "refresh_cache-fef6a232-f401-4dbb-b19b-b5a05cfdb1c2" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquired lock "refresh_cache-fef6a232-f401-4dbb-b19b-b5a05cfdb1c2" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.network.neutron [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.network.neutron [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Updating instance_info_cache with network_info: [{"id": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "address": "fa:16:3e:e4:fb:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c860dfa-73", "ovs_interfaceid": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Releasing lock "refresh_cache-08851ec4-6f71-4ec1-a092-42aab83ee87f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.compute.manager [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Instance network_info: |[{"id": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "address": "fa:16:3e:e4:fb:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c860dfa-73", "ovs_interfaceid": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c66c51ef-5239-4281-8789-f1aadf57e8c9 req-1472642e-ad0d-4276-841e-10a021f0a1f9 service nova] Acquired lock "refresh_cache-08851ec4-6f71-4ec1-a092-42aab83ee87f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.network.neutron [req-c66c51ef-5239-4281-8789-f1aadf57e8c9 req-1472642e-ad0d-4276-841e-10a021f0a1f9 service nova] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Refreshing network info cache for port 8c860dfa-7333-4fec-8d5c-573c1c53063f {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Start _get_guest_xml network_info=[{"id": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "address": "fa:16:3e:e4:fb:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c860dfa-73", "ovs_interfaceid": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:26:32 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:26:32 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-242653114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-242653114',id=15,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ad8ef64d051424e9fe644a1fb40fcb4',ramdisk_id='',reservation_id='r-by3s1hi8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-23372548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:26:29Z,user_data=None,user_id='cc00b9006f5842c6b875c5d25538b718',uuid=08851ec4-6f71-4ec1-a092-42aab83ee87f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "address": "fa:16:3e:e4:fb:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c860dfa-73", "ovs_interfaceid": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converting VIF {"id": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "address": "fa:16:3e:e4:fb:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c860dfa-73", "ovs_interfaceid": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:fb:5a,bridge_name='br-int',has_traffic_filtering=True,id=8c860dfa-7333-4fec-8d5c-573c1c53063f,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c860dfa-73') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.objects.instance [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'pci_devices' on Instance uuid 08851ec4-6f71-4ec1-a092-42aab83ee87f {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.network.neutron [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.607s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:26:32 user nova-compute[72150]:   <uuid>08851ec4-6f71-4ec1-a092-42aab83ee87f</uuid>
Aug 01 18:26:32 user nova-compute[72150]:   <name>instance-0000000f</name>
Aug 01 18:26:32 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:26:32 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:26:32 user nova-compute[72150]:   <metadata>
Aug 01 18:26:32 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:26:32 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:26:32 user nova-compute[72150]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-242653114</nova:name>
Aug 01 18:26:32 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:26:32</nova:creationTime>
Aug 01 18:26:32 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:26:32 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:26:32 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:26:32 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:26:32 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:26:32 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:26:32 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:26:32 user nova-compute[72150]:       <nova:owner>
Aug 01 18:26:32 user nova-compute[72150]:         <nova:user uuid="cc00b9006f5842c6b875c5d25538b718">tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member</nova:user>
Aug 01 18:26:32 user nova-compute[72150]:         <nova:project uuid="5ad8ef64d051424e9fe644a1fb40fcb4">tempest-ServerBootFromVolumeStableRescueTest-23372548</nova:project>
Aug 01 18:26:32 user nova-compute[72150]:       </nova:owner>
Aug 01 18:26:32 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:26:32 user nova-compute[72150]:       <nova:ports>
Aug 01 18:26:32 user nova-compute[72150]:         <nova:port uuid="8c860dfa-7333-4fec-8d5c-573c1c53063f">
Aug 01 18:26:32 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 18:26:32 user nova-compute[72150]:         </nova:port>
Aug 01 18:26:32 user nova-compute[72150]:       </nova:ports>
Aug 01 18:26:32 user nova-compute[72150]:     </nova:instance>
Aug 01 18:26:32 user nova-compute[72150]:   </metadata>
Aug 01 18:26:32 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:26:32 user nova-compute[72150]:     <system>
Aug 01 18:26:32 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:26:32 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:26:32 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:26:32 user nova-compute[72150]:       <entry name="serial">08851ec4-6f71-4ec1-a092-42aab83ee87f</entry>
Aug 01 18:26:32 user nova-compute[72150]:       <entry name="uuid">08851ec4-6f71-4ec1-a092-42aab83ee87f</entry>
Aug 01 18:26:32 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:26:32 user nova-compute[72150]:     </system>
Aug 01 18:26:32 user nova-compute[72150]:   </sysinfo>
Aug 01 18:26:32 user nova-compute[72150]:   <os>
Aug 01 18:26:32 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:26:32 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:26:32 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:26:32 user nova-compute[72150]:   </os>
Aug 01 18:26:32 user nova-compute[72150]:   <features>
Aug 01 18:26:32 user nova-compute[72150]:     <acpi/>
Aug 01 18:26:32 user nova-compute[72150]:     <apic/>
Aug 01 18:26:32 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:26:32 user nova-compute[72150]:   </features>
Aug 01 18:26:32 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:26:32 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:26:32 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:26:32 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:26:32 user nova-compute[72150]:   </clock>
Aug 01 18:26:32 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:26:32 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:26:32 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:26:32 user nova-compute[72150]:   </cpu>
Aug 01 18:26:32 user nova-compute[72150]:   <devices>
Aug 01 18:26:32 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:26:32 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:26:32 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk"/>
Aug 01 18:26:32 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:26:32 user nova-compute[72150]:     </disk>
Aug 01 18:26:32 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:26:32 user nova-compute[72150]:       <mac address="fa:16:3e:e4:fb:5a"/>
Aug 01 18:26:32 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:26:32 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:26:32 user nova-compute[72150]:       <target dev="tap8c860dfa-73"/>
Aug 01 18:26:32 user nova-compute[72150]:     </interface>
Aug 01 18:26:32 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:26:32 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/console.log" append="off"/>
Aug 01 18:26:32 user nova-compute[72150]:     </serial>
Aug 01 18:26:32 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:26:32 user nova-compute[72150]:     <video>
Aug 01 18:26:32 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:26:32 user nova-compute[72150]:     </video>
Aug 01 18:26:32 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:26:32 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:26:32 user nova-compute[72150]:     </rng>
Aug 01 18:26:32 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:26:32 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:26:32 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:26:32 user nova-compute[72150]:     </memballoon>
Aug 01 18:26:32 user nova-compute[72150]:   </devices>
Aug 01 18:26:32 user nova-compute[72150]: </domain>
Aug 01 18:26:32 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-242653114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-242653114',id=15,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ad8ef64d051424e9fe644a1fb40fcb4',ramdisk_id='',reservation_id='r-by3s1hi8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-23372548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:26:29Z,user_data=None,user_id='cc00b9006f5842c6b875c5d25538b718',uuid=08851ec4-6f71-4ec1-a092-42aab83ee87f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "address": "fa:16:3e:e4:fb:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c860dfa-73", "ovs_interfaceid": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converting VIF {"id": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "address": "fa:16:3e:e4:fb:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c860dfa-73", "ovs_interfaceid": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:fb:5a,bridge_name='br-int',has_traffic_filtering=True,id=8c860dfa-7333-4fec-8d5c-573c1c53063f,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c860dfa-73') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG os_vif [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:fb:5a,bridge_name='br-int',has_traffic_filtering=True,id=8c860dfa-7333-4fec-8d5c-573c1c53063f,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c860dfa-73') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c860dfa-73, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c860dfa-73, col_values=(('external_ids', {'iface-id': '8c860dfa-7333-4fec-8d5c-573c1c53063f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:fb:5a', 'vm-uuid': '08851ec4-6f71-4ec1-a092-42aab83ee87f'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:32 user nova-compute[72150]: INFO os_vif [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:fb:5a,bridge_name='br-int',has_traffic_filtering=True,id=8c860dfa-7333-4fec-8d5c-573c1c53063f,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c860dfa-73')
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:26:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] No VIF found with MAC fa:16:3e:e4:fb:5a, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:26:33 user nova-compute[72150]: DEBUG nova.network.neutron [req-c66c51ef-5239-4281-8789-f1aadf57e8c9 req-1472642e-ad0d-4276-841e-10a021f0a1f9 service nova] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Updated VIF entry in instance network info cache for port 8c860dfa-7333-4fec-8d5c-573c1c53063f. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:26:33 user nova-compute[72150]: DEBUG nova.network.neutron [req-c66c51ef-5239-4281-8789-f1aadf57e8c9 req-1472642e-ad0d-4276-841e-10a021f0a1f9 service nova] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Updating instance_info_cache with network_info: [{"id": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "address": "fa:16:3e:e4:fb:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c860dfa-73", "ovs_interfaceid": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:26:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c66c51ef-5239-4281-8789-f1aadf57e8c9 req-1472642e-ad0d-4276-841e-10a021f0a1f9 service nova] Releasing lock "refresh_cache-08851ec4-6f71-4ec1-a092-42aab83ee87f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:26:33 user nova-compute[72150]: DEBUG nova.network.neutron [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Updating instance_info_cache with network_info: [{"id": "08ad3719-57b0-43f4-bd06-91c9a68bd67f", "address": "fa:16:3e:5a:6d:2e", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ad3719-57", "ovs_interfaceid": "08ad3719-57b0-43f4-bd06-91c9a68bd67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:26:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Releasing lock "refresh_cache-fef6a232-f401-4dbb-b19b-b5a05cfdb1c2" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:26:33 user nova-compute[72150]: DEBUG nova.compute.manager [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Instance network_info: |[{"id": "08ad3719-57b0-43f4-bd06-91c9a68bd67f", "address": "fa:16:3e:5a:6d:2e", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ad3719-57", "ovs_interfaceid": "08ad3719-57b0-43f4-bd06-91c9a68bd67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:26:33 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:26:33 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:26:33 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:26:33 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:26:33 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:26:33 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:26:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:33 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:26:33 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:26:33 user nova-compute[72150]: DEBUG nova.compute.manager [req-97dc3192-6589-41d5-8318-64f888620da4 req-3768b5e3-73a8-49d7-9fc1-82626ca9799e service nova] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Received event network-changed-08ad3719-57b0-43f4-bd06-91c9a68bd67f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:33 user nova-compute[72150]: DEBUG nova.compute.manager [req-97dc3192-6589-41d5-8318-64f888620da4 req-3768b5e3-73a8-49d7-9fc1-82626ca9799e service nova] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Refreshing instance network info cache due to event network-changed-08ad3719-57b0-43f4-bd06-91c9a68bd67f. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:26:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-97dc3192-6589-41d5-8318-64f888620da4 req-3768b5e3-73a8-49d7-9fc1-82626ca9799e service nova] Acquiring lock "refresh_cache-fef6a232-f401-4dbb-b19b-b5a05cfdb1c2" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:26:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-97dc3192-6589-41d5-8318-64f888620da4 req-3768b5e3-73a8-49d7-9fc1-82626ca9799e service nova] Acquired lock "refresh_cache-fef6a232-f401-4dbb-b19b-b5a05cfdb1c2" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:26:33 user nova-compute[72150]: DEBUG nova.network.neutron [req-97dc3192-6589-41d5-8318-64f888620da4 req-3768b5e3-73a8-49d7-9fc1-82626ca9799e service nova] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Refreshing network info cache for port 08ad3719-57b0-43f4-bd06-91c9a68bd67f {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:26:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:34 user nova-compute[72150]: DEBUG nova.network.neutron [req-97dc3192-6589-41d5-8318-64f888620da4 req-3768b5e3-73a8-49d7-9fc1-82626ca9799e service nova] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Updated VIF entry in instance network info cache for port 08ad3719-57b0-43f4-bd06-91c9a68bd67f. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:26:34 user nova-compute[72150]: DEBUG nova.network.neutron [req-97dc3192-6589-41d5-8318-64f888620da4 req-3768b5e3-73a8-49d7-9fc1-82626ca9799e service nova] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Updating instance_info_cache with network_info: [{"id": "08ad3719-57b0-43f4-bd06-91c9a68bd67f", "address": "fa:16:3e:5a:6d:2e", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ad3719-57", "ovs_interfaceid": "08ad3719-57b0-43f4-bd06-91c9a68bd67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:26:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-97dc3192-6589-41d5-8318-64f888620da4 req-3768b5e3-73a8-49d7-9fc1-82626ca9799e service nova] Releasing lock "refresh_cache-fef6a232-f401-4dbb-b19b-b5a05cfdb1c2" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG os_brick.utils [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc3fdb5-94ba-4f80-a00e-3ee121ae8a88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a11af5-b7d8-4ed3-a2fd-49062a0722e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92ce104-baaa-4672-b292-f0c2677b1228]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f56c60e-da86-4f49-9b89-cf802e1cae4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:26:35 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:26:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c934f5-19d6-4404-9135-319b84d418b8]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG os_brick.utils [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Updating existing volume attachment record: d3c58b40-335b-4d17-9bda-f4d7f0801b4e {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Skipping network cache update for instance because it is Building. {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Skipping network cache update for instance because it is Building. {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 01 18:26:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG nova.compute.manager [req-73437f88-5734-477d-9145-8c94c7818295 req-58c1a85e-98a8-4609-b3b6-9dbbd98e2cdb service nova] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Received event network-vif-plugged-8c860dfa-7333-4fec-8d5c-573c1c53063f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-73437f88-5734-477d-9145-8c94c7818295 req-58c1a85e-98a8-4609-b3b6-9dbbd98e2cdb service nova] Acquiring lock "08851ec4-6f71-4ec1-a092-42aab83ee87f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-73437f88-5734-477d-9145-8c94c7818295 req-58c1a85e-98a8-4609-b3b6-9dbbd98e2cdb service nova] Lock "08851ec4-6f71-4ec1-a092-42aab83ee87f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-73437f88-5734-477d-9145-8c94c7818295 req-58c1a85e-98a8-4609-b3b6-9dbbd98e2cdb service nova] Lock "08851ec4-6f71-4ec1-a092-42aab83ee87f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG nova.compute.manager [req-73437f88-5734-477d-9145-8c94c7818295 req-58c1a85e-98a8-4609-b3b6-9dbbd98e2cdb service nova] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] No waiting events found dispatching network-vif-plugged-8c860dfa-7333-4fec-8d5c-573c1c53063f {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:26:36 user nova-compute[72150]: WARNING nova.compute.manager [req-73437f88-5734-477d-9145-8c94c7818295 req-58c1a85e-98a8-4609-b3b6-9dbbd98e2cdb service nova] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Received unexpected event network-vif-plugged-8c860dfa-7333-4fec-8d5c-573c1c53063f for instance with vm_state building and task_state spawning.
Aug 01 18:26:36 user nova-compute[72150]: DEBUG nova.compute.manager [req-73437f88-5734-477d-9145-8c94c7818295 req-58c1a85e-98a8-4609-b3b6-9dbbd98e2cdb service nova] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Received event network-vif-plugged-8c860dfa-7333-4fec-8d5c-573c1c53063f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-73437f88-5734-477d-9145-8c94c7818295 req-58c1a85e-98a8-4609-b3b6-9dbbd98e2cdb service nova] Acquiring lock "08851ec4-6f71-4ec1-a092-42aab83ee87f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-73437f88-5734-477d-9145-8c94c7818295 req-58c1a85e-98a8-4609-b3b6-9dbbd98e2cdb service nova] Lock "08851ec4-6f71-4ec1-a092-42aab83ee87f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-73437f88-5734-477d-9145-8c94c7818295 req-58c1a85e-98a8-4609-b3b6-9dbbd98e2cdb service nova] Lock "08851ec4-6f71-4ec1-a092-42aab83ee87f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG nova.compute.manager [req-73437f88-5734-477d-9145-8c94c7818295 req-58c1a85e-98a8-4609-b3b6-9dbbd98e2cdb service nova] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] No waiting events found dispatching network-vif-plugged-8c860dfa-7333-4fec-8d5c-573c1c53063f {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:26:36 user nova-compute[72150]: WARNING nova.compute.manager [req-73437f88-5734-477d-9145-8c94c7818295 req-58c1a85e-98a8-4609-b3b6-9dbbd98e2cdb service nova] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Received unexpected event network-vif-plugged-8c860dfa-7333-4fec-8d5c-573c1c53063f for instance with vm_state building and task_state spawning.
Aug 01 18:26:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-050260e0-53e0-43dd-a301-a4e3e411f34d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-050260e0-53e0-43dd-a301-a4e3e411f34d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG nova.objects.instance [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lazy-loading 'info_cache' on Instance uuid 050260e0-53e0-43dd-a301-a4e3e411f34d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914396.6117508, 08851ec4-6f71-4ec1-a092-42aab83ee87f => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:26:36 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] VM Resumed (Lifecycle Event)
Aug 01 18:26:36 user nova-compute[72150]: DEBUG nova.compute.manager [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:26:36 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Instance spawned successfully.
Aug 01 18:26:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:26:36 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:26:36 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914396.613019, 08851ec4-6f71-4ec1-a092-42aab83ee87f => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:26:36 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] VM Started (Lifecycle Event)
Aug 01 18:26:36 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:26:36 user nova-compute[72150]: INFO nova.compute.manager [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Took 7.99 seconds to spawn the instance on the hypervisor.
Aug 01 18:26:36 user nova-compute[72150]: DEBUG nova.compute.manager [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:26:36 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:26:36 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:26:36 user nova-compute[72150]: INFO nova.compute.manager [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Took 8.89 seconds to build instance.
Aug 01 18:26:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-639d5cd6-c621-414c-a612-52d95e60fcc6 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "08851ec4-6f71-4ec1-a092-42aab83ee87f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.006s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:37 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Updating instance_info_cache with network_info: [{"id": "c82387ba-7cc9-4eac-9469-021c80c1c195", "address": "fa:16:3e:ba:0b:96", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82387ba-7c", "ovs_interfaceid": "c82387ba-7cc9-4eac-9469-021c80c1c195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:26:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-050260e0-53e0-43dd-a301-a4e3e411f34d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:26:37 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:26:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.compute.manager [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:26:45 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Creating image(s)
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Did not create local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Ensure instance console log exists: /opt/stack/data/nova/instances/fef6a232-f401-4dbb-b19b-b5a05cfdb1c2/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Start _get_guest_xml network_info=[{"id": "08ad3719-57b0-43f4-bd06-91c9a68bd67f", "address": "fa:16:3e:5a:6d:2e", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ad3719-57", "ovs_interfaceid": "08ad3719-57b0-43f4-bd06-91c9a68bd67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd3c58b40-335b-4d17-9bda-f4d7f0801b4e', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HnykVOpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fef6a232-f401-4dbb-b19b-b5a05cfdb1c2', 'attached_at': '', 'detached_at': '', 'volume_id': '3b898b26-e241-40f5-8823-ae1d7c2aa47d', 'serial': '3b898b26-e241-40f5-8823-ae1d7c2aa47d'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:26:45 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:26:45 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HnykVOpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:26:45 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:26:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:26:45 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:26:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:26:45 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:26:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[01586313-4c8c-4f36-a5d4-6701c72e92f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:26:45 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb69a15-45a8-46e2-91e3-4e3d73efb1cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d] added
Aug 01 18:26:45 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[52601d64-1fb6-44d1-955e-f905d09a3ad7]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa747760-28b2-4f97-b637-2bd315fe68c3]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HnykVOpo {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HnykVOpo" returned: 0 in 0.038s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[650a1454-e704-4c71-8e1d-92716e3ccf76]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HnykVOpo'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[136f82d5-f843-4891-b739-3d6470ab0cdd]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bf9c05-b2a9-4a0b-a852-689f2e6ad6fb]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:26:45 user nova-compute[72150]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:26:45 user nova-compute[72150]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:26:45 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:26:45 user nova-compute[72150]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:26:45 user nova-compute[72150]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:26:45 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[324f3ec8-7b1b-43ea-8d1c-29880678de09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d, portal: 172.16.0.220,3260]
Aug 01 18:26:45 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d, portal: 172.16.0.220,3260] successful.
Aug 01 18:26:45 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb625fb-408e-4068-819b-bbea4b029f85]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:45 user nova-compute[72150]: INFO nova.compute.manager [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Rescuing
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "refresh_cache-ea68420b-8362-4df3-b710-cd1cf76adba0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquired lock "refresh_cache-ea68420b-8362-4df3-b710-cd1cf76adba0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG nova.network.neutron [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5940f76-ae06-4d64-901c-0209e57e5d24]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:26:45 user nova-compute[72150]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:26:45 user nova-compute[72150]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:26:45 user nova-compute[72150]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)
Aug 01 18:26:45 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:26:45 user nova-compute[72150]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:26:45 user nova-compute[72150]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:26:45 user nova-compute[72150]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)
Aug 01 18:26:45 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.499s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.040s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5eafe2e-20d5-44f1-8b12-bcaa493b3a3c]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:26:45 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: None {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG nova.network.neutron [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Updating instance_info_cache with network_info: [{"id": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "address": "fa:16:3e:a6:bd:40", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a63bb1a-08", "ovs_interfaceid": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Releasing lock "refresh_cache-ea68420b-8362-4df3-b710-cd1cf76adba0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HnykVOpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.568s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] <== connect_volume: return (1570ms) {'type': 'block', 'scsi_wwn': '23965313865666363', 'path': '/dev/sde'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965313865666363', 'path': '/dev/sde'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1624357681',display_name='tempest-TestVolumeBootPattern-server-1624357681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1624357681',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7ca44f23b114893afcfe57c52f693b1',ramdisk_id='',reservation_id='r-9yjy6ldq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-295340968',owner_user_name='tempest-TestVolumeBootPattern-295340968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:26:29Z,user_data=None,user_id='92c7ef0ed6814f8880de76adb913a487',uuid=fef6a232-f401-4dbb-b19b-b5a05cfdb1c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08ad3719-57b0-43f4-bd06-91c9a68bd67f", "address": "fa:16:3e:5a:6d:2e", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ad3719-57", "ovs_interfaceid": "08ad3719-57b0-43f4-bd06-91c9a68bd67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converting VIF {"id": "08ad3719-57b0-43f4-bd06-91c9a68bd67f", "address": "fa:16:3e:5a:6d:2e", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ad3719-57", "ovs_interfaceid": "08ad3719-57b0-43f4-bd06-91c9a68bd67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:6d:2e,bridge_name='br-int',has_traffic_filtering=True,id=08ad3719-57b0-43f4-bd06-91c9a68bd67f,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ad3719-57') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG nova.objects.instance [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lazy-loading 'pci_devices' on Instance uuid fef6a232-f401-4dbb-b19b-b5a05cfdb1c2 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:26:46 user nova-compute[72150]:   <uuid>fef6a232-f401-4dbb-b19b-b5a05cfdb1c2</uuid>
Aug 01 18:26:46 user nova-compute[72150]:   <name>instance-00000010</name>
Aug 01 18:26:46 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:26:46 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:26:46 user nova-compute[72150]:   <metadata>
Aug 01 18:26:46 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:26:46 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:26:46 user nova-compute[72150]:       <nova:name>tempest-TestVolumeBootPattern-server-1624357681</nova:name>
Aug 01 18:26:46 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:26:45</nova:creationTime>
Aug 01 18:26:46 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:26:46 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:26:46 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:26:46 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:26:46 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:26:46 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:26:46 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:26:46 user nova-compute[72150]:       <nova:owner>
Aug 01 18:26:46 user nova-compute[72150]:         <nova:user uuid="92c7ef0ed6814f8880de76adb913a487">tempest-TestVolumeBootPattern-295340968-project-member</nova:user>
Aug 01 18:26:46 user nova-compute[72150]:         <nova:project uuid="e7ca44f23b114893afcfe57c52f693b1">tempest-TestVolumeBootPattern-295340968</nova:project>
Aug 01 18:26:46 user nova-compute[72150]:       </nova:owner>
Aug 01 18:26:46 user nova-compute[72150]:       <nova:ports>
Aug 01 18:26:46 user nova-compute[72150]:         <nova:port uuid="08ad3719-57b0-43f4-bd06-91c9a68bd67f">
Aug 01 18:26:46 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 18:26:46 user nova-compute[72150]:         </nova:port>
Aug 01 18:26:46 user nova-compute[72150]:       </nova:ports>
Aug 01 18:26:46 user nova-compute[72150]:     </nova:instance>
Aug 01 18:26:46 user nova-compute[72150]:   </metadata>
Aug 01 18:26:46 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:26:46 user nova-compute[72150]:     <system>
Aug 01 18:26:46 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:26:46 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:26:46 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:26:46 user nova-compute[72150]:       <entry name="serial">fef6a232-f401-4dbb-b19b-b5a05cfdb1c2</entry>
Aug 01 18:26:46 user nova-compute[72150]:       <entry name="uuid">fef6a232-f401-4dbb-b19b-b5a05cfdb1c2</entry>
Aug 01 18:26:46 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:26:46 user nova-compute[72150]:     </system>
Aug 01 18:26:46 user nova-compute[72150]:   </sysinfo>
Aug 01 18:26:46 user nova-compute[72150]:   <os>
Aug 01 18:26:46 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:26:46 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:26:46 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:26:46 user nova-compute[72150]:   </os>
Aug 01 18:26:46 user nova-compute[72150]:   <features>
Aug 01 18:26:46 user nova-compute[72150]:     <acpi/>
Aug 01 18:26:46 user nova-compute[72150]:     <apic/>
Aug 01 18:26:46 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:26:46 user nova-compute[72150]:   </features>
Aug 01 18:26:46 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:26:46 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:26:46 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:26:46 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:26:46 user nova-compute[72150]:   </clock>
Aug 01 18:26:46 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:26:46 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:26:46 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:26:46 user nova-compute[72150]:   </cpu>
Aug 01 18:26:46 user nova-compute[72150]:   <devices>
Aug 01 18:26:46 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:26:46 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:26:46 user nova-compute[72150]:       <source dev="/dev/sde"/>
Aug 01 18:26:46 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:26:46 user nova-compute[72150]:       <serial>3b898b26-e241-40f5-8823-ae1d7c2aa47d</serial>
Aug 01 18:26:46 user nova-compute[72150]:     </disk>
Aug 01 18:26:46 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:26:46 user nova-compute[72150]:       <mac address="fa:16:3e:5a:6d:2e"/>
Aug 01 18:26:46 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:26:46 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:26:46 user nova-compute[72150]:       <target dev="tap08ad3719-57"/>
Aug 01 18:26:46 user nova-compute[72150]:     </interface>
Aug 01 18:26:46 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:26:46 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/fef6a232-f401-4dbb-b19b-b5a05cfdb1c2/console.log" append="off"/>
Aug 01 18:26:46 user nova-compute[72150]:     </serial>
Aug 01 18:26:46 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:26:46 user nova-compute[72150]:     <video>
Aug 01 18:26:46 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:26:46 user nova-compute[72150]:     </video>
Aug 01 18:26:46 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:26:46 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:26:46 user nova-compute[72150]:     </rng>
Aug 01 18:26:46 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:26:46 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:26:46 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:26:46 user nova-compute[72150]:     </memballoon>
Aug 01 18:26:46 user nova-compute[72150]:   </devices>
Aug 01 18:26:46 user nova-compute[72150]: </domain>
Aug 01 18:26:46 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1624357681',display_name='tempest-TestVolumeBootPattern-server-1624357681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1624357681',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7ca44f23b114893afcfe57c52f693b1',ramdisk_id='',reservation_id='r-9yjy6ldq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-295340968',owner_user_name='tempest-TestVolumeBootPattern-295340968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:26:29Z,user_data=None,user_id='92c7ef0ed6814f8880de76adb913a487',uuid=fef6a232-f401-4dbb-b19b-b5a05cfdb1c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08ad3719-57b0-43f4-bd06-91c9a68bd67f", "address": "fa:16:3e:5a:6d:2e", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ad3719-57", "ovs_interfaceid": "08ad3719-57b0-43f4-bd06-91c9a68bd67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converting VIF {"id": "08ad3719-57b0-43f4-bd06-91c9a68bd67f", "address": "fa:16:3e:5a:6d:2e", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ad3719-57", "ovs_interfaceid": "08ad3719-57b0-43f4-bd06-91c9a68bd67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:6d:2e,bridge_name='br-int',has_traffic_filtering=True,id=08ad3719-57b0-43f4-bd06-91c9a68bd67f,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ad3719-57') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG os_vif [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:6d:2e,bridge_name='br-int',has_traffic_filtering=True,id=08ad3719-57b0-43f4-bd06-91c9a68bd67f,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ad3719-57') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08ad3719-57, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08ad3719-57, col_values=(('external_ids', {'iface-id': '08ad3719-57b0-43f4-bd06-91c9a68bd67f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:6d:2e', 'vm-uuid': 'fef6a232-f401-4dbb-b19b-b5a05cfdb1c2'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:46 user nova-compute[72150]: INFO os_vif [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:6d:2e,bridge_name='br-int',has_traffic_filtering=True,id=08ad3719-57b0-43f4-bd06-91c9a68bd67f,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ad3719-57')
Aug 01 18:26:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG nova.compute.manager [req-ba836412-cdf1-40cf-b445-a14e377e845f req-0620b00b-4050-42a8-baaf-bc23b5fba327 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Received event network-vif-unplugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ba836412-cdf1-40cf-b445-a14e377e845f req-0620b00b-4050-42a8-baaf-bc23b5fba327 service nova] Acquiring lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ba836412-cdf1-40cf-b445-a14e377e845f req-0620b00b-4050-42a8-baaf-bc23b5fba327 service nova] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ba836412-cdf1-40cf-b445-a14e377e845f req-0620b00b-4050-42a8-baaf-bc23b5fba327 service nova] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG nova.compute.manager [req-ba836412-cdf1-40cf-b445-a14e377e845f req-0620b00b-4050-42a8-baaf-bc23b5fba327 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] No waiting events found dispatching network-vif-unplugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:26:46 user nova-compute[72150]: WARNING nova.compute.manager [req-ba836412-cdf1-40cf-b445-a14e377e845f req-0620b00b-4050-42a8-baaf-bc23b5fba327 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Received unexpected event network-vif-unplugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a for instance with vm_state active and task_state rescuing.
Aug 01 18:26:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:26:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] No VIF found with MAC fa:16:3e:5a:6d:2e, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:26:47 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Instance destroyed successfully.
Aug 01 18:26:47 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Attempting rescue
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72150) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Instance directory exists: not creating {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 18:26:47 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Creating image(s)
Aug 01 18:26:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "/opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "/opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.objects.instance [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'trusted_certs' on Instance uuid ea68420b-8362-4df3-b710-cd1cf76adba0 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.190s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue" returned: 0 in 0.052s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.objects.instance [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'migration_context' on Instance uuid ea68420b-8362-4df3-b710-cd1cf76adba0 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Start _get_guest_xml network_info=[{"id": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "address": "fa:16:3e:a6:bd:40", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "vif_mac": "fa:16:3e:a6:bd:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a63bb1a-08", "ovs_interfaceid": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.objects.instance [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'resources' on Instance uuid ea68420b-8362-4df3-b710-cd1cf76adba0 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.objects.instance [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'numa_topology' on Instance uuid ea68420b-8362-4df3-b710-cd1cf76adba0 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:26:47 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:26:47 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:26:47 user nova-compute[72150]: DEBUG nova.objects.instance [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'vcpu_model' on Instance uuid ea68420b-8362-4df3-b710-cd1cf76adba0 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:26:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-784211986',display_name='tempest-ServerRescueNegativeTestJSON-server-784211986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-784211986',id=13,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:25:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0b70fdffe9e414aa766f7c8f7a20d50',ramdisk_id='',reservation_id='r-wf7l5fq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2003578958',owner_user_name='tempest-ServerRescueNegativeTestJSON-2003578958-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:25:05Z,user_data=None,user_id='375cd4acff1646f4a5418fb012118600',uuid=ea68420b-8362-4df3-b710-cd1cf76adba0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "address": "fa:16:3e:a6:bd:40", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "vif_mac": "fa:16:3e:a6:bd:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a63bb1a-08", "ovs_interfaceid": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:26:48 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converting VIF {"id": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "address": "fa:16:3e:a6:bd:40", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "vif_mac": "fa:16:3e:a6:bd:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a63bb1a-08", "ovs_interfaceid": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:26:48 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:bd:40,bridge_name='br-int',has_traffic_filtering=True,id=6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a63bb1a-08') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:26:48 user nova-compute[72150]: DEBUG nova.objects.instance [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'pci_devices' on Instance uuid ea68420b-8362-4df3-b710-cd1cf76adba0 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:26:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:26:48 user nova-compute[72150]:   <uuid>ea68420b-8362-4df3-b710-cd1cf76adba0</uuid>
Aug 01 18:26:48 user nova-compute[72150]:   <name>instance-0000000d</name>
Aug 01 18:26:48 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:26:48 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:26:48 user nova-compute[72150]:   <metadata>
Aug 01 18:26:48 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:26:48 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:26:48 user nova-compute[72150]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-784211986</nova:name>
Aug 01 18:26:48 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:26:47</nova:creationTime>
Aug 01 18:26:48 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:26:48 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:26:48 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:26:48 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:26:48 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:26:48 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:26:48 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:26:48 user nova-compute[72150]:       <nova:owner>
Aug 01 18:26:48 user nova-compute[72150]:         <nova:user uuid="375cd4acff1646f4a5418fb012118600">tempest-ServerRescueNegativeTestJSON-2003578958-project-member</nova:user>
Aug 01 18:26:48 user nova-compute[72150]:         <nova:project uuid="e0b70fdffe9e414aa766f7c8f7a20d50">tempest-ServerRescueNegativeTestJSON-2003578958</nova:project>
Aug 01 18:26:48 user nova-compute[72150]:       </nova:owner>
Aug 01 18:26:48 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:26:48 user nova-compute[72150]:       <nova:ports>
Aug 01 18:26:48 user nova-compute[72150]:         <nova:port uuid="6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a">
Aug 01 18:26:48 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 18:26:48 user nova-compute[72150]:         </nova:port>
Aug 01 18:26:48 user nova-compute[72150]:       </nova:ports>
Aug 01 18:26:48 user nova-compute[72150]:     </nova:instance>
Aug 01 18:26:48 user nova-compute[72150]:   </metadata>
Aug 01 18:26:48 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:26:48 user nova-compute[72150]:     <system>
Aug 01 18:26:48 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:26:48 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:26:48 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:26:48 user nova-compute[72150]:       <entry name="serial">ea68420b-8362-4df3-b710-cd1cf76adba0</entry>
Aug 01 18:26:48 user nova-compute[72150]:       <entry name="uuid">ea68420b-8362-4df3-b710-cd1cf76adba0</entry>
Aug 01 18:26:48 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:26:48 user nova-compute[72150]:     </system>
Aug 01 18:26:48 user nova-compute[72150]:   </sysinfo>
Aug 01 18:26:48 user nova-compute[72150]:   <os>
Aug 01 18:26:48 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:26:48 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:26:48 user nova-compute[72150]:   </os>
Aug 01 18:26:48 user nova-compute[72150]:   <features>
Aug 01 18:26:48 user nova-compute[72150]:     <acpi/>
Aug 01 18:26:48 user nova-compute[72150]:     <apic/>
Aug 01 18:26:48 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:26:48 user nova-compute[72150]:   </features>
Aug 01 18:26:48 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:26:48 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:26:48 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:26:48 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:26:48 user nova-compute[72150]:   </clock>
Aug 01 18:26:48 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:26:48 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:26:48 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:26:48 user nova-compute[72150]:   </cpu>
Aug 01 18:26:48 user nova-compute[72150]:   <devices>
Aug 01 18:26:48 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:26:48 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:26:48 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue"/>
Aug 01 18:26:48 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:26:48 user nova-compute[72150]:     </disk>
Aug 01 18:26:48 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:26:48 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:26:48 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk"/>
Aug 01 18:26:48 user nova-compute[72150]:       <target dev="vdb" bus="virtio"/>
Aug 01 18:26:48 user nova-compute[72150]:     </disk>
Aug 01 18:26:48 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:26:48 user nova-compute[72150]:       <mac address="fa:16:3e:a6:bd:40"/>
Aug 01 18:26:48 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:26:48 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:26:48 user nova-compute[72150]:       <target dev="tap6a63bb1a-08"/>
Aug 01 18:26:48 user nova-compute[72150]:     </interface>
Aug 01 18:26:48 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:26:48 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/console.log" append="off"/>
Aug 01 18:26:48 user nova-compute[72150]:     </serial>
Aug 01 18:26:48 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:26:48 user nova-compute[72150]:     <video>
Aug 01 18:26:48 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:26:48 user nova-compute[72150]:     </video>
Aug 01 18:26:48 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:26:48 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:26:48 user nova-compute[72150]:     </rng>
Aug 01 18:26:48 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:26:48 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:26:48 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:26:48 user nova-compute[72150]:     </memballoon>
Aug 01 18:26:48 user nova-compute[72150]:   </devices>
Aug 01 18:26:48 user nova-compute[72150]: </domain>
Aug 01 18:26:48 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:26:48 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Instance destroyed successfully.
Aug 01 18:26:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:26:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:26:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] No VIF found with MAC fa:16:3e:a6:bd:40, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:26:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:49 user nova-compute[72150]: DEBUG nova.compute.manager [req-0ec5b741-efd1-4c27-b293-345654c74d4a req-648fb35e-f0e1-4127-9632-b5239ce95905 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Received event network-vif-plugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0ec5b741-efd1-4c27-b293-345654c74d4a req-648fb35e-f0e1-4127-9632-b5239ce95905 service nova] Acquiring lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0ec5b741-efd1-4c27-b293-345654c74d4a req-648fb35e-f0e1-4127-9632-b5239ce95905 service nova] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0ec5b741-efd1-4c27-b293-345654c74d4a req-648fb35e-f0e1-4127-9632-b5239ce95905 service nova] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:49 user nova-compute[72150]: DEBUG nova.compute.manager [req-0ec5b741-efd1-4c27-b293-345654c74d4a req-648fb35e-f0e1-4127-9632-b5239ce95905 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] No waiting events found dispatching network-vif-plugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:26:49 user nova-compute[72150]: WARNING nova.compute.manager [req-0ec5b741-efd1-4c27-b293-345654c74d4a req-648fb35e-f0e1-4127-9632-b5239ce95905 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Received unexpected event network-vif-plugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a for instance with vm_state active and task_state rescuing.
Aug 01 18:26:49 user nova-compute[72150]: DEBUG nova.compute.manager [req-352be080-ebeb-4cb2-ac77-17d85921439b req-2c0ca3d8-70e4-4df9-a718-f38779ad4091 service nova] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Received event network-vif-plugged-08ad3719-57b0-43f4-bd06-91c9a68bd67f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-352be080-ebeb-4cb2-ac77-17d85921439b req-2c0ca3d8-70e4-4df9-a718-f38779ad4091 service nova] Acquiring lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-352be080-ebeb-4cb2-ac77-17d85921439b req-2c0ca3d8-70e4-4df9-a718-f38779ad4091 service nova] Lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-352be080-ebeb-4cb2-ac77-17d85921439b req-2c0ca3d8-70e4-4df9-a718-f38779ad4091 service nova] Lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:49 user nova-compute[72150]: DEBUG nova.compute.manager [req-352be080-ebeb-4cb2-ac77-17d85921439b req-2c0ca3d8-70e4-4df9-a718-f38779ad4091 service nova] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] No waiting events found dispatching network-vif-plugged-08ad3719-57b0-43f4-bd06-91c9a68bd67f {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:26:49 user nova-compute[72150]: WARNING nova.compute.manager [req-352be080-ebeb-4cb2-ac77-17d85921439b req-2c0ca3d8-70e4-4df9-a718-f38779ad4091 service nova] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Received unexpected event network-vif-plugged-08ad3719-57b0-43f4-bd06-91c9a68bd67f for instance with vm_state building and task_state spawning.
Aug 01 18:26:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:26:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:26:49 user nova-compute[72150]: INFO nova.compute.claims [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Claim successful on node user
Aug 01 18:26:50 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:26:50 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:26:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:26:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:26:50 user nova-compute[72150]: DEBUG nova.network.neutron [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:26:50 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:26:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:26:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:26:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:26:50 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Creating image(s)
Aug 01 18:26:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "/opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "/opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.168s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG nova.policy [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9470bee775394bf5a3368d27b64911cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c393fdc0b774cd8a6208200011ba16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-7a59f311-1a23-433f-961f-2237efadff93 req-4201db94-39c7-4841-bdc6-1d5f38e2d015 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Received event network-vif-plugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7a59f311-1a23-433f-961f-2237efadff93 req-4201db94-39c7-4841-bdc6-1d5f38e2d015 service nova] Acquiring lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7a59f311-1a23-433f-961f-2237efadff93 req-4201db94-39c7-4841-bdc6-1d5f38e2d015 service nova] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7a59f311-1a23-433f-961f-2237efadff93 req-4201db94-39c7-4841-bdc6-1d5f38e2d015 service nova] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-7a59f311-1a23-433f-961f-2237efadff93 req-4201db94-39c7-4841-bdc6-1d5f38e2d015 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] No waiting events found dispatching network-vif-plugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:26:51 user nova-compute[72150]: WARNING nova.compute.manager [req-7a59f311-1a23-433f-961f-2237efadff93 req-4201db94-39c7-4841-bdc6-1d5f38e2d015 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Received unexpected event network-vif-plugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a for instance with vm_state active and task_state rescuing.
Aug 01 18:26:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-ebd5ee7c-a055-4e45-920b-d248f88670f9 req-8879242e-4aa4-4648-884a-83f9fafe156b service nova] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Received event network-vif-plugged-08ad3719-57b0-43f4-bd06-91c9a68bd67f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ebd5ee7c-a055-4e45-920b-d248f88670f9 req-8879242e-4aa4-4648-884a-83f9fafe156b service nova] Acquiring lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ebd5ee7c-a055-4e45-920b-d248f88670f9 req-8879242e-4aa4-4648-884a-83f9fafe156b service nova] Lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ebd5ee7c-a055-4e45-920b-d248f88670f9 req-8879242e-4aa4-4648-884a-83f9fafe156b service nova] Lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-ebd5ee7c-a055-4e45-920b-d248f88670f9 req-8879242e-4aa4-4648-884a-83f9fafe156b service nova] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] No waiting events found dispatching network-vif-plugged-08ad3719-57b0-43f4-bd06-91c9a68bd67f {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:26:51 user nova-compute[72150]: WARNING nova.compute.manager [req-ebd5ee7c-a055-4e45-920b-d248f88670f9 req-8879242e-4aa4-4648-884a-83f9fafe156b service nova] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Received unexpected event network-vif-plugged-08ad3719-57b0-43f4-bd06-91c9a68bd67f for instance with vm_state building and task_state spawning.
Aug 01 18:26:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.168s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk 1073741824" returned: 0 in 0.392s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.565s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Cannot resize image /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG nova.objects.instance [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lazy-loading 'migration_context' on Instance uuid bf2d1f14-2227-41d1-bd73-a05ab3149aba {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Ensure instance console log exists: /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:52 user nova-compute[72150]: DEBUG nova.network.neutron [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Successfully created port: 41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.compute.manager [req-f45ddc34-5a9c-4185-a4f2-68310c38a714 req-cb2bcc68-b8c6-403a-8481-d32e9251ee69 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Received event network-vif-plugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f45ddc34-5a9c-4185-a4f2-68310c38a714 req-cb2bcc68-b8c6-403a-8481-d32e9251ee69 service nova] Acquiring lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f45ddc34-5a9c-4185-a4f2-68310c38a714 req-cb2bcc68-b8c6-403a-8481-d32e9251ee69 service nova] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f45ddc34-5a9c-4185-a4f2-68310c38a714 req-cb2bcc68-b8c6-403a-8481-d32e9251ee69 service nova] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.compute.manager [req-f45ddc34-5a9c-4185-a4f2-68310c38a714 req-cb2bcc68-b8c6-403a-8481-d32e9251ee69 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] No waiting events found dispatching network-vif-plugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:26:53 user nova-compute[72150]: WARNING nova.compute.manager [req-f45ddc34-5a9c-4185-a4f2-68310c38a714 req-cb2bcc68-b8c6-403a-8481-d32e9251ee69 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Received unexpected event network-vif-plugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a for instance with vm_state active and task_state rescuing.
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914413.2779152, fef6a232-f401-4dbb-b19b-b5a05cfdb1c2 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:26:53 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] VM Resumed (Lifecycle Event)
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:26:53 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Instance spawned successfully.
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:53 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914413.2799895, fef6a232-f401-4dbb-b19b-b5a05cfdb1c2 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:26:53 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] VM Started (Lifecycle Event)
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:26:53 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:26:53 user nova-compute[72150]: INFO nova.compute.manager [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Took 8.36 seconds to spawn the instance on the hypervisor.
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:26:53 user nova-compute[72150]: INFO nova.compute.manager [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Took 25.24 seconds to build instance.
Aug 01 18:26:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-56ce4293-e202-4ec9-8702-aa822fa9a66a tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.366s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Removed pending event for ea68420b-8362-4df3-b710-cd1cf76adba0 due to event {{(pid=72150) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914413.6139798, ea68420b-8362-4df3-b710-cd1cf76adba0 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:26:53 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] VM Resumed (Lifecycle Event)
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-dee18099-c641-4bb6-a720-518dea9e3cbc tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:26:53 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914413.6322012, ea68420b-8362-4df3-b710-cd1cf76adba0 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:26:53 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] VM Started (Lifecycle Event)
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.network.neutron [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Successfully updated port: 41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "refresh_cache-bf2d1f14-2227-41d1-bd73-a05ab3149aba" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquired lock "refresh_cache-bf2d1f14-2227-41d1-bd73-a05ab3149aba" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.network.neutron [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:26:53 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 18:26:53 user nova-compute[72150]: DEBUG nova.network.neutron [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:26:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.network.neutron [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Updating instance_info_cache with network_info: [{"id": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "address": "fa:16:3e:63:c8:50", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41eb682d-9c", "ovs_interfaceid": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Releasing lock "refresh_cache-bf2d1f14-2227-41d1-bd73-a05ab3149aba" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Instance network_info: |[{"id": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "address": "fa:16:3e:63:c8:50", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41eb682d-9c", "ovs_interfaceid": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Start _get_guest_xml network_info=[{"id": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "address": "fa:16:3e:63:c8:50", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41eb682d-9c", "ovs_interfaceid": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:26:54 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:26:54 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-301869653',display_name='tempest-ServerActionsTestOtherA-server-301869653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-301869653',id=17,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJY2FlDJuzmLBeUAuDA5wUSU2UHRGDTZlkebFFQy7IaCc3RvIIFGPPP6kDQA5KkLRYt2dsIc0CUwBhPl2TFzcR9udfpfPek2FdJAmKOoaMyPBsGZqlWc4+qDiA+nCRd2Q==',key_name='tempest-keypair-605536790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c393fdc0b774cd8a6208200011ba16b',ramdisk_id='',reservation_id='r-djtbnitg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-993571413',owner_user_name='tempest-ServerActionsTestOtherA-993571413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:26:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9470bee775394bf5a3368d27b64911cb',uuid=bf2d1f14-2227-41d1-bd73-a05ab3149aba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "address": "fa:16:3e:63:c8:50", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41eb682d-9c", "ovs_interfaceid": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converting VIF {"id": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "address": "fa:16:3e:63:c8:50", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41eb682d-9c", "ovs_interfaceid": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=41eb682d-9c56-46b8-bd1d-b479d120b8a1,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41eb682d-9c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.objects.instance [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lazy-loading 'pci_devices' on Instance uuid bf2d1f14-2227-41d1-bd73-a05ab3149aba {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:26:54 user nova-compute[72150]:   <uuid>bf2d1f14-2227-41d1-bd73-a05ab3149aba</uuid>
Aug 01 18:26:54 user nova-compute[72150]:   <name>instance-00000011</name>
Aug 01 18:26:54 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:26:54 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:26:54 user nova-compute[72150]:   <metadata>
Aug 01 18:26:54 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:26:54 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:26:54 user nova-compute[72150]:       <nova:name>tempest-ServerActionsTestOtherA-server-301869653</nova:name>
Aug 01 18:26:54 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:26:54</nova:creationTime>
Aug 01 18:26:54 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:26:54 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:26:54 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:26:54 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:26:54 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:26:54 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:26:54 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:26:54 user nova-compute[72150]:       <nova:owner>
Aug 01 18:26:54 user nova-compute[72150]:         <nova:user uuid="9470bee775394bf5a3368d27b64911cb">tempest-ServerActionsTestOtherA-993571413-project-member</nova:user>
Aug 01 18:26:54 user nova-compute[72150]:         <nova:project uuid="1c393fdc0b774cd8a6208200011ba16b">tempest-ServerActionsTestOtherA-993571413</nova:project>
Aug 01 18:26:54 user nova-compute[72150]:       </nova:owner>
Aug 01 18:26:54 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:26:54 user nova-compute[72150]:       <nova:ports>
Aug 01 18:26:54 user nova-compute[72150]:         <nova:port uuid="41eb682d-9c56-46b8-bd1d-b479d120b8a1">
Aug 01 18:26:54 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 18:26:54 user nova-compute[72150]:         </nova:port>
Aug 01 18:26:54 user nova-compute[72150]:       </nova:ports>
Aug 01 18:26:54 user nova-compute[72150]:     </nova:instance>
Aug 01 18:26:54 user nova-compute[72150]:   </metadata>
Aug 01 18:26:54 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:26:54 user nova-compute[72150]:     <system>
Aug 01 18:26:54 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:26:54 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:26:54 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:26:54 user nova-compute[72150]:       <entry name="serial">bf2d1f14-2227-41d1-bd73-a05ab3149aba</entry>
Aug 01 18:26:54 user nova-compute[72150]:       <entry name="uuid">bf2d1f14-2227-41d1-bd73-a05ab3149aba</entry>
Aug 01 18:26:54 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:26:54 user nova-compute[72150]:     </system>
Aug 01 18:26:54 user nova-compute[72150]:   </sysinfo>
Aug 01 18:26:54 user nova-compute[72150]:   <os>
Aug 01 18:26:54 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:26:54 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:26:54 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:26:54 user nova-compute[72150]:   </os>
Aug 01 18:26:54 user nova-compute[72150]:   <features>
Aug 01 18:26:54 user nova-compute[72150]:     <acpi/>
Aug 01 18:26:54 user nova-compute[72150]:     <apic/>
Aug 01 18:26:54 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:26:54 user nova-compute[72150]:   </features>
Aug 01 18:26:54 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:26:54 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:26:54 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:26:54 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:26:54 user nova-compute[72150]:   </clock>
Aug 01 18:26:54 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:26:54 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:26:54 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:26:54 user nova-compute[72150]:   </cpu>
Aug 01 18:26:54 user nova-compute[72150]:   <devices>
Aug 01 18:26:54 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:26:54 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:26:54 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk"/>
Aug 01 18:26:54 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:26:54 user nova-compute[72150]:     </disk>
Aug 01 18:26:54 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:26:54 user nova-compute[72150]:       <mac address="fa:16:3e:63:c8:50"/>
Aug 01 18:26:54 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:26:54 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:26:54 user nova-compute[72150]:       <target dev="tap41eb682d-9c"/>
Aug 01 18:26:54 user nova-compute[72150]:     </interface>
Aug 01 18:26:54 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:26:54 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/console.log" append="off"/>
Aug 01 18:26:54 user nova-compute[72150]:     </serial>
Aug 01 18:26:54 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:26:54 user nova-compute[72150]:     <video>
Aug 01 18:26:54 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:26:54 user nova-compute[72150]:     </video>
Aug 01 18:26:54 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:26:54 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:26:54 user nova-compute[72150]:     </rng>
Aug 01 18:26:54 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:26:54 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:26:54 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:26:54 user nova-compute[72150]:     </memballoon>
Aug 01 18:26:54 user nova-compute[72150]:   </devices>
Aug 01 18:26:54 user nova-compute[72150]: </domain>
Aug 01 18:26:54 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-301869653',display_name='tempest-ServerActionsTestOtherA-server-301869653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-301869653',id=17,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJY2FlDJuzmLBeUAuDA5wUSU2UHRGDTZlkebFFQy7IaCc3RvIIFGPPP6kDQA5KkLRYt2dsIc0CUwBhPl2TFzcR9udfpfPek2FdJAmKOoaMyPBsGZqlWc4+qDiA+nCRd2Q==',key_name='tempest-keypair-605536790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c393fdc0b774cd8a6208200011ba16b',ramdisk_id='',reservation_id='r-djtbnitg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-993571413',owner_user_name='tempest-ServerActionsTestOtherA-993571413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:26:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9470bee775394bf5a3368d27b64911cb',uuid=bf2d1f14-2227-41d1-bd73-a05ab3149aba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "address": "fa:16:3e:63:c8:50", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41eb682d-9c", "ovs_interfaceid": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converting VIF {"id": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "address": "fa:16:3e:63:c8:50", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41eb682d-9c", "ovs_interfaceid": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=41eb682d-9c56-46b8-bd1d-b479d120b8a1,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41eb682d-9c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG os_vif [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=41eb682d-9c56-46b8-bd1d-b479d120b8a1,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41eb682d-9c') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41eb682d-9c, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap41eb682d-9c, col_values=(('external_ids', {'iface-id': '41eb682d-9c56-46b8-bd1d-b479d120b8a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:c8:50', 'vm-uuid': 'bf2d1f14-2227-41d1-bd73-a05ab3149aba'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:54 user nova-compute[72150]: INFO os_vif [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=41eb682d-9c56-46b8-bd1d-b479d120b8a1,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41eb682d-9c')
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:26:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] No VIF found with MAC fa:16:3e:63:c8:50, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:26:55 user nova-compute[72150]: DEBUG nova.compute.manager [req-afdccc49-e010-4d27-afc8-2bb94826f29b req-99fc9862-908d-4545-a431-26203f9a79d8 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Received event network-changed-41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:55 user nova-compute[72150]: DEBUG nova.compute.manager [req-afdccc49-e010-4d27-afc8-2bb94826f29b req-99fc9862-908d-4545-a431-26203f9a79d8 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Refreshing instance network info cache due to event network-changed-41eb682d-9c56-46b8-bd1d-b479d120b8a1. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:26:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-afdccc49-e010-4d27-afc8-2bb94826f29b req-99fc9862-908d-4545-a431-26203f9a79d8 service nova] Acquiring lock "refresh_cache-bf2d1f14-2227-41d1-bd73-a05ab3149aba" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:26:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-afdccc49-e010-4d27-afc8-2bb94826f29b req-99fc9862-908d-4545-a431-26203f9a79d8 service nova] Acquired lock "refresh_cache-bf2d1f14-2227-41d1-bd73-a05ab3149aba" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:26:55 user nova-compute[72150]: DEBUG nova.network.neutron [req-afdccc49-e010-4d27-afc8-2bb94826f29b req-99fc9862-908d-4545-a431-26203f9a79d8 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Refreshing network info cache for port 41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:26:55 user nova-compute[72150]: DEBUG nova.network.neutron [req-afdccc49-e010-4d27-afc8-2bb94826f29b req-99fc9862-908d-4545-a431-26203f9a79d8 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Updated VIF entry in instance network info cache for port 41eb682d-9c56-46b8-bd1d-b479d120b8a1. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:26:55 user nova-compute[72150]: DEBUG nova.network.neutron [req-afdccc49-e010-4d27-afc8-2bb94826f29b req-99fc9862-908d-4545-a431-26203f9a79d8 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Updating instance_info_cache with network_info: [{"id": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "address": "fa:16:3e:63:c8:50", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41eb682d-9c", "ovs_interfaceid": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:26:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-afdccc49-e010-4d27-afc8-2bb94826f29b req-99fc9862-908d-4545-a431-26203f9a79d8 service nova] Releasing lock "refresh_cache-bf2d1f14-2227-41d1-bd73-a05ab3149aba" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:26:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-06c8eaf1-c962-4184-bf11-8844e7200c9c req-3fa3d881-9b20-4b97-8b5b-2dbf370d2b1e service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Received event network-vif-plugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-06c8eaf1-c962-4184-bf11-8844e7200c9c req-3fa3d881-9b20-4b97-8b5b-2dbf370d2b1e service nova] Acquiring lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-06c8eaf1-c962-4184-bf11-8844e7200c9c req-3fa3d881-9b20-4b97-8b5b-2dbf370d2b1e service nova] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-06c8eaf1-c962-4184-bf11-8844e7200c9c req-3fa3d881-9b20-4b97-8b5b-2dbf370d2b1e service nova] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-06c8eaf1-c962-4184-bf11-8844e7200c9c req-3fa3d881-9b20-4b97-8b5b-2dbf370d2b1e service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] No waiting events found dispatching network-vif-plugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:26:57 user nova-compute[72150]: WARNING nova.compute.manager [req-06c8eaf1-c962-4184-bf11-8844e7200c9c req-3fa3d881-9b20-4b97-8b5b-2dbf370d2b1e service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Received unexpected event network-vif-plugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 for instance with vm_state building and task_state spawning.
Aug 01 18:26:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-06c8eaf1-c962-4184-bf11-8844e7200c9c req-3fa3d881-9b20-4b97-8b5b-2dbf370d2b1e service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Received event network-vif-plugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:26:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-06c8eaf1-c962-4184-bf11-8844e7200c9c req-3fa3d881-9b20-4b97-8b5b-2dbf370d2b1e service nova] Acquiring lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:26:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-06c8eaf1-c962-4184-bf11-8844e7200c9c req-3fa3d881-9b20-4b97-8b5b-2dbf370d2b1e service nova] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:26:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-06c8eaf1-c962-4184-bf11-8844e7200c9c req-3fa3d881-9b20-4b97-8b5b-2dbf370d2b1e service nova] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-06c8eaf1-c962-4184-bf11-8844e7200c9c req-3fa3d881-9b20-4b97-8b5b-2dbf370d2b1e service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] No waiting events found dispatching network-vif-plugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:26:57 user nova-compute[72150]: WARNING nova.compute.manager [req-06c8eaf1-c962-4184-bf11-8844e7200c9c req-3fa3d881-9b20-4b97-8b5b-2dbf370d2b1e service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Received unexpected event network-vif-plugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 for instance with vm_state building and task_state spawning.
Aug 01 18:26:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:26:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:26:58 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914418.7808065, bf2d1f14-2227-41d1-bd73-a05ab3149aba => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:26:58 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] VM Resumed (Lifecycle Event)
Aug 01 18:26:58 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Instance spawned successfully.
Aug 01 18:26:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:26:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:26:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:26:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:26:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:26:58 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:26:58 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914418.7810223, bf2d1f14-2227-41d1-bd73-a05ab3149aba => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:26:58 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] VM Started (Lifecycle Event)
Aug 01 18:26:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:26:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:26:58 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:26:58 user nova-compute[72150]: INFO nova.compute.manager [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Took 8.09 seconds to spawn the instance on the hypervisor.
Aug 01 18:26:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:26:59 user nova-compute[72150]: INFO nova.compute.manager [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Took 9.10 seconds to build instance.
Aug 01 18:26:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5b74e6d-79c7-4358-b195-30f4b5649039 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.208s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:26:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "a5f0eca7-d060-4226-b36e-a3cd15b15703" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:10 user nova-compute[72150]: DEBUG nova.compute.manager [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:27:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:27:10 user nova-compute[72150]: INFO nova.compute.claims [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Claim successful on node user
Aug 01 18:27:10 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:27:10 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:27:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.649s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:10 user nova-compute[72150]: DEBUG nova.compute.manager [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:27:10 user nova-compute[72150]: DEBUG nova.compute.manager [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:27:10 user nova-compute[72150]: DEBUG nova.network.neutron [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:27:10 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:27:10 user nova-compute[72150]: DEBUG nova.compute.manager [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG nova.policy [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68c9836c352b488b934723c56f892c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d566eb776234eb4a834d0e3f6dd7792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG nova.compute.manager [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:27:11 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Creating image(s)
Aug 01 18:27:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "/opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "/opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.167s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.147s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk 1073741824" returned: 0 in 0.051s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Cannot resize image /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG nova.objects.instance [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lazy-loading 'migration_context' on Instance uuid a5f0eca7-d060-4226-b36e-a3cd15b15703 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Ensure instance console log exists: /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:12 user nova-compute[72150]: INFO nova.compute.manager [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Detaching volume 97e42f6b-03a1-4846-80a6-e8e08f236253
Aug 01 18:27:12 user nova-compute[72150]: DEBUG nova.network.neutron [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Successfully created port: e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:27:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:12 user nova-compute[72150]: INFO nova.virt.block_device [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Attempting to driver detach volume 97e42f6b-03a1-4846-80a6-e8e08f236253 from mountpoint /dev/vdc
Aug 01 18:27:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Attempting to detach device vdc from instance 3f123d4e-1aec-4aa1-8717-f31305a62a5d from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:27:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:27:12 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:27:12 user nova-compute[72150]:   <source dev="/dev/sdc"/>
Aug 01 18:27:12 user nova-compute[72150]:   <target dev="vdc" bus="virtio"/>
Aug 01 18:27:12 user nova-compute[72150]:   <serial>97e42f6b-03a1-4846-80a6-e8e08f236253</serial>
Aug 01 18:27:12 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 18:27:12 user nova-compute[72150]: </disk>
Aug 01 18:27:12 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:27:12 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Successfully detached device vdc from instance 3f123d4e-1aec-4aa1-8717-f31305a62a5d from the persistent domain config.
Aug 01 18:27:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3f123d4e-1aec-4aa1-8717-f31305a62a5d from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:27:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:27:12 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:27:12 user nova-compute[72150]:   <source dev="/dev/sdc"/>
Aug 01 18:27:12 user nova-compute[72150]:   <target dev="vdc" bus="virtio"/>
Aug 01 18:27:12 user nova-compute[72150]:   <serial>97e42f6b-03a1-4846-80a6-e8e08f236253</serial>
Aug 01 18:27:12 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 18:27:12 user nova-compute[72150]: </disk>
Aug 01 18:27:12 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690914433.1709812, 3f123d4e-1aec-4aa1-8717-f31305a62a5d => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3f123d4e-1aec-4aa1-8717-f31305a62a5d {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:27:13 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Successfully detached device vdc from instance 3f123d4e-1aec-4aa1-8717-f31305a62a5d from the live domain config.
Aug 01 18:27:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvsCrJUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:27:13 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:27:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[70477b82-deef-4cb7-95b4-153c77a7899a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7beab52-ebd0-4624-b6c5-c901f89d9865]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:27:13 user nova-compute[72150]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:27:13 user nova-compute[72150]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:27:13 user nova-compute[72150]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)
Aug 01 18:27:13 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 (non-flash)
Aug 01 18:27:13 user nova-compute[72150]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:27:13 user nova-compute[72150]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:27:13 user nova-compute[72150]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)
Aug 01 18:27:13 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec5449d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253'): ({'sdc'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Removing single pathed devices sdc {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1060291-8344-47d5-936c-bc810bab56d4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e5c130-d017-431e-b084-de54439c137b]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Flushing IO for device /dev/sdc {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[47547107-f3ba-41e1-b926-aa2f3279d7f5]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0082724-e762-498e-bd38-33662444c40a]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] SCSI volumes sdc have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ca545e-9434-4504-82bf-af02aa400f3a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8698d9-e989-4bc4-9743-e0fa5a07d680]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253, portal: 172.16.0.220,3260]
Aug 01 18:27:13 user nova-compute[72150]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253, portal: 172.16.0.220,3260] successful.
Aug 01 18:27:13 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG nova.network.neutron [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Successfully updated port: e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97e42f6b-03a1-4846-80a6-e8e08f236253 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f787104-56cf-4782-9e8c-d4098862b345]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] <== disconnect_volume: return (374ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "refresh_cache-a5f0eca7-d060-4226-b36e-a3cd15b15703" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquired lock "refresh_cache-a5f0eca7-d060-4226-b36e-a3cd15b15703" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG nova.network.neutron [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG nova.compute.manager [req-e562a58a-69c2-4cf5-9920-a60b4479e4ed req-939057d1-6dff-4d41-8c55-0240d411f81d service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received event network-changed-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG nova.compute.manager [req-e562a58a-69c2-4cf5-9920-a60b4479e4ed req-939057d1-6dff-4d41-8c55-0240d411f81d service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Refreshing instance network info cache due to event network-changed-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e562a58a-69c2-4cf5-9920-a60b4479e4ed req-939057d1-6dff-4d41-8c55-0240d411f81d service nova] Acquiring lock "refresh_cache-a5f0eca7-d060-4226-b36e-a3cd15b15703" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG nova.network.neutron [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG nova.network.neutron [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Updating instance_info_cache with network_info: [{"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Releasing lock "refresh_cache-a5f0eca7-d060-4226-b36e-a3cd15b15703" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG nova.compute.manager [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Instance network_info: |[{"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e562a58a-69c2-4cf5-9920-a60b4479e4ed req-939057d1-6dff-4d41-8c55-0240d411f81d service nova] Acquired lock "refresh_cache-a5f0eca7-d060-4226-b36e-a3cd15b15703" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG nova.network.neutron [req-e562a58a-69c2-4cf5-9920-a60b4479e4ed req-939057d1-6dff-4d41-8c55-0240d411f81d service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Refreshing network info cache for port e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:27:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Start _get_guest_xml network_info=[{"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:27:14 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:27:14 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1769556587',display_name='tempest-ServerActionsTestOtherB-server-1769556587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1769556587',id=18,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHk1JfNPFXl8HOej4l4GGAFwiUlyr68TuvMkyJFt7CHfDXuZjpGZ30rkbU/oouT3R2Q9X+Pk0+5iMSh/dzvrWC0rsJ078sX31sP2prrj5uYPobmNDT4n3BlWJvWW4raDpA==',key_name='tempest-keypair-792111278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d566eb776234eb4a834d0e3f6dd7792',ramdisk_id='',reservation_id='r-o20tu0o3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-623575398',owner_user_name='tempest-ServerActionsTestOtherB-623575398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:27:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68c9836c352b488b934723c56f892c10',uuid=a5f0eca7-d060-4226-b36e-a3cd15b15703,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Converting VIF {"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc,network=Network(36c41dfd-577c-4ceb-a1f7-69187368b386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0a2205a-4b') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.objects.instance [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lazy-loading 'pci_devices' on Instance uuid a5f0eca7-d060-4226-b36e-a3cd15b15703 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:27:14 user nova-compute[72150]:   <uuid>a5f0eca7-d060-4226-b36e-a3cd15b15703</uuid>
Aug 01 18:27:14 user nova-compute[72150]:   <name>instance-00000012</name>
Aug 01 18:27:14 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:27:14 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:27:14 user nova-compute[72150]:   <metadata>
Aug 01 18:27:14 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:27:14 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:27:14 user nova-compute[72150]:       <nova:name>tempest-ServerActionsTestOtherB-server-1769556587</nova:name>
Aug 01 18:27:14 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:27:14</nova:creationTime>
Aug 01 18:27:14 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:27:14 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:27:14 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:27:14 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:27:14 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:27:14 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:27:14 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:27:14 user nova-compute[72150]:       <nova:owner>
Aug 01 18:27:14 user nova-compute[72150]:         <nova:user uuid="68c9836c352b488b934723c56f892c10">tempest-ServerActionsTestOtherB-623575398-project-member</nova:user>
Aug 01 18:27:14 user nova-compute[72150]:         <nova:project uuid="3d566eb776234eb4a834d0e3f6dd7792">tempest-ServerActionsTestOtherB-623575398</nova:project>
Aug 01 18:27:14 user nova-compute[72150]:       </nova:owner>
Aug 01 18:27:14 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:27:14 user nova-compute[72150]:       <nova:ports>
Aug 01 18:27:14 user nova-compute[72150]:         <nova:port uuid="e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc">
Aug 01 18:27:14 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 18:27:14 user nova-compute[72150]:         </nova:port>
Aug 01 18:27:14 user nova-compute[72150]:       </nova:ports>
Aug 01 18:27:14 user nova-compute[72150]:     </nova:instance>
Aug 01 18:27:14 user nova-compute[72150]:   </metadata>
Aug 01 18:27:14 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:27:14 user nova-compute[72150]:     <system>
Aug 01 18:27:14 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:27:14 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:27:14 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:27:14 user nova-compute[72150]:       <entry name="serial">a5f0eca7-d060-4226-b36e-a3cd15b15703</entry>
Aug 01 18:27:14 user nova-compute[72150]:       <entry name="uuid">a5f0eca7-d060-4226-b36e-a3cd15b15703</entry>
Aug 01 18:27:14 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:27:14 user nova-compute[72150]:     </system>
Aug 01 18:27:14 user nova-compute[72150]:   </sysinfo>
Aug 01 18:27:14 user nova-compute[72150]:   <os>
Aug 01 18:27:14 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:27:14 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:27:14 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:27:14 user nova-compute[72150]:   </os>
Aug 01 18:27:14 user nova-compute[72150]:   <features>
Aug 01 18:27:14 user nova-compute[72150]:     <acpi/>
Aug 01 18:27:14 user nova-compute[72150]:     <apic/>
Aug 01 18:27:14 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:27:14 user nova-compute[72150]:   </features>
Aug 01 18:27:14 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:27:14 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:27:14 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:27:14 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:27:14 user nova-compute[72150]:   </clock>
Aug 01 18:27:14 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:27:14 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:27:14 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:27:14 user nova-compute[72150]:   </cpu>
Aug 01 18:27:14 user nova-compute[72150]:   <devices>
Aug 01 18:27:14 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:27:14 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:27:14 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk"/>
Aug 01 18:27:14 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:27:14 user nova-compute[72150]:     </disk>
Aug 01 18:27:14 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:27:14 user nova-compute[72150]:       <mac address="fa:16:3e:65:82:a8"/>
Aug 01 18:27:14 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:27:14 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:27:14 user nova-compute[72150]:       <target dev="tape0a2205a-4b"/>
Aug 01 18:27:14 user nova-compute[72150]:     </interface>
Aug 01 18:27:14 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:27:14 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/console.log" append="off"/>
Aug 01 18:27:14 user nova-compute[72150]:     </serial>
Aug 01 18:27:14 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:27:14 user nova-compute[72150]:     <video>
Aug 01 18:27:14 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:27:14 user nova-compute[72150]:     </video>
Aug 01 18:27:14 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:27:14 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:27:14 user nova-compute[72150]:     </rng>
Aug 01 18:27:14 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:27:14 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:27:14 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:27:14 user nova-compute[72150]:     </memballoon>
Aug 01 18:27:14 user nova-compute[72150]:   </devices>
Aug 01 18:27:14 user nova-compute[72150]: </domain>
Aug 01 18:27:14 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1769556587',display_name='tempest-ServerActionsTestOtherB-server-1769556587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1769556587',id=18,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHk1JfNPFXl8HOej4l4GGAFwiUlyr68TuvMkyJFt7CHfDXuZjpGZ30rkbU/oouT3R2Q9X+Pk0+5iMSh/dzvrWC0rsJ078sX31sP2prrj5uYPobmNDT4n3BlWJvWW4raDpA==',key_name='tempest-keypair-792111278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d566eb776234eb4a834d0e3f6dd7792',ramdisk_id='',reservation_id='r-o20tu0o3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-623575398',owner_user_name='tempest-ServerActionsTestOtherB-623575398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:27:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68c9836c352b488b934723c56f892c10',uuid=a5f0eca7-d060-4226-b36e-a3cd15b15703,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Converting VIF {"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc,network=Network(36c41dfd-577c-4ceb-a1f7-69187368b386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0a2205a-4b') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG os_vif [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc,network=Network(36c41dfd-577c-4ceb-a1f7-69187368b386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0a2205a-4b') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0a2205a-4b, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape0a2205a-4b, col_values=(('external_ids', {'iface-id': 'e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:82:a8', 'vm-uuid': 'a5f0eca7-d060-4226-b36e-a3cd15b15703'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:14 user nova-compute[72150]: INFO os_vif [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc,network=Network(36c41dfd-577c-4ceb-a1f7-69187368b386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0a2205a-4b')
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] No VIF found with MAC fa:16:3e:65:82:a8, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.network.neutron [req-e562a58a-69c2-4cf5-9920-a60b4479e4ed req-939057d1-6dff-4d41-8c55-0240d411f81d service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Updated VIF entry in instance network info cache for port e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.network.neutron [req-e562a58a-69c2-4cf5-9920-a60b4479e4ed req-939057d1-6dff-4d41-8c55-0240d411f81d service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Updating instance_info_cache with network_info: [{"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e562a58a-69c2-4cf5-9920-a60b4479e4ed req-939057d1-6dff-4d41-8c55-0240d411f81d service nova] Releasing lock "refresh_cache-a5f0eca7-d060-4226-b36e-a3cd15b15703" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG nova.objects.instance [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'flavor' on Instance uuid 3f123d4e-1aec-4aa1-8717-f31305a62a5d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:27:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-55785ab6-c549-4af6-a916-ccc7892e6b8b tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.206s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:15 user nova-compute[72150]: DEBUG nova.compute.manager [req-74e5fa38-9eaa-4cc7-a774-0274355e7a10 req-039274f4-f754-4c46-b541-b7cab28f8dc2 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received event network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:27:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-74e5fa38-9eaa-4cc7-a774-0274355e7a10 req-039274f4-f754-4c46-b541-b7cab28f8dc2 service nova] Acquiring lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-74e5fa38-9eaa-4cc7-a774-0274355e7a10 req-039274f4-f754-4c46-b541-b7cab28f8dc2 service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-74e5fa38-9eaa-4cc7-a774-0274355e7a10 req-039274f4-f754-4c46-b541-b7cab28f8dc2 service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:16 user nova-compute[72150]: DEBUG nova.compute.manager [req-74e5fa38-9eaa-4cc7-a774-0274355e7a10 req-039274f4-f754-4c46-b541-b7cab28f8dc2 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] No waiting events found dispatching network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:27:16 user nova-compute[72150]: WARNING nova.compute.manager [req-74e5fa38-9eaa-4cc7-a774-0274355e7a10 req-039274f4-f754-4c46-b541-b7cab28f8dc2 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received unexpected event network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc for instance with vm_state building and task_state spawning.
Aug 01 18:27:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:17 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914437.8907413, a5f0eca7-d060-4226-b36e-a3cd15b15703 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:27:17 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] VM Resumed (Lifecycle Event)
Aug 01 18:27:17 user nova-compute[72150]: DEBUG nova.compute.manager [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:27:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:27:17 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Instance spawned successfully.
Aug 01 18:27:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:27:17 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:27:17 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:27:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:27:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:27:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:27:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:27:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:27:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:27:17 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:27:17 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914437.8915372, a5f0eca7-d060-4226-b36e-a3cd15b15703 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:27:17 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] VM Started (Lifecycle Event)
Aug 01 18:27:17 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:27:17 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:27:17 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:27:18 user nova-compute[72150]: INFO nova.compute.manager [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Took 6.85 seconds to spawn the instance on the hypervisor.
Aug 01 18:27:18 user nova-compute[72150]: DEBUG nova.compute.manager [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:27:18 user nova-compute[72150]: DEBUG nova.compute.manager [req-3017047f-4e57-43fe-86ca-f03efb49ab47 req-aa1710f5-7c42-46ab-a9b0-1d3139b9b7c5 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received event network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:27:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3017047f-4e57-43fe-86ca-f03efb49ab47 req-aa1710f5-7c42-46ab-a9b0-1d3139b9b7c5 service nova] Acquiring lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3017047f-4e57-43fe-86ca-f03efb49ab47 req-aa1710f5-7c42-46ab-a9b0-1d3139b9b7c5 service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3017047f-4e57-43fe-86ca-f03efb49ab47 req-aa1710f5-7c42-46ab-a9b0-1d3139b9b7c5 service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:18 user nova-compute[72150]: DEBUG nova.compute.manager [req-3017047f-4e57-43fe-86ca-f03efb49ab47 req-aa1710f5-7c42-46ab-a9b0-1d3139b9b7c5 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] No waiting events found dispatching network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:27:18 user nova-compute[72150]: WARNING nova.compute.manager [req-3017047f-4e57-43fe-86ca-f03efb49ab47 req-aa1710f5-7c42-46ab-a9b0-1d3139b9b7c5 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received unexpected event network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc for instance with vm_state building and task_state spawning.
Aug 01 18:27:18 user nova-compute[72150]: INFO nova.compute.manager [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Took 7.98 seconds to build instance.
Aug 01 18:27:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e34e1694-7b3e-4dbb-825b-bb46b3a05697 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.104s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:23 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:27:23 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72150) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 18:27:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:28 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:27:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:28 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:27:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquiring lock "ceee3912-ca68-4b15-8fe6-985d905e8128" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:27:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:29 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:27:29 user nova-compute[72150]: INFO nova.compute.claims [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Claim successful on node user
Aug 01 18:27:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG nova.network.neutron [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:27:30 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:27:30 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG nova.policy [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e75ce9ed1ddf4011bf578b72580eedad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759cb04dd744d7895a63bc5bd1d1c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:27:30 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Creating image(s)
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquiring lock "/opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "/opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "/opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.148s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.141s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk 1073741824" returned: 0 in 0.055s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.141s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Cannot resize image /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG nova.objects.instance [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lazy-loading 'migration_context' on Instance uuid ceee3912-ca68-4b15-8fe6-985d905e8128 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Ensure instance console log exists: /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG nova.network.neutron [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Successfully created port: ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG nova.network.neutron [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Successfully updated port: ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG nova.compute.manager [req-337b65fd-fdaa-4ef4-af50-ddebff5d3939 req-89a5994c-934f-40b8-9ddb-402b5bddc3c8 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received event network-changed-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG nova.compute.manager [req-337b65fd-fdaa-4ef4-af50-ddebff5d3939 req-89a5994c-934f-40b8-9ddb-402b5bddc3c8 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Refreshing instance network info cache due to event network-changed-ee07a0f4-222d-4863-92b2-f70a7afd75f1. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-337b65fd-fdaa-4ef4-af50-ddebff5d3939 req-89a5994c-934f-40b8-9ddb-402b5bddc3c8 service nova] Acquiring lock "refresh_cache-ceee3912-ca68-4b15-8fe6-985d905e8128" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-337b65fd-fdaa-4ef4-af50-ddebff5d3939 req-89a5994c-934f-40b8-9ddb-402b5bddc3c8 service nova] Acquired lock "refresh_cache-ceee3912-ca68-4b15-8fe6-985d905e8128" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG nova.network.neutron [req-337b65fd-fdaa-4ef4-af50-ddebff5d3939 req-89a5994c-934f-40b8-9ddb-402b5bddc3c8 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Refreshing network info cache for port ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:27:32 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:27:32 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:27:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=7034MB free_disk=25.665485382080078GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquiring lock "refresh_cache-ceee3912-ca68-4b15-8fe6-985d905e8128" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG nova.network.neutron [req-337b65fd-fdaa-4ef4-af50-ddebff5d3939 req-89a5994c-934f-40b8-9ddb-402b5bddc3c8 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 050260e0-53e0-43dd-a301-a4e3e411f34d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance e298ac85-ebe3-4aa1-ae1e-91134e13e230 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 9a4c69c1-6d13-4428-9460-be5988aa0b16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 769690c8-53c5-4057-88a5-fbdbcb930e32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ea68420b-8362-4df3-b710-cd1cf76adba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 3f123d4e-1aec-4aa1-8717-f31305a62a5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance bcbfca8c-8bdb-47d2-addc-e1cec3166dc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 08851ec4-6f71-4ec1-a092-42aab83ee87f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance fef6a232-f401-4dbb-b19b-b5a05cfdb1c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance bf2d1f14-2227-41d1-bd73-a05ab3149aba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance a5f0eca7-d060-4226-b36e-a3cd15b15703 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ceee3912-ca68-4b15-8fe6-985d905e8128 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:27:32 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.network.neutron [req-337b65fd-fdaa-4ef4-af50-ddebff5d3939 req-89a5994c-934f-40b8-9ddb-402b5bddc3c8 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-337b65fd-fdaa-4ef4-af50-ddebff5d3939 req-89a5994c-934f-40b8-9ddb-402b5bddc3c8 service nova] Releasing lock "refresh_cache-ceee3912-ca68-4b15-8fe6-985d905e8128" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquired lock "refresh_cache-ceee3912-ca68-4b15-8fe6-985d905e8128" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.network.neutron [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.network.neutron [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Cleaning up deleted instances {{(pid=72150) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] There are 0 instances to clean {{(pid=72150) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.network.neutron [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Updating instance_info_cache with network_info: [{"id": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "address": "fa:16:3e:e0:04:f1", "network": {"id": "838d4cba-b00d-46ff-ad55-9d7dd511581a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-732384801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8759cb04dd744d7895a63bc5bd1d1c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee07a0f4-22", "ovs_interfaceid": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Releasing lock "refresh_cache-ceee3912-ca68-4b15-8fe6-985d905e8128" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Instance network_info: |[{"id": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "address": "fa:16:3e:e0:04:f1", "network": {"id": "838d4cba-b00d-46ff-ad55-9d7dd511581a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-732384801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8759cb04dd744d7895a63bc5bd1d1c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee07a0f4-22", "ovs_interfaceid": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Start _get_guest_xml network_info=[{"id": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "address": "fa:16:3e:e0:04:f1", "network": {"id": "838d4cba-b00d-46ff-ad55-9d7dd511581a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-732384801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8759cb04dd744d7895a63bc5bd1d1c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee07a0f4-22", "ovs_interfaceid": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:27:33 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:27:33 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:27:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1031087304',display_name='tempest-ServerStableDeviceRescueTest-server-1031087304',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1031087304',id=19,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXknm48O+sHdtxwG6tm4FYBXZP3XaIW2WM3AK91piLPeoMnQQ4qv/ck/RizkVbsO3RmdgJYcVKp+GZNypXSFhAn+S6lpUIGjz/mDUmenWQw+T1tA09bruOrFwdJDPcLiA==',key_name='tempest-keypair-409987953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8759cb04dd744d7895a63bc5bd1d1c83',ramdisk_id='',reservation_id='r-t0lo8wvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1141204139',owner_user_name='tempest-ServerStableDeviceRescueTest-1141204139-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:27:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e75ce9ed1ddf4011bf578b72580eedad',uuid=ceee3912-ca68-4b15-8fe6-985d905e8128,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "address": "fa:16:3e:e0:04:f1", "network": {"id": "838d4cba-b00d-46ff-ad55-9d7dd511581a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-732384801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8759cb04dd744d7895a63bc5bd1d1c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee07a0f4-22", "ovs_interfaceid": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Converting VIF {"id": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "address": "fa:16:3e:e0:04:f1", "network": {"id": "838d4cba-b00d-46ff-ad55-9d7dd511581a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-732384801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8759cb04dd744d7895a63bc5bd1d1c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee07a0f4-22", "ovs_interfaceid": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:04:f1,bridge_name='br-int',has_traffic_filtering=True,id=ee07a0f4-222d-4863-92b2-f70a7afd75f1,network=Network(838d4cba-b00d-46ff-ad55-9d7dd511581a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee07a0f4-22') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.objects.instance [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lazy-loading 'pci_devices' on Instance uuid ceee3912-ca68-4b15-8fe6-985d905e8128 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:27:33 user nova-compute[72150]:   <uuid>ceee3912-ca68-4b15-8fe6-985d905e8128</uuid>
Aug 01 18:27:33 user nova-compute[72150]:   <name>instance-00000013</name>
Aug 01 18:27:33 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:27:33 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:27:33 user nova-compute[72150]:   <metadata>
Aug 01 18:27:33 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:27:33 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:27:33 user nova-compute[72150]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1031087304</nova:name>
Aug 01 18:27:33 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:27:33</nova:creationTime>
Aug 01 18:27:33 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:27:33 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:27:33 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:27:33 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:27:33 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:27:33 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:27:33 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:27:33 user nova-compute[72150]:       <nova:owner>
Aug 01 18:27:33 user nova-compute[72150]:         <nova:user uuid="e75ce9ed1ddf4011bf578b72580eedad">tempest-ServerStableDeviceRescueTest-1141204139-project-member</nova:user>
Aug 01 18:27:33 user nova-compute[72150]:         <nova:project uuid="8759cb04dd744d7895a63bc5bd1d1c83">tempest-ServerStableDeviceRescueTest-1141204139</nova:project>
Aug 01 18:27:33 user nova-compute[72150]:       </nova:owner>
Aug 01 18:27:33 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:27:33 user nova-compute[72150]:       <nova:ports>
Aug 01 18:27:33 user nova-compute[72150]:         <nova:port uuid="ee07a0f4-222d-4863-92b2-f70a7afd75f1">
Aug 01 18:27:33 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 18:27:33 user nova-compute[72150]:         </nova:port>
Aug 01 18:27:33 user nova-compute[72150]:       </nova:ports>
Aug 01 18:27:33 user nova-compute[72150]:     </nova:instance>
Aug 01 18:27:33 user nova-compute[72150]:   </metadata>
Aug 01 18:27:33 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:27:33 user nova-compute[72150]:     <system>
Aug 01 18:27:33 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:27:33 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:27:33 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:27:33 user nova-compute[72150]:       <entry name="serial">ceee3912-ca68-4b15-8fe6-985d905e8128</entry>
Aug 01 18:27:33 user nova-compute[72150]:       <entry name="uuid">ceee3912-ca68-4b15-8fe6-985d905e8128</entry>
Aug 01 18:27:33 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:27:33 user nova-compute[72150]:     </system>
Aug 01 18:27:33 user nova-compute[72150]:   </sysinfo>
Aug 01 18:27:33 user nova-compute[72150]:   <os>
Aug 01 18:27:33 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:27:33 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:27:33 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:27:33 user nova-compute[72150]:   </os>
Aug 01 18:27:33 user nova-compute[72150]:   <features>
Aug 01 18:27:33 user nova-compute[72150]:     <acpi/>
Aug 01 18:27:33 user nova-compute[72150]:     <apic/>
Aug 01 18:27:33 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:27:33 user nova-compute[72150]:   </features>
Aug 01 18:27:33 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:27:33 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:27:33 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:27:33 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:27:33 user nova-compute[72150]:   </clock>
Aug 01 18:27:33 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:27:33 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:27:33 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:27:33 user nova-compute[72150]:   </cpu>
Aug 01 18:27:33 user nova-compute[72150]:   <devices>
Aug 01 18:27:33 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:27:33 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:27:33 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk"/>
Aug 01 18:27:33 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:27:33 user nova-compute[72150]:     </disk>
Aug 01 18:27:33 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:27:33 user nova-compute[72150]:       <mac address="fa:16:3e:e0:04:f1"/>
Aug 01 18:27:33 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:27:33 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:27:33 user nova-compute[72150]:       <target dev="tapee07a0f4-22"/>
Aug 01 18:27:33 user nova-compute[72150]:     </interface>
Aug 01 18:27:33 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:27:33 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/console.log" append="off"/>
Aug 01 18:27:33 user nova-compute[72150]:     </serial>
Aug 01 18:27:33 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:27:33 user nova-compute[72150]:     <video>
Aug 01 18:27:33 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:27:33 user nova-compute[72150]:     </video>
Aug 01 18:27:33 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:27:33 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:27:33 user nova-compute[72150]:     </rng>
Aug 01 18:27:33 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:27:33 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:27:33 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:27:33 user nova-compute[72150]:     </memballoon>
Aug 01 18:27:33 user nova-compute[72150]:   </devices>
Aug 01 18:27:33 user nova-compute[72150]: </domain>
Aug 01 18:27:33 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:27:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1031087304',display_name='tempest-ServerStableDeviceRescueTest-server-1031087304',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1031087304',id=19,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXknm48O+sHdtxwG6tm4FYBXZP3XaIW2WM3AK91piLPeoMnQQ4qv/ck/RizkVbsO3RmdgJYcVKp+GZNypXSFhAn+S6lpUIGjz/mDUmenWQw+T1tA09bruOrFwdJDPcLiA==',key_name='tempest-keypair-409987953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8759cb04dd744d7895a63bc5bd1d1c83',ramdisk_id='',reservation_id='r-t0lo8wvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1141204139',owner_user_name='tempest-ServerStableDeviceRescueTest-1141204139-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:27:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e75ce9ed1ddf4011bf578b72580eedad',uuid=ceee3912-ca68-4b15-8fe6-985d905e8128,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "address": "fa:16:3e:e0:04:f1", "network": {"id": "838d4cba-b00d-46ff-ad55-9d7dd511581a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-732384801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8759cb04dd744d7895a63bc5bd1d1c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee07a0f4-22", "ovs_interfaceid": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Converting VIF {"id": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "address": "fa:16:3e:e0:04:f1", "network": {"id": "838d4cba-b00d-46ff-ad55-9d7dd511581a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-732384801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8759cb04dd744d7895a63bc5bd1d1c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee07a0f4-22", "ovs_interfaceid": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:04:f1,bridge_name='br-int',has_traffic_filtering=True,id=ee07a0f4-222d-4863-92b2-f70a7afd75f1,network=Network(838d4cba-b00d-46ff-ad55-9d7dd511581a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee07a0f4-22') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG os_vif [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:04:f1,bridge_name='br-int',has_traffic_filtering=True,id=ee07a0f4-222d-4863-92b2-f70a7afd75f1,network=Network(838d4cba-b00d-46ff-ad55-9d7dd511581a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee07a0f4-22') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee07a0f4-22, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee07a0f4-22, col_values=(('external_ids', {'iface-id': 'ee07a0f4-222d-4863-92b2-f70a7afd75f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:04:f1', 'vm-uuid': 'ceee3912-ca68-4b15-8fe6-985d905e8128'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:33 user nova-compute[72150]: INFO os_vif [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:04:f1,bridge_name='br-int',has_traffic_filtering=True,id=ee07a0f4-222d-4863-92b2-f70a7afd75f1,network=Network(838d4cba-b00d-46ff-ad55-9d7dd511581a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee07a0f4-22')
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] No VIF found with MAC fa:16:3e:e0:04:f1, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:27:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:34 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:27:34 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:27:34 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:27:34 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:27:34 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:27:34 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:27:34 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:27:34 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:27:34 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:27:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:35 user nova-compute[72150]: DEBUG nova.compute.manager [req-ba081259-38ad-4082-944e-3b3a70979a8c req-ea18b964-47ff-4beb-8a7d-9c0cafdce70c service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received event network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:27:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ba081259-38ad-4082-944e-3b3a70979a8c req-ea18b964-47ff-4beb-8a7d-9c0cafdce70c service nova] Acquiring lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ba081259-38ad-4082-944e-3b3a70979a8c req-ea18b964-47ff-4beb-8a7d-9c0cafdce70c service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ba081259-38ad-4082-944e-3b3a70979a8c req-ea18b964-47ff-4beb-8a7d-9c0cafdce70c service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:35 user nova-compute[72150]: DEBUG nova.compute.manager [req-ba081259-38ad-4082-944e-3b3a70979a8c req-ea18b964-47ff-4beb-8a7d-9c0cafdce70c service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] No waiting events found dispatching network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:27:35 user nova-compute[72150]: WARNING nova.compute.manager [req-ba081259-38ad-4082-944e-3b3a70979a8c req-ea18b964-47ff-4beb-8a7d-9c0cafdce70c service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received unexpected event network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 for instance with vm_state building and task_state spawning.
Aug 01 18:27:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "9a4c69c1-6d13-4428-9460-be5988aa0b16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:36 user nova-compute[72150]: INFO nova.compute.manager [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Terminating instance
Aug 01 18:27:36 user nova-compute[72150]: DEBUG nova.compute.manager [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG nova.compute.manager [req-44ac48b4-5330-49bd-9e95-307b20a281e1 req-6188b7cb-a9cc-4562-9ba3-1f746b7dcb6e service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Received event network-vif-unplugged-3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-44ac48b4-5330-49bd-9e95-307b20a281e1 req-6188b7cb-a9cc-4562-9ba3-1f746b7dcb6e service nova] Acquiring lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-44ac48b4-5330-49bd-9e95-307b20a281e1 req-6188b7cb-a9cc-4562-9ba3-1f746b7dcb6e service nova] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-44ac48b4-5330-49bd-9e95-307b20a281e1 req-6188b7cb-a9cc-4562-9ba3-1f746b7dcb6e service nova] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG nova.compute.manager [req-44ac48b4-5330-49bd-9e95-307b20a281e1 req-6188b7cb-a9cc-4562-9ba3-1f746b7dcb6e service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] No waiting events found dispatching network-vif-unplugged-3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG nova.compute.manager [req-44ac48b4-5330-49bd-9e95-307b20a281e1 req-6188b7cb-a9cc-4562-9ba3-1f746b7dcb6e service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Received event network-vif-unplugged-3383d1ec-873d-4660-a685-3d71c2e0092c for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:27:36 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Instance destroyed successfully.
Aug 01 18:27:36 user nova-compute[72150]: DEBUG nova.objects.instance [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lazy-loading 'resources' on Instance uuid 9a4c69c1-6d13-4428-9460-be5988aa0b16 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T18:23:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1141577599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1283435186',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+Nn4jIkP7o81KAVSuEafYwZ26XCjfE3kKImFLpIJCuWu6CIp77lxBWVyFrwhzih2blhaPYtQDdQOnjy77eqEv5UzljWf90RHtb08BFC6XddfTDCcic8R7KEtRpk3mn7g==',key_name='tempest-keypair-1383383211',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:26:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cec5474a64d46c2bfc92435c677abf2',ramdisk_id='',reservation_id='r-wxny26dq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1421721381',owner_user_name='tempest-ServerActionsV293TestJSON-1421721381-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e312b378dd2b43798193756afb51e343',uuid=9a4c69c1-6d13-4428-9460-be5988aa0b16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3383d1ec-873d-4660-a685-3d71c2e0092c", "address": "fa:16:3e:ab:5f:8a", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3383d1ec-87", "ovs_interfaceid": "3383d1ec-873d-4660-a685-3d71c2e0092c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Converting VIF {"id": "3383d1ec-873d-4660-a685-3d71c2e0092c", "address": "fa:16:3e:ab:5f:8a", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3383d1ec-87", "ovs_interfaceid": "3383d1ec-873d-4660-a685-3d71c2e0092c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:5f:8a,bridge_name='br-int',has_traffic_filtering=True,id=3383d1ec-873d-4660-a685-3d71c2e0092c,network=Network(ac6e56c1-0122-4bc2-b6b2-a76d80894c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3383d1ec-87') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG os_vif [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:5f:8a,bridge_name='br-int',has_traffic_filtering=True,id=3383d1ec-873d-4660-a685-3d71c2e0092c,network=Network(ac6e56c1-0122-4bc2-b6b2-a76d80894c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3383d1ec-87') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3383d1ec-87, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:37 user nova-compute[72150]: INFO os_vif [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:5f:8a,bridge_name='br-int',has_traffic_filtering=True,id=3383d1ec-873d-4660-a685-3d71c2e0092c,network=Network(ac6e56c1-0122-4bc2-b6b2-a76d80894c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3383d1ec-87')
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWXaJRkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:27:37 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:27:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[69964c33-3809-47b8-83d3-ccb25349b144]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa02a5f0-d83f-4e92-888e-ef1bdc3279f4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:27:37 user nova-compute[72150]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:27:37 user nova-compute[72150]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)
Aug 01 18:27:37 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:27:37 user nova-compute[72150]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 (non-flash)
Aug 01 18:27:37 user nova-compute[72150]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)
Aug 01 18:27:37 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec44ea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17'): ({'sdb'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Removing single pathed devices sdb {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b381b024-105e-4c37-9004-11e6db7b900a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef99a0ff-bb50-4aec-b148-c8e0699bba9c]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Flushing IO for device /dev/sdb {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1facece3-c0c2-4db6-8443-424dbc074774]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.070s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8987b1-13f1-4dae-90b7-3f6b09fd59ef]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c838f740-2242-4052-b3cb-74be59211550]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[99847f79-0705-48b7-ad58-9975bf28fa98]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17, portal: 172.16.0.220,3260]
Aug 01 18:27:37 user nova-compute[72150]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17, portal: 172.16.0.220,3260] successful.
Aug 01 18:27:37 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99176d6f-ea51-4322-b763-9a4f8a154d17 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c83710e-3864-45b0-b101-cdf2bf78242c]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] <== disconnect_volume: return (372ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:27:37 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Deleting instance files /opt/stack/data/nova/instances/9a4c69c1-6d13-4428-9460-be5988aa0b16_del
Aug 01 18:27:37 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Deletion of /opt/stack/data/nova/instances/9a4c69c1-6d13-4428-9460-be5988aa0b16_del complete
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914457.394433, ceee3912-ca68-4b15-8fe6-985d905e8128 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:27:37 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] VM Resumed (Lifecycle Event)
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:27:37 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Instance spawned successfully.
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.compute.manager [req-c7e302c5-e66a-49cb-8c69-136eaf4e81c1 req-18160f68-e410-41a5-89c0-495d13f9636f service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received event network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c7e302c5-e66a-49cb-8c69-136eaf4e81c1 req-18160f68-e410-41a5-89c0-495d13f9636f service nova] Acquiring lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c7e302c5-e66a-49cb-8c69-136eaf4e81c1 req-18160f68-e410-41a5-89c0-495d13f9636f service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c7e302c5-e66a-49cb-8c69-136eaf4e81c1 req-18160f68-e410-41a5-89c0-495d13f9636f service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.compute.manager [req-c7e302c5-e66a-49cb-8c69-136eaf4e81c1 req-18160f68-e410-41a5-89c0-495d13f9636f service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] No waiting events found dispatching network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:27:37 user nova-compute[72150]: WARNING nova.compute.manager [req-c7e302c5-e66a-49cb-8c69-136eaf4e81c1 req-18160f68-e410-41a5-89c0-495d13f9636f service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received unexpected event network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 for instance with vm_state building and task_state spawning.
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:27:37 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914457.3988981, ceee3912-ca68-4b15-8fe6-985d905e8128 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:27:37 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] VM Started (Lifecycle Event)
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:27:37 user nova-compute[72150]: INFO nova.compute.manager [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Took 1.41 seconds to destroy the instance on the hypervisor.
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:27:37 user nova-compute[72150]: INFO nova.compute.manager [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Took 6.86 seconds to spawn the instance on the hypervisor.
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.compute.manager [req-d7319f54-133d-452d-9c2c-1f079bf759c5 req-db0d639d-11a7-4738-baea-eacc0f4f3af2 service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Received event network-changed-242e141b-d5fa-4e86-82ae-26b993342476 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.compute.manager [req-d7319f54-133d-452d-9c2c-1f079bf759c5 req-db0d639d-11a7-4738-baea-eacc0f4f3af2 service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Refreshing instance network info cache due to event network-changed-242e141b-d5fa-4e86-82ae-26b993342476. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d7319f54-133d-452d-9c2c-1f079bf759c5 req-db0d639d-11a7-4738-baea-eacc0f4f3af2 service nova] Acquiring lock "refresh_cache-bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d7319f54-133d-452d-9c2c-1f079bf759c5 req-db0d639d-11a7-4738-baea-eacc0f4f3af2 service nova] Acquired lock "refresh_cache-bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:27:37 user nova-compute[72150]: DEBUG nova.network.neutron [req-d7319f54-133d-452d-9c2c-1f079bf759c5 req-db0d639d-11a7-4738-baea-eacc0f4f3af2 service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Refreshing network info cache for port 242e141b-d5fa-4e86-82ae-26b993342476 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:27:37 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:27:38 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Updating instance_info_cache with network_info: [{"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:27:38 user nova-compute[72150]: INFO nova.compute.manager [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Took 8.24 seconds to build instance.
Aug 01 18:27:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:27:38 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:27:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bde0a660-59bf-4bd7-a2a8-a7f5af09b7d0 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.453s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:38 user nova-compute[72150]: DEBUG nova.compute.manager [req-2344f232-8499-40f8-9c65-6c335a1cd82b req-8449756a-e68b-4607-9c12-c8d02c5edc93 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Received event network-vif-plugged-3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:27:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2344f232-8499-40f8-9c65-6c335a1cd82b req-8449756a-e68b-4607-9c12-c8d02c5edc93 service nova] Acquiring lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2344f232-8499-40f8-9c65-6c335a1cd82b req-8449756a-e68b-4607-9c12-c8d02c5edc93 service nova] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2344f232-8499-40f8-9c65-6c335a1cd82b req-8449756a-e68b-4607-9c12-c8d02c5edc93 service nova] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:38 user nova-compute[72150]: DEBUG nova.compute.manager [req-2344f232-8499-40f8-9c65-6c335a1cd82b req-8449756a-e68b-4607-9c12-c8d02c5edc93 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] No waiting events found dispatching network-vif-plugged-3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:27:38 user nova-compute[72150]: WARNING nova.compute.manager [req-2344f232-8499-40f8-9c65-6c335a1cd82b req-8449756a-e68b-4607-9c12-c8d02c5edc93 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Received unexpected event network-vif-plugged-3383d1ec-873d-4660-a685-3d71c2e0092c for instance with vm_state active and task_state deleting.
Aug 01 18:27:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:39 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:27:39 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Took 1.56 seconds to deallocate network for instance.
Aug 01 18:27:39 user nova-compute[72150]: DEBUG nova.network.neutron [req-d7319f54-133d-452d-9c2c-1f079bf759c5 req-db0d639d-11a7-4738-baea-eacc0f4f3af2 service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Updated VIF entry in instance network info cache for port 242e141b-d5fa-4e86-82ae-26b993342476. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:27:39 user nova-compute[72150]: DEBUG nova.network.neutron [req-d7319f54-133d-452d-9c2c-1f079bf759c5 req-db0d639d-11a7-4738-baea-eacc0f4f3af2 service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Updating instance_info_cache with network_info: [{"id": "242e141b-d5fa-4e86-82ae-26b993342476", "address": "fa:16:3e:26:8b:9c", "network": {"id": "633e7e89-16a6-4a46-8d94-0a1cc6891579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211447573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41181268f4754733811b1abdad7eeb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242e141b-d5", "ovs_interfaceid": "242e141b-d5fa-4e86-82ae-26b993342476", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:27:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d7319f54-133d-452d-9c2c-1f079bf759c5 req-db0d639d-11a7-4738-baea-eacc0f4f3af2 service nova] Releasing lock "refresh_cache-bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:27:39 user nova-compute[72150]: DEBUG nova.compute.manager [req-ad013135-30c8-40ba-abcf-f2e3769cde0f req-39e00101-d720-49f5-b282-1723ca687552 service nova] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Received event network-vif-deleted-3383d1ec-873d-4660-a685-3d71c2e0092c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:27:40 user nova-compute[72150]: INFO nova.compute.manager [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Took 1.11 seconds to detach 1 volumes for instance.
Aug 01 18:27:40 user nova-compute[72150]: DEBUG nova.compute.manager [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Deleting volume: 99176d6f-ea51-4322-b763-9a4f8a154d17 {{(pid=72150) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 18:27:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:40 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:27:40 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:27:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:40 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Deleted allocations for instance 9a4c69c1-6d13-4428-9460-be5988aa0b16
Aug 01 18:27:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-45d97865-bfc1-4537-9af5-01ae81b55667 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "9a4c69c1-6d13-4428-9460-be5988aa0b16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.919s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG nova.objects.instance [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lazy-loading 'flavor' on Instance uuid bcbfca8c-8bdb-47d2-addc-e1cec3166dc5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:42 user nova-compute[72150]: INFO nova.compute.manager [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Attaching volume 21f8fc8c-840f-42e9-9595-461cbee1be3e to /dev/vdb
Aug 01 18:27:42 user nova-compute[72150]: DEBUG os_brick.utils [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[52015242-5e91-4d97-8d56-d37076ddb074]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[822d0d3c-98af-4780-a8e9-82436932147a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[486c783c-238a-478c-b249-ad8bb11ff0f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a88316c-74e1-4730-901d-0d8330696384]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:27:42 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:27:42 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4b65e1-ec64-460c-9e60-483c8e6646e1]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG os_brick.utils [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:27:42 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Updating existing volume attachment record: 3ed40f38-b464-4928-89bd-e9255f223bc3 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:27:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid 050260e0-53e0-43dd-a301-a4e3e411f34d {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid e298ac85-ebe3-4aa1-ae1e-91134e13e230 {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid 769690c8-53c5-4057-88a5-fbdbcb930e32 {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid ea68420b-8362-4df3-b710-cd1cf76adba0 {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid bcbfca8c-8bdb-47d2-addc-e1cec3166dc5 {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid 08851ec4-6f71-4ec1-a092-42aab83ee87f {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid fef6a232-f401-4dbb-b19b-b5a05cfdb1c2 {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid bf2d1f14-2227-41d1-bd73-a05ab3149aba {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid a5f0eca7-d060-4226-b36e-a3cd15b15703 {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid ceee3912-ca68-4b15-8fe6-985d905e8128 {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid 3f123d4e-1aec-4aa1-8717-f31305a62a5d {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "050260e0-53e0-43dd-a301-a4e3e411f34d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "050260e0-53e0-43dd-a301-a4e3e411f34d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "769690c8-53c5-4057-88a5-fbdbcb930e32" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "ea68420b-8362-4df3-b710-cd1cf76adba0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "08851ec4-6f71-4ec1-a092-42aab83ee87f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "08851ec4-6f71-4ec1-a092-42aab83ee87f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "a5f0eca7-d060-4226-b36e-a3cd15b15703" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "ceee3912-ca68-4b15-8fe6-985d905e8128" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "050260e0-53e0-43dd-a301-a4e3e411f34d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "08851ec4-6f71-4ec1-a092-42aab83ee87f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjiKkYPI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:27:50 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:27:50 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:27:50 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fabb70-331d-4aa3-bb18-5f2ea71a93e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:27:50 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae53d16-9b45-484c-8948-03fc89808749]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e] added
Aug 01 18:27:50 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b99ed7-0805-4dc3-9cf3-f930e21864e7]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f50a7c-042f-4af1-bf3f-a51f9db6f0b9]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pjiKkYPI {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pjiKkYPI" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d831ad8f-dfb9-4cb6-bf4c-e9715cd911a3]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pjiKkYPI'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2404292e-7a4e-4aae-8bde-1cca567eaf16]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[732ba90a-1dc1-4ac1-a5a3-2c09d0d49671]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:27:50 user nova-compute[72150]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)
Aug 01 18:27:50 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:27:50 user nova-compute[72150]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)
Aug 01 18:27:50 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a2c959-8f57-41ee-b5b9-b25ccfec7107]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e, portal: 172.16.0.220,3260]
Aug 01 18:27:50 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e, portal: 172.16.0.220,3260] successful.
Aug 01 18:27:50 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a849f748-2f20-4e1b-9f54-e08ebe143e46]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7988b7c3-9200-4475-a5d1-a985670297fd]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:27:50 user nova-compute[72150]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)
Aug 01 18:27:50 user nova-compute[72150]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e (non-flash)
Aug 01 18:27:50 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:27:50 user nova-compute[72150]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)
Aug 01 18:27:50 user nova-compute[72150]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e (non-flash)
Aug 01 18:27:50 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e8feeb-48f1-400c-87c6-5f2babd2eac9]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdb {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:27:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjiKkYPI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:27:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:27:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23033303464613564', 'path': '/dev/sdb'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:27:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033303464613564', 'path': '/dev/sdb'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:27:51 user nova-compute[72150]: DEBUG nova.objects.instance [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lazy-loading 'flavor' on Instance uuid bcbfca8c-8bdb-47d2-addc-e1cec3166dc5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:27:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:27:51 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:27:51 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 18:27:51 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:27:51 user nova-compute[72150]:   <serial>21f8fc8c-840f-42e9-9595-461cbee1be3e</serial>
Aug 01 18:27:51 user nova-compute[72150]: </disk>
Aug 01 18:27:51 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:27:51 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914456.9632547, 9a4c69c1-6d13-4428-9460-be5988aa0b16 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:27:51 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] VM Stopped (Lifecycle Event)
Aug 01 18:27:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8bc50c23-4009-4c2f-b53e-dda4ed70a94d None None] [instance: 9a4c69c1-6d13-4428-9460-be5988aa0b16] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:27:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:27:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:27:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] No VIF found with MAC fa:16:3e:26:8b:9c, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:27:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-67fb238b-5bbc-4749-a882-8db4e572fe32 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.973s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.550s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:53 user nova-compute[72150]: DEBUG nova.compute.manager [req-3e6f2f5a-0279-4a72-9068-52249a3e4782 req-779264d3-27de-4260-b49e-de96ce2ad523 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Received event network-changed-10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:27:53 user nova-compute[72150]: DEBUG nova.compute.manager [req-3e6f2f5a-0279-4a72-9068-52249a3e4782 req-779264d3-27de-4260-b49e-de96ce2ad523 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Refreshing instance network info cache due to event network-changed-10176957-b4a6-4052-9a16-21152c8c3da5. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:27:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3e6f2f5a-0279-4a72-9068-52249a3e4782 req-779264d3-27de-4260-b49e-de96ce2ad523 service nova] Acquiring lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:27:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3e6f2f5a-0279-4a72-9068-52249a3e4782 req-779264d3-27de-4260-b49e-de96ce2ad523 service nova] Acquired lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:27:53 user nova-compute[72150]: DEBUG nova.network.neutron [req-3e6f2f5a-0279-4a72-9068-52249a3e4782 req-779264d3-27de-4260-b49e-de96ce2ad523 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Refreshing network info cache for port 10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:27:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG nova.network.neutron [req-3e6f2f5a-0279-4a72-9068-52249a3e4782 req-779264d3-27de-4260-b49e-de96ce2ad523 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Updated VIF entry in instance network info cache for port 10176957-b4a6-4052-9a16-21152c8c3da5. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG nova.network.neutron [req-3e6f2f5a-0279-4a72-9068-52249a3e4782 req-779264d3-27de-4260-b49e-de96ce2ad523 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Updating instance_info_cache with network_info: [{"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3e6f2f5a-0279-4a72-9068-52249a3e4782 req-779264d3-27de-4260-b49e-de96ce2ad523 service nova] Releasing lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:54 user nova-compute[72150]: INFO nova.compute.manager [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Detaching volume 21f8fc8c-840f-42e9-9595-461cbee1be3e
Aug 01 18:27:54 user nova-compute[72150]: INFO nova.virt.block_device [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Attempting to driver detach volume 21f8fc8c-840f-42e9-9595-461cbee1be3e from mountpoint /dev/vdb
Aug 01 18:27:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Attempting to detach device vdb from instance bcbfca8c-8bdb-47d2-addc-e1cec3166dc5 from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:27:54 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:27:54 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 18:27:54 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:27:54 user nova-compute[72150]:   <serial>21f8fc8c-840f-42e9-9595-461cbee1be3e</serial>
Aug 01 18:27:54 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:27:54 user nova-compute[72150]: </disk>
Aug 01 18:27:54 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:27:54 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Successfully detached device vdb from instance bcbfca8c-8bdb-47d2-addc-e1cec3166dc5 from the persistent domain config.
Aug 01 18:27:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bcbfca8c-8bdb-47d2-addc-e1cec3166dc5 from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:27:54 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:27:54 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 18:27:54 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:27:54 user nova-compute[72150]:   <serial>21f8fc8c-840f-42e9-9595-461cbee1be3e</serial>
Aug 01 18:27:54 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:27:54 user nova-compute[72150]: </disk>
Aug 01 18:27:54 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690914474.72445, bcbfca8c-8bdb-47d2-addc-e1cec3166dc5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bcbfca8c-8bdb-47d2-addc-e1cec3166dc5 {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:27:54 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Successfully detached device vdb from instance bcbfca8c-8bdb-47d2-addc-e1cec3166dc5 from the live domain config.
Aug 01 18:27:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjiKkYPI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:27:54 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:27:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc854fc1-99e4-4538-948c-f0bd3f0af7d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2079db76-6619-44d5-9cd2-1acd2ce1395f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:27:54 user nova-compute[72150]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)
Aug 01 18:27:54 user nova-compute[72150]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e (non-flash)
Aug 01 18:27:54 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:27:54 user nova-compute[72150]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)
Aug 01 18:27:54 user nova-compute[72150]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e (non-flash)
Aug 01 18:27:54 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec5f0d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e'): ({'sdb'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Removing single pathed devices sdb {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d015084-09ec-4526-8770-c706743f141d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced773c4-094f-4647-9056-1faa99486c8a]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Flushing IO for device /dev/sdb {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f084b01e-569c-4b44-8b3f-0162296cec06]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cd2b53-7f4b-44c4-9518-f63c9f297ace]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:54 user nova-compute[72150]: INFO nova.compute.manager [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Detaching volume 4628e1ee-2e16-4255-95e8-c5cc4e6c775a
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee6dbcd-8bbd-415e-bcb5-5c838184f5e4]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:27:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:55 user nova-compute[72150]: INFO nova.virt.block_device [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Attempting to driver detach volume 4628e1ee-2e16-4255-95e8-c5cc4e6c775a from mountpoint /dev/vdb
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[468d3c35-a581-4bb0-a5f5-c46489dd0a6a]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e, portal: 172.16.0.220,3260]
Aug 01 18:27:55 user nova-compute[72150]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e, portal: 172.16.0.220,3260] successful.
Aug 01 18:27:55 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Attempting to detach device vdb from instance e298ac85-ebe3-4aa1-ae1e-91134e13e230 from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:27:55 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:27:55 user nova-compute[72150]:   <source dev="/dev/sdd"/>
Aug 01 18:27:55 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:27:55 user nova-compute[72150]:   <serial>4628e1ee-2e16-4255-95e8-c5cc4e6c775a</serial>
Aug 01 18:27:55 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 18:27:55 user nova-compute[72150]: </disk>
Aug 01 18:27:55 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:27:55 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Successfully detached device vdb from instance e298ac85-ebe3-4aa1-ae1e-91134e13e230 from the persistent domain config.
Aug 01 18:27:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e298ac85-ebe3-4aa1-ae1e-91134e13e230 from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:27:55 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:27:55 user nova-compute[72150]:   <source dev="/dev/sdd"/>
Aug 01 18:27:55 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:27:55 user nova-compute[72150]:   <serial>4628e1ee-2e16-4255-95e8-c5cc4e6c775a</serial>
Aug 01 18:27:55 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 18:27:55 user nova-compute[72150]: </disk>
Aug 01 18:27:55 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21f8fc8c-840f-42e9-9595-461cbee1be3e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d69760e-257c-4800-9c65-9d3ac59f9e0f]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] <== disconnect_volume: return (298ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690914475.4198642, e298ac85-ebe3-4aa1-ae1e-91134e13e230 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e298ac85-ebe3-4aa1-ae1e-91134e13e230 {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:27:55 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Successfully detached device vdb from instance e298ac85-ebe3-4aa1-ae1e-91134e13e230 from the live domain config.
Aug 01 18:27:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVImtzaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:27:55 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:27:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda0be1d-29f0-4a48-a66d-089357636c5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4e4446-b67c-4bbf-8b93-398c9d79802d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:27:55 user nova-compute[72150]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)
Aug 01 18:27:55 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a (non-flash)
Aug 01 18:27:55 user nova-compute[72150]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)
Aug 01 18:27:55 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f47195a4280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a'): ({'sdd'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Removing single pathed devices sdd {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf41e26-50da-40b7-9543-4bf57e51d7cc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[914c6f16-978f-40f8-a71e-db4f666e6aee]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Flushing IO for device /dev/sdd {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c083b82b-a1e8-4311-a4e9-5df32f7b21bc]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG nova.compute.manager [req-a492e267-bbb5-4bc2-8959-57e9e17cb8b8 req-74a0b05f-a27f-477e-babc-d2fa555910c1 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Received event network-changed-10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG nova.compute.manager [req-a492e267-bbb5-4bc2-8959-57e9e17cb8b8 req-74a0b05f-a27f-477e-babc-d2fa555910c1 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Refreshing instance network info cache due to event network-changed-10176957-b4a6-4052-9a16-21152c8c3da5. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a492e267-bbb5-4bc2-8959-57e9e17cb8b8 req-74a0b05f-a27f-477e-babc-d2fa555910c1 service nova] Acquiring lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a492e267-bbb5-4bc2-8959-57e9e17cb8b8 req-74a0b05f-a27f-477e-babc-d2fa555910c1 service nova] Acquired lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG nova.network.neutron [req-a492e267-bbb5-4bc2-8959-57e9e17cb8b8 req-74a0b05f-a27f-477e-babc-d2fa555910c1 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Refreshing network info cache for port 10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2829a970-4d0c-428a-9884-8a994337c6b8]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] SCSI volumes sdd have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[580c1e2d-d6b6-49f7-a3d8-b97ed01a9aeb]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7ef9e4-6397-4a8e-9a25-26c46bb4018e]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a, portal: 172.16.0.220,3260]
Aug 01 18:27:55 user nova-compute[72150]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a, portal: 172.16.0.220,3260] successful.
Aug 01 18:27:55 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4628e1ee-2e16-4255-95e8-c5cc4e6c775a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a562fea-0626-4a4b-b397-6f2c91c75063]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] <== disconnect_volume: return (292ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG nova.objects.instance [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lazy-loading 'flavor' on Instance uuid bcbfca8c-8bdb-47d2-addc-e1cec3166dc5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:27:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6da255b1-10b1-48fd-b928-f7ad2a1a6360 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.639s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:56 user nova-compute[72150]: DEBUG nova.network.neutron [req-a492e267-bbb5-4bc2-8959-57e9e17cb8b8 req-74a0b05f-a27f-477e-babc-d2fa555910c1 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Updated VIF entry in instance network info cache for port 10176957-b4a6-4052-9a16-21152c8c3da5. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:27:56 user nova-compute[72150]: DEBUG nova.network.neutron [req-a492e267-bbb5-4bc2-8959-57e9e17cb8b8 req-74a0b05f-a27f-477e-babc-d2fa555910c1 service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Updating instance_info_cache with network_info: [{"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:27:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a492e267-bbb5-4bc2-8959-57e9e17cb8b8 req-74a0b05f-a27f-477e-babc-d2fa555910c1 service nova] Releasing lock "refresh_cache-e298ac85-ebe3-4aa1-ae1e-91134e13e230" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:27:56 user nova-compute[72150]: DEBUG nova.objects.instance [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lazy-loading 'flavor' on Instance uuid e298ac85-ebe3-4aa1-ae1e-91134e13e230 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:27:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-71cee2dd-3afd-40de-98d3-c91fc854f49e tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.608s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:27:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:27:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:02 user nova-compute[72150]: INFO nova.compute.manager [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Terminating instance
Aug 01 18:28:02 user nova-compute[72150]: DEBUG nova.compute.manager [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:28:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:03 user nova-compute[72150]: DEBUG nova.compute.manager [req-8b40b533-ce3e-4378-9991-c4a09c6fe3b6 req-2f67ca60-c9a0-49c4-b61e-fa6e659b2417 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Received event network-vif-unplugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:28:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8b40b533-ce3e-4378-9991-c4a09c6fe3b6 req-2f67ca60-c9a0-49c4-b61e-fa6e659b2417 service nova] Acquiring lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8b40b533-ce3e-4378-9991-c4a09c6fe3b6 req-2f67ca60-c9a0-49c4-b61e-fa6e659b2417 service nova] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8b40b533-ce3e-4378-9991-c4a09c6fe3b6 req-2f67ca60-c9a0-49c4-b61e-fa6e659b2417 service nova] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:03 user nova-compute[72150]: DEBUG nova.compute.manager [req-8b40b533-ce3e-4378-9991-c4a09c6fe3b6 req-2f67ca60-c9a0-49c4-b61e-fa6e659b2417 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] No waiting events found dispatching network-vif-unplugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:28:03 user nova-compute[72150]: DEBUG nova.compute.manager [req-8b40b533-ce3e-4378-9991-c4a09c6fe3b6 req-2f67ca60-c9a0-49c4-b61e-fa6e659b2417 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Received event network-vif-unplugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:28:03 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Instance destroyed successfully.
Aug 01 18:28:03 user nova-compute[72150]: DEBUG nova.objects.instance [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'resources' on Instance uuid 3f123d4e-1aec-4aa1-8717-f31305a62a5d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:28:03 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T18:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1003209770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1003209770',id=1,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbjycC5zBZm+jvsm6GKYmgPP65OAatTQjCe2+mKm63L/m7E/UypS6JMjfua0Hf9QrTu6zvwdEzRoBZi9TuD4yBQcH8hOrW2tjxpilyk89sJYOLq8mOKZh/+51AlthHzMA==',key_name='tempest-keypair-1020169864',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:25:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='493923414b464384bb3a1ce3e6f7a2f0',ramdisk_id='',reservation_id='r-6jxlw7xx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849821930',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849821930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:25:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5804d69f9f18482f9fe0e0d4d73c4e92',uuid=3f123d4e-1aec-4aa1-8717-f31305a62a5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:28:03 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converting VIF {"id": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "address": "fa:16:3e:c9:fb:29", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc6d1a-9b", "ovs_interfaceid": "b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:28:03 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fb:29,bridge_name='br-int',has_traffic_filtering=True,id=b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc6d1a-9b') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:28:03 user nova-compute[72150]: DEBUG os_vif [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fb:29,bridge_name='br-int',has_traffic_filtering=True,id=b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc6d1a-9b') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:28:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3bc6d1a-9b, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:28:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:03 user nova-compute[72150]: INFO os_vif [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fb:29,bridge_name='br-int',has_traffic_filtering=True,id=b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc6d1a-9b')
Aug 01 18:28:03 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Deleting instance files /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d_del
Aug 01 18:28:03 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Deletion of /opt/stack/data/nova/instances/3f123d4e-1aec-4aa1-8717-f31305a62a5d_del complete
Aug 01 18:28:03 user nova-compute[72150]: INFO nova.compute.manager [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 01 18:28:03 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:28:03 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:28:03 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:28:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:04 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:28:04 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Took 0.91 seconds to deallocate network for instance.
Aug 01 18:28:04 user nova-compute[72150]: DEBUG nova.compute.manager [req-11099507-9155-466f-9d20-16111841329f req-07cb45a6-0959-4b45-9059-f511145b781c service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Received event network-vif-deleted-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:28:04 user nova-compute[72150]: INFO nova.compute.manager [req-11099507-9155-466f-9d20-16111841329f req-07cb45a6-0959-4b45-9059-f511145b781c service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Neutron deleted interface b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17; detaching it from the instance and deleting it from the info cache
Aug 01 18:28:04 user nova-compute[72150]: DEBUG nova.network.neutron [req-11099507-9155-466f-9d20-16111841329f req-07cb45a6-0959-4b45-9059-f511145b781c service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:28:04 user nova-compute[72150]: DEBUG nova.compute.manager [req-11099507-9155-466f-9d20-16111841329f req-07cb45a6-0959-4b45-9059-f511145b781c service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Detach interface failed, port_id=b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17, reason: Instance 3f123d4e-1aec-4aa1-8717-f31305a62a5d could not be found. {{(pid=72150) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 18:28:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:04 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Refreshing inventories for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 18:28:04 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Updating ProviderTree inventory for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 18:28:04 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Updating inventory in ProviderTree for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 18:28:04 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Refreshing aggregate associations for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479, aggregates: None {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 18:28:04 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Refreshing trait associations for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 18:28:05 user nova-compute[72150]: DEBUG nova.compute.manager [req-b6ef75ee-282c-4299-a149-9182fec6513d req-cfa9993e-1d3b-4f5e-a67c-2f5fa1c9a252 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Received event network-vif-plugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:28:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b6ef75ee-282c-4299-a149-9182fec6513d req-cfa9993e-1d3b-4f5e-a67c-2f5fa1c9a252 service nova] Acquiring lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b6ef75ee-282c-4299-a149-9182fec6513d req-cfa9993e-1d3b-4f5e-a67c-2f5fa1c9a252 service nova] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b6ef75ee-282c-4299-a149-9182fec6513d req-cfa9993e-1d3b-4f5e-a67c-2f5fa1c9a252 service nova] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:05 user nova-compute[72150]: DEBUG nova.compute.manager [req-b6ef75ee-282c-4299-a149-9182fec6513d req-cfa9993e-1d3b-4f5e-a67c-2f5fa1c9a252 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] No waiting events found dispatching network-vif-plugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:28:05 user nova-compute[72150]: WARNING nova.compute.manager [req-b6ef75ee-282c-4299-a149-9182fec6513d req-cfa9993e-1d3b-4f5e-a67c-2f5fa1c9a252 service nova] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Received unexpected event network-vif-plugged-b3bc6d1a-9bed-4f0f-8a33-bcefb51c1e17 for instance with vm_state deleted and task_state None.
Aug 01 18:28:05 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:28:05 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:28:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.694s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:05 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Deleted allocations for instance 3f123d4e-1aec-4aa1-8717-f31305a62a5d
Aug 01 18:28:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-556764e4-e343-413b-bcb3-9cbf2fa8ad90 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "3f123d4e-1aec-4aa1-8717-f31305a62a5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.720s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:18 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914483.576869, 3f123d4e-1aec-4aa1-8717-f31305a62a5d => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:28:18 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] VM Stopped (Lifecycle Event)
Aug 01 18:28:18 user nova-compute[72150]: DEBUG nova.compute.manager [None req-dad60100-a850-4b34-bec0-494a1c9fe9d9 None None] [instance: 3f123d4e-1aec-4aa1-8717-f31305a62a5d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:28:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:18 user nova-compute[72150]: INFO nova.compute.manager [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Terminating instance
Aug 01 18:28:18 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG nova.compute.manager [req-5bebd3be-23dc-45ad-8cc9-1bdd69c5634f req-4e724de6-f05a-4b22-aa4a-bdc63e5227fb service nova] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Received event network-vif-unplugged-08ad3719-57b0-43f4-bd06-91c9a68bd67f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5bebd3be-23dc-45ad-8cc9-1bdd69c5634f req-4e724de6-f05a-4b22-aa4a-bdc63e5227fb service nova] Acquiring lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5bebd3be-23dc-45ad-8cc9-1bdd69c5634f req-4e724de6-f05a-4b22-aa4a-bdc63e5227fb service nova] Lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5bebd3be-23dc-45ad-8cc9-1bdd69c5634f req-4e724de6-f05a-4b22-aa4a-bdc63e5227fb service nova] Lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG nova.compute.manager [req-5bebd3be-23dc-45ad-8cc9-1bdd69c5634f req-4e724de6-f05a-4b22-aa4a-bdc63e5227fb service nova] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] No waiting events found dispatching network-vif-unplugged-08ad3719-57b0-43f4-bd06-91c9a68bd67f {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG nova.compute.manager [req-5bebd3be-23dc-45ad-8cc9-1bdd69c5634f req-4e724de6-f05a-4b22-aa4a-bdc63e5227fb service nova] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Received event network-vif-unplugged-08ad3719-57b0-43f4-bd06-91c9a68bd67f for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG nova.compute.manager [None req-49907c28-2aaf-46dd-bbc5-d4d7be1c6656 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:28:19 user nova-compute[72150]: INFO nova.compute.manager [None req-49907c28-2aaf-46dd-bbc5-d4d7be1c6656 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] instance snapshotting
Aug 01 18:28:19 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-49907c28-2aaf-46dd-bbc5-d4d7be1c6656 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Beginning live snapshot process
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-49907c28-2aaf-46dd-bbc5-d4d7be1c6656 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json -f qcow2 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:19 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Instance destroyed successfully.
Aug 01 18:28:19 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lazy-loading 'resources' on Instance uuid fef6a232-f401-4dbb-b19b-b5a05cfdb1c2 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1624357681',display_name='tempest-TestVolumeBootPattern-server-1624357681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1624357681',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:26:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7ca44f23b114893afcfe57c52f693b1',ramdisk_id='',reservation_id='r-9yjy6ldq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-295340968',owner_user_name='tempest-TestVolumeBootPattern-295340968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:26:54Z,user_data=None,user_id='92c7ef0ed6814f8880de76adb913a487',uuid=fef6a232-f401-4dbb-b19b-b5a05cfdb1c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08ad3719-57b0-43f4-bd06-91c9a68bd67f", "address": "fa:16:3e:5a:6d:2e", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ad3719-57", "ovs_interfaceid": "08ad3719-57b0-43f4-bd06-91c9a68bd67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converting VIF {"id": "08ad3719-57b0-43f4-bd06-91c9a68bd67f", "address": "fa:16:3e:5a:6d:2e", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ad3719-57", "ovs_interfaceid": "08ad3719-57b0-43f4-bd06-91c9a68bd67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:6d:2e,bridge_name='br-int',has_traffic_filtering=True,id=08ad3719-57b0-43f4-bd06-91c9a68bd67f,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ad3719-57') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG os_vif [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:6d:2e,bridge_name='br-int',has_traffic_filtering=True,id=08ad3719-57b0-43f4-bd06-91c9a68bd67f,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ad3719-57') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08ad3719-57, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:28:19 user nova-compute[72150]: INFO os_vif [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:6d:2e,bridge_name='br-int',has_traffic_filtering=True,id=08ad3719-57b0-43f4-bd06-91c9a68bd67f,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ad3719-57')
Aug 01 18:28:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HnykVOpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:28:19 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:28:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9ed630-c4e1-412a-8df8-335f8c8409dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-49907c28-2aaf-46dd-bbc5-d4d7be1c6656 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-49907c28-2aaf-46dd-bbc5-d4d7be1c6656 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json -f qcow2 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb2e460-d9f1-4042-8eba-51d4a3480d5c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)
Aug 01 18:28:19 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d (non-flash)
Aug 01 18:28:19 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c2b55a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d'): ({'sde'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Removing single pathed devices sde {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1a5b70-47b2-40af-a9bd-f1121cdbb335]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ed1639-7fdb-4ddc-ac51-e2b95e898850]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Flushing IO for device /dev/sde {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d193a184-ff15-4fc3-bd84-311728c2c8c1]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-49907c28-2aaf-46dd-bbc5-d4d7be1c6656 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-49907c28-2aaf-46dd-bbc5-d4d7be1c6656 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee46271-ffb8-463b-8f3e-da0d63c423bd]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] SCSI volumes sde have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:28:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:20 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0b331c-7804-4f2c-8253-6df9da135d18]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:28:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:28:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-49907c28-2aaf-46dd-bbc5-d4d7be1c6656 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-49907c28-2aaf-46dd-bbc5-d4d7be1c6656 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwkox7s8a/2c43e329f10844d78c6e0f59524aff00.delta 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:20 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e84236-3e30-4f6a-a0b1-0fe8b3cdab7b]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:28:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d, portal: 172.16.0.220,3260]
Aug 01 18:28:20 user nova-compute[72150]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d, portal: 172.16.0.220,3260] successful.
Aug 01 18:28:20 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:28:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-49907c28-2aaf-46dd-bbc5-d4d7be1c6656 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwkox7s8a/2c43e329f10844d78c6e0f59524aff00.delta 1073741824" returned: 0 in 0.048s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:20 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-49907c28-2aaf-46dd-bbc5-d4d7be1c6656 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 18:28:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b898b26-e241-40f5-8823-ae1d7c2aa47d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:20 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[66589049-57e4-4ae4-ae99-ba2e9df4ce8f]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:28:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:28:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:28:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] <== disconnect_volume: return (368ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:28:20 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:28:20 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Deleting instance files /opt/stack/data/nova/instances/fef6a232-f401-4dbb-b19b-b5a05cfdb1c2_del
Aug 01 18:28:20 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Deletion of /opt/stack/data/nova/instances/fef6a232-f401-4dbb-b19b-b5a05cfdb1c2_del complete
Aug 01 18:28:20 user nova-compute[72150]: INFO nova.compute.manager [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 01 18:28:20 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:28:20 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:28:20 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:28:20 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:28:20 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Took 0.58 seconds to deallocate network for instance.
Aug 01 18:28:20 user nova-compute[72150]: DEBUG nova.compute.manager [req-19be203a-0880-4e27-9a6a-8c8d45125e6b req-5998d7d1-b9b0-4184-93fd-0816c8323a00 service nova] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Received event network-vif-deleted-08ad3719-57b0-43f4-bd06-91c9a68bd67f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:28:20 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-49907c28-2aaf-46dd-bbc5-d4d7be1c6656 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:28:21 user nova-compute[72150]: DEBUG nova.compute.manager [req-bae84af7-5656-4882-975e-f120a05ae706 req-7ed8332f-dee2-4f69-bdb6-c20b899db15a service nova] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Received event network-vif-plugged-08ad3719-57b0-43f4-bd06-91c9a68bd67f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:28:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bae84af7-5656-4882-975e-f120a05ae706 req-7ed8332f-dee2-4f69-bdb6-c20b899db15a service nova] Acquiring lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bae84af7-5656-4882-975e-f120a05ae706 req-7ed8332f-dee2-4f69-bdb6-c20b899db15a service nova] Lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bae84af7-5656-4882-975e-f120a05ae706 req-7ed8332f-dee2-4f69-bdb6-c20b899db15a service nova] Lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:21 user nova-compute[72150]: DEBUG nova.compute.manager [req-bae84af7-5656-4882-975e-f120a05ae706 req-7ed8332f-dee2-4f69-bdb6-c20b899db15a service nova] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] No waiting events found dispatching network-vif-plugged-08ad3719-57b0-43f4-bd06-91c9a68bd67f {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:28:21 user nova-compute[72150]: WARNING nova.compute.manager [req-bae84af7-5656-4882-975e-f120a05ae706 req-7ed8332f-dee2-4f69-bdb6-c20b899db15a service nova] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Received unexpected event network-vif-plugged-08ad3719-57b0-43f4-bd06-91c9a68bd67f for instance with vm_state active and task_state deleting.
Aug 01 18:28:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-49907c28-2aaf-46dd-bbc5-d4d7be1c6656 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:28:21 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-49907c28-2aaf-46dd-bbc5-d4d7be1c6656 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 18:28:21 user nova-compute[72150]: DEBUG nova.privsep.utils [None req-49907c28-2aaf-46dd-bbc5-d4d7be1c6656 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72150) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 18:28:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-49907c28-2aaf-46dd-bbc5-d4d7be1c6656 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwkox7s8a/2c43e329f10844d78c6e0f59524aff00.delta /opt/stack/data/nova/instances/snapshots/tmpwkox7s8a/2c43e329f10844d78c6e0f59524aff00 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:21 user nova-compute[72150]: INFO nova.compute.manager [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Took 0.94 seconds to detach 1 volumes for instance.
Aug 01 18:28:21 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Deleting volume: 3b898b26-e241-40f5-8823-ae1d7c2aa47d {{(pid=72150) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 18:28:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-49907c28-2aaf-46dd-bbc5-d4d7be1c6656 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwkox7s8a/2c43e329f10844d78c6e0f59524aff00.delta /opt/stack/data/nova/instances/snapshots/tmpwkox7s8a/2c43e329f10844d78c6e0f59524aff00" returned: 0 in 0.495s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:21 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-49907c28-2aaf-46dd-bbc5-d4d7be1c6656 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Snapshot extracted, beginning image upload
Aug 01 18:28:22 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:28:22 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:28:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:22 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Deleted allocations for instance fef6a232-f401-4dbb-b19b-b5a05cfdb1c2
Aug 01 18:28:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9087a38f-ba02-4c03-8120-0ba3a14f8676 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "fef6a232-f401-4dbb-b19b-b5a05cfdb1c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.371s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:24 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-49907c28-2aaf-46dd-bbc5-d4d7be1c6656 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Snapshot image upload complete
Aug 01 18:28:24 user nova-compute[72150]: INFO nova.compute.manager [None req-49907c28-2aaf-46dd-bbc5-d4d7be1c6656 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Took 5.02 seconds to snapshot the instance on the hypervisor.
Aug 01 18:28:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "050260e0-53e0-43dd-a301-a4e3e411f34d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "050260e0-53e0-43dd-a301-a4e3e411f34d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "050260e0-53e0-43dd-a301-a4e3e411f34d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "050260e0-53e0-43dd-a301-a4e3e411f34d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "050260e0-53e0-43dd-a301-a4e3e411f34d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:27 user nova-compute[72150]: INFO nova.compute.manager [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Terminating instance
Aug 01 18:28:27 user nova-compute[72150]: DEBUG nova.compute.manager [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:28:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:27 user nova-compute[72150]: DEBUG nova.compute.manager [req-651c4e30-95f5-469c-bfe0-2e1330814c3f req-ffb2e506-d5a1-413a-924e-af7ebf2c660d service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Received event network-vif-unplugged-c82387ba-7cc9-4eac-9469-021c80c1c195 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:28:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-651c4e30-95f5-469c-bfe0-2e1330814c3f req-ffb2e506-d5a1-413a-924e-af7ebf2c660d service nova] Acquiring lock "050260e0-53e0-43dd-a301-a4e3e411f34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-651c4e30-95f5-469c-bfe0-2e1330814c3f req-ffb2e506-d5a1-413a-924e-af7ebf2c660d service nova] Lock "050260e0-53e0-43dd-a301-a4e3e411f34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-651c4e30-95f5-469c-bfe0-2e1330814c3f req-ffb2e506-d5a1-413a-924e-af7ebf2c660d service nova] Lock "050260e0-53e0-43dd-a301-a4e3e411f34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:27 user nova-compute[72150]: DEBUG nova.compute.manager [req-651c4e30-95f5-469c-bfe0-2e1330814c3f req-ffb2e506-d5a1-413a-924e-af7ebf2c660d service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] No waiting events found dispatching network-vif-unplugged-c82387ba-7cc9-4eac-9469-021c80c1c195 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:28:27 user nova-compute[72150]: DEBUG nova.compute.manager [req-651c4e30-95f5-469c-bfe0-2e1330814c3f req-ffb2e506-d5a1-413a-924e-af7ebf2c660d service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Received event network-vif-unplugged-c82387ba-7cc9-4eac-9469-021c80c1c195 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:28:28 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Instance destroyed successfully.
Aug 01 18:28:28 user nova-compute[72150]: DEBUG nova.objects.instance [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lazy-loading 'resources' on Instance uuid 050260e0-53e0-43dd-a301-a4e3e411f34d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:28:28 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-215959377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-215959377',id=3,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/wFowy+M1NAPnvANCXjan/daFtwmUjVAs74fsHLjZxiCYE/+xbPtnm8pIgXOeNbriQJTWIvWSP9HtPPGIZRq1lPhZFjuc5VnxhFyz1VYnUnucR7H9nTtIhQVb22bKz0Q==',key_name='tempest-keypair-926565866',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:21:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cec5474a64d46c2bfc92435c677abf2',ramdisk_id='',reservation_id='r-h2809h54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1421721381',owner_user_name='tempest-ServerActionsV293TestJSON-1421721381-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e312b378dd2b43798193756afb51e343',uuid=050260e0-53e0-43dd-a301-a4e3e411f34d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c82387ba-7cc9-4eac-9469-021c80c1c195", "address": "fa:16:3e:ba:0b:96", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82387ba-7c", "ovs_interfaceid": "c82387ba-7cc9-4eac-9469-021c80c1c195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:28:28 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Converting VIF {"id": "c82387ba-7cc9-4eac-9469-021c80c1c195", "address": "fa:16:3e:ba:0b:96", "network": {"id": "ac6e56c1-0122-4bc2-b6b2-a76d80894c7b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-690476238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cec5474a64d46c2bfc92435c677abf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82387ba-7c", "ovs_interfaceid": "c82387ba-7cc9-4eac-9469-021c80c1c195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:28:28 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:0b:96,bridge_name='br-int',has_traffic_filtering=True,id=c82387ba-7cc9-4eac-9469-021c80c1c195,network=Network(ac6e56c1-0122-4bc2-b6b2-a76d80894c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc82387ba-7c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:28:28 user nova-compute[72150]: DEBUG os_vif [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:0b:96,bridge_name='br-int',has_traffic_filtering=True,id=c82387ba-7cc9-4eac-9469-021c80c1c195,network=Network(ac6e56c1-0122-4bc2-b6b2-a76d80894c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc82387ba-7c') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:28:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc82387ba-7c, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:28:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:28:28 user nova-compute[72150]: INFO os_vif [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:0b:96,bridge_name='br-int',has_traffic_filtering=True,id=c82387ba-7cc9-4eac-9469-021c80c1c195,network=Network(ac6e56c1-0122-4bc2-b6b2-a76d80894c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc82387ba-7c')
Aug 01 18:28:28 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Deleting instance files /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d_del
Aug 01 18:28:28 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Deletion of /opt/stack/data/nova/instances/050260e0-53e0-43dd-a301-a4e3e411f34d_del complete
Aug 01 18:28:28 user nova-compute[72150]: INFO nova.compute.manager [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 18:28:28 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:28:28 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:28:28 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:28:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-17a888a2-bf16-4ed0-83f4-ecdb302526ef req-d1a93347-e94b-4c49-8cf1-e192fa9dc307 service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Received event network-vif-deleted-c82387ba-7cc9-4eac-9469-021c80c1c195 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:28:29 user nova-compute[72150]: INFO nova.compute.manager [req-17a888a2-bf16-4ed0-83f4-ecdb302526ef req-d1a93347-e94b-4c49-8cf1-e192fa9dc307 service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Neutron deleted interface c82387ba-7cc9-4eac-9469-021c80c1c195; detaching it from the instance and deleting it from the info cache
Aug 01 18:28:29 user nova-compute[72150]: DEBUG nova.network.neutron [req-17a888a2-bf16-4ed0-83f4-ecdb302526ef req-d1a93347-e94b-4c49-8cf1-e192fa9dc307 service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:28:29 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:28:29 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Took 1.21 seconds to deallocate network for instance.
Aug 01 18:28:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-17a888a2-bf16-4ed0-83f4-ecdb302526ef req-d1a93347-e94b-4c49-8cf1-e192fa9dc307 service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Detach interface failed, port_id=c82387ba-7cc9-4eac-9469-021c80c1c195, reason: Instance 050260e0-53e0-43dd-a301-a4e3e411f34d could not be found. {{(pid=72150) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 18:28:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-2fbfafe2-4d88-4798-b69e-7a871828919f req-2865837a-2752-44c1-be54-c6dc5e8f121e service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Received event network-vif-plugged-c82387ba-7cc9-4eac-9469-021c80c1c195 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:28:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2fbfafe2-4d88-4798-b69e-7a871828919f req-2865837a-2752-44c1-be54-c6dc5e8f121e service nova] Acquiring lock "050260e0-53e0-43dd-a301-a4e3e411f34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2fbfafe2-4d88-4798-b69e-7a871828919f req-2865837a-2752-44c1-be54-c6dc5e8f121e service nova] Lock "050260e0-53e0-43dd-a301-a4e3e411f34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2fbfafe2-4d88-4798-b69e-7a871828919f req-2865837a-2752-44c1-be54-c6dc5e8f121e service nova] Lock "050260e0-53e0-43dd-a301-a4e3e411f34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-2fbfafe2-4d88-4798-b69e-7a871828919f req-2865837a-2752-44c1-be54-c6dc5e8f121e service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] No waiting events found dispatching network-vif-plugged-c82387ba-7cc9-4eac-9469-021c80c1c195 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:28:29 user nova-compute[72150]: WARNING nova.compute.manager [req-2fbfafe2-4d88-4798-b69e-7a871828919f req-2865837a-2752-44c1-be54-c6dc5e8f121e service nova] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Received unexpected event network-vif-plugged-c82387ba-7cc9-4eac-9469-021c80c1c195 for instance with vm_state deleted and task_state None.
Aug 01 18:28:29 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:28:29 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:28:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:29 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Deleted allocations for instance 050260e0-53e0-43dd-a301-a4e3e411f34d
Aug 01 18:28:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-03e2077e-c256-46a0-b4f7-d0d61abf3b73 tempest-ServerActionsV293TestJSON-1421721381 tempest-ServerActionsV293TestJSON-1421721381-project-member] Lock "050260e0-53e0-43dd-a301-a4e3e411f34d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.547s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:30 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:28:30 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:28:30 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:28:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:30 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:28:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:33 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:28:34 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:28:34 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=7424MB free_disk=25.604209899902344GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:28:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:34 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance e298ac85-ebe3-4aa1-ae1e-91134e13e230 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:28:34 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 769690c8-53c5-4057-88a5-fbdbcb930e32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:28:34 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ea68420b-8362-4df3-b710-cd1cf76adba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:28:34 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance bcbfca8c-8bdb-47d2-addc-e1cec3166dc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:28:34 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 08851ec4-6f71-4ec1-a092-42aab83ee87f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:28:34 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance bf2d1f14-2227-41d1-bd73-a05ab3149aba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:28:34 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance a5f0eca7-d060-4226-b36e-a3cd15b15703 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:28:34 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ceee3912-ca68-4b15-8fe6-985d905e8128 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:28:34 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:28:34 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:28:34 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:28:34 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:28:34 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:28:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.390s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:34 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914499.7078428, fef6a232-f401-4dbb-b19b-b5a05cfdb1c2 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:28:34 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] VM Stopped (Lifecycle Event)
Aug 01 18:28:34 user nova-compute[72150]: DEBUG nova.compute.manager [None req-01015461-9d5f-486b-aa87-2079a5ef5da1 None None] [instance: fef6a232-f401-4dbb-b19b-b5a05cfdb1c2] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:28:35 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:28:35 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:28:35 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:28:35 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:28:35 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:28:35 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:28:37 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:28:37 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:28:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-769690c8-53c5-4057-88a5-fbdbcb930e32" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:28:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-769690c8-53c5-4057-88a5-fbdbcb930e32" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:28:37 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:28:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:38 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Updating instance_info_cache with network_info: [{"id": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "address": "fa:16:3e:8e:d7:75", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2596e33-c1", "ovs_interfaceid": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:28:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-769690c8-53c5-4057-88a5-fbdbcb930e32" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:28:38 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:28:40 user nova-compute[72150]: DEBUG nova.compute.manager [req-55933639-825b-4667-aaa6-584baa100c19 req-08dba9bc-cd45-499a-bced-55e80776e4e7 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Received event network-changed-41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:28:40 user nova-compute[72150]: DEBUG nova.compute.manager [req-55933639-825b-4667-aaa6-584baa100c19 req-08dba9bc-cd45-499a-bced-55e80776e4e7 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Refreshing instance network info cache due to event network-changed-41eb682d-9c56-46b8-bd1d-b479d120b8a1. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:28:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-55933639-825b-4667-aaa6-584baa100c19 req-08dba9bc-cd45-499a-bced-55e80776e4e7 service nova] Acquiring lock "refresh_cache-bf2d1f14-2227-41d1-bd73-a05ab3149aba" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:28:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-55933639-825b-4667-aaa6-584baa100c19 req-08dba9bc-cd45-499a-bced-55e80776e4e7 service nova] Acquired lock "refresh_cache-bf2d1f14-2227-41d1-bd73-a05ab3149aba" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:28:40 user nova-compute[72150]: DEBUG nova.network.neutron [req-55933639-825b-4667-aaa6-584baa100c19 req-08dba9bc-cd45-499a-bced-55e80776e4e7 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Refreshing network info cache for port 41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:28:41 user nova-compute[72150]: DEBUG nova.network.neutron [req-55933639-825b-4667-aaa6-584baa100c19 req-08dba9bc-cd45-499a-bced-55e80776e4e7 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Updated VIF entry in instance network info cache for port 41eb682d-9c56-46b8-bd1d-b479d120b8a1. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:28:41 user nova-compute[72150]: DEBUG nova.network.neutron [req-55933639-825b-4667-aaa6-584baa100c19 req-08dba9bc-cd45-499a-bced-55e80776e4e7 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Updating instance_info_cache with network_info: [{"id": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "address": "fa:16:3e:63:c8:50", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41eb682d-9c", "ovs_interfaceid": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:28:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-55933639-825b-4667-aaa6-584baa100c19 req-08dba9bc-cd45-499a-bced-55e80776e4e7 service nova] Releasing lock "refresh_cache-bf2d1f14-2227-41d1-bd73-a05ab3149aba" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:28:43 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914508.07146, 050260e0-53e0-43dd-a301-a4e3e411f34d => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:28:43 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] VM Stopped (Lifecycle Event)
Aug 01 18:28:43 user nova-compute[72150]: DEBUG nova.compute.manager [None req-27285405-7863-40b8-b87f-674f28af8a8b None None] [instance: 050260e0-53e0-43dd-a301-a4e3e411f34d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:28:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:28:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:28:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:28:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:28:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "a50fb967-36ed-4266-bf10-66606dd64320" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "a50fb967-36ed-4266-bf10-66606dd64320" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:45 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:28:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:45 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:28:45 user nova-compute[72150]: INFO nova.compute.claims [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Claim successful on node user
Aug 01 18:28:46 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG nova.network.neutron [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:28:46 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:28:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG nova.policy [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8264f17490ec46638cf38187aab3ce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41181268f4754733811b1abdad7eeb21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:28:46 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Creating image(s)
Aug 01 18:28:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "/opt/stack/data/nova/instances/a50fb967-36ed-4266-bf10-66606dd64320/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "/opt/stack/data/nova/instances/a50fb967-36ed-4266-bf10-66606dd64320/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "/opt/stack/data/nova/instances/a50fb967-36ed-4266-bf10-66606dd64320/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.132s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/a50fb967-36ed-4266-bf10-66606dd64320/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/a50fb967-36ed-4266-bf10-66606dd64320/disk 1073741824" returned: 0 in 0.048s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a50fb967-36ed-4266-bf10-66606dd64320/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:28:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a50fb967-36ed-4266-bf10-66606dd64320/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:47 user nova-compute[72150]: DEBUG nova.network.neutron [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Successfully created port: 7c67dc1c-6443-4e87-b055-6103231fd3b0 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:28:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a50fb967-36ed-4266-bf10-66606dd64320/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:47 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Cannot resize image /opt/stack/data/nova/instances/a50fb967-36ed-4266-bf10-66606dd64320/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:28:47 user nova-compute[72150]: DEBUG nova.objects.instance [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lazy-loading 'migration_context' on Instance uuid a50fb967-36ed-4266-bf10-66606dd64320 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:28:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:28:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Ensure instance console log exists: /opt/stack/data/nova/instances/a50fb967-36ed-4266-bf10-66606dd64320/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:28:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:47 user nova-compute[72150]: DEBUG nova.network.neutron [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Successfully updated port: 7c67dc1c-6443-4e87-b055-6103231fd3b0 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:28:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "refresh_cache-a50fb967-36ed-4266-bf10-66606dd64320" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:28:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquired lock "refresh_cache-a50fb967-36ed-4266-bf10-66606dd64320" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:28:47 user nova-compute[72150]: DEBUG nova.network.neutron [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:28:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-eef7c2de-4880-404c-a0df-8fe5f2fecb92 req-81ff1e56-e380-418d-a341-990598082b4c service nova] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Received event network-changed-7c67dc1c-6443-4e87-b055-6103231fd3b0 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:28:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-eef7c2de-4880-404c-a0df-8fe5f2fecb92 req-81ff1e56-e380-418d-a341-990598082b4c service nova] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Refreshing instance network info cache due to event network-changed-7c67dc1c-6443-4e87-b055-6103231fd3b0. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:28:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-eef7c2de-4880-404c-a0df-8fe5f2fecb92 req-81ff1e56-e380-418d-a341-990598082b4c service nova] Acquiring lock "refresh_cache-a50fb967-36ed-4266-bf10-66606dd64320" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:28:47 user nova-compute[72150]: DEBUG nova.network.neutron [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.network.neutron [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Updating instance_info_cache with network_info: [{"id": "7c67dc1c-6443-4e87-b055-6103231fd3b0", "address": "fa:16:3e:36:79:d5", "network": {"id": "633e7e89-16a6-4a46-8d94-0a1cc6891579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211447573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41181268f4754733811b1abdad7eeb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c67dc1c-64", "ovs_interfaceid": "7c67dc1c-6443-4e87-b055-6103231fd3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Releasing lock "refresh_cache-a50fb967-36ed-4266-bf10-66606dd64320" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Instance network_info: |[{"id": "7c67dc1c-6443-4e87-b055-6103231fd3b0", "address": "fa:16:3e:36:79:d5", "network": {"id": "633e7e89-16a6-4a46-8d94-0a1cc6891579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211447573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41181268f4754733811b1abdad7eeb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c67dc1c-64", "ovs_interfaceid": "7c67dc1c-6443-4e87-b055-6103231fd3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-eef7c2de-4880-404c-a0df-8fe5f2fecb92 req-81ff1e56-e380-418d-a341-990598082b4c service nova] Acquired lock "refresh_cache-a50fb967-36ed-4266-bf10-66606dd64320" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.network.neutron [req-eef7c2de-4880-404c-a0df-8fe5f2fecb92 req-81ff1e56-e380-418d-a341-990598082b4c service nova] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Refreshing network info cache for port 7c67dc1c-6443-4e87-b055-6103231fd3b0 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Start _get_guest_xml network_info=[{"id": "7c67dc1c-6443-4e87-b055-6103231fd3b0", "address": "fa:16:3e:36:79:d5", "network": {"id": "633e7e89-16a6-4a46-8d94-0a1cc6891579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211447573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41181268f4754733811b1abdad7eeb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c67dc1c-64", "ovs_interfaceid": "7c67dc1c-6443-4e87-b055-6103231fd3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:28:48 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:28:48 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:28:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1838942122',display_name='tempest-VolumesAdminNegativeTest-server-1838942122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1838942122',id=20,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41181268f4754733811b1abdad7eeb21',ramdisk_id='',reservation_id='r-o1dafsdk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-38137380',owner_user_name='tempest-VolumesAdminNegativeTest-38137380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:28:46Z,user_data=None,user_id='8264f17490ec46638cf38187aab3ce4c',uuid=a50fb967-36ed-4266-bf10-66606dd64320,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c67dc1c-6443-4e87-b055-6103231fd3b0", "address": "fa:16:3e:36:79:d5", "network": {"id": "633e7e89-16a6-4a46-8d94-0a1cc6891579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211447573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41181268f4754733811b1abdad7eeb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c67dc1c-64", "ovs_interfaceid": "7c67dc1c-6443-4e87-b055-6103231fd3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Converting VIF {"id": "7c67dc1c-6443-4e87-b055-6103231fd3b0", "address": "fa:16:3e:36:79:d5", "network": {"id": "633e7e89-16a6-4a46-8d94-0a1cc6891579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211447573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41181268f4754733811b1abdad7eeb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c67dc1c-64", "ovs_interfaceid": "7c67dc1c-6443-4e87-b055-6103231fd3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:79:d5,bridge_name='br-int',has_traffic_filtering=True,id=7c67dc1c-6443-4e87-b055-6103231fd3b0,network=Network(633e7e89-16a6-4a46-8d94-0a1cc6891579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c67dc1c-64') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.objects.instance [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lazy-loading 'pci_devices' on Instance uuid a50fb967-36ed-4266-bf10-66606dd64320 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:28:48 user nova-compute[72150]:   <uuid>a50fb967-36ed-4266-bf10-66606dd64320</uuid>
Aug 01 18:28:48 user nova-compute[72150]:   <name>instance-00000014</name>
Aug 01 18:28:48 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:28:48 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:28:48 user nova-compute[72150]:   <metadata>
Aug 01 18:28:48 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:28:48 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:28:48 user nova-compute[72150]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1838942122</nova:name>
Aug 01 18:28:48 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:28:48</nova:creationTime>
Aug 01 18:28:48 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:28:48 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:28:48 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:28:48 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:28:48 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:28:48 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:28:48 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:28:48 user nova-compute[72150]:       <nova:owner>
Aug 01 18:28:48 user nova-compute[72150]:         <nova:user uuid="8264f17490ec46638cf38187aab3ce4c">tempest-VolumesAdminNegativeTest-38137380-project-member</nova:user>
Aug 01 18:28:48 user nova-compute[72150]:         <nova:project uuid="41181268f4754733811b1abdad7eeb21">tempest-VolumesAdminNegativeTest-38137380</nova:project>
Aug 01 18:28:48 user nova-compute[72150]:       </nova:owner>
Aug 01 18:28:48 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:28:48 user nova-compute[72150]:       <nova:ports>
Aug 01 18:28:48 user nova-compute[72150]:         <nova:port uuid="7c67dc1c-6443-4e87-b055-6103231fd3b0">
Aug 01 18:28:48 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 18:28:48 user nova-compute[72150]:         </nova:port>
Aug 01 18:28:48 user nova-compute[72150]:       </nova:ports>
Aug 01 18:28:48 user nova-compute[72150]:     </nova:instance>
Aug 01 18:28:48 user nova-compute[72150]:   </metadata>
Aug 01 18:28:48 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:28:48 user nova-compute[72150]:     <system>
Aug 01 18:28:48 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:28:48 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:28:48 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:28:48 user nova-compute[72150]:       <entry name="serial">a50fb967-36ed-4266-bf10-66606dd64320</entry>
Aug 01 18:28:48 user nova-compute[72150]:       <entry name="uuid">a50fb967-36ed-4266-bf10-66606dd64320</entry>
Aug 01 18:28:48 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:28:48 user nova-compute[72150]:     </system>
Aug 01 18:28:48 user nova-compute[72150]:   </sysinfo>
Aug 01 18:28:48 user nova-compute[72150]:   <os>
Aug 01 18:28:48 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:28:48 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:28:48 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:28:48 user nova-compute[72150]:   </os>
Aug 01 18:28:48 user nova-compute[72150]:   <features>
Aug 01 18:28:48 user nova-compute[72150]:     <acpi/>
Aug 01 18:28:48 user nova-compute[72150]:     <apic/>
Aug 01 18:28:48 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:28:48 user nova-compute[72150]:   </features>
Aug 01 18:28:48 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:28:48 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:28:48 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:28:48 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:28:48 user nova-compute[72150]:   </clock>
Aug 01 18:28:48 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:28:48 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:28:48 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:28:48 user nova-compute[72150]:   </cpu>
Aug 01 18:28:48 user nova-compute[72150]:   <devices>
Aug 01 18:28:48 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:28:48 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:28:48 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/a50fb967-36ed-4266-bf10-66606dd64320/disk"/>
Aug 01 18:28:48 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:28:48 user nova-compute[72150]:     </disk>
Aug 01 18:28:48 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:28:48 user nova-compute[72150]:       <mac address="fa:16:3e:36:79:d5"/>
Aug 01 18:28:48 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:28:48 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:28:48 user nova-compute[72150]:       <target dev="tap7c67dc1c-64"/>
Aug 01 18:28:48 user nova-compute[72150]:     </interface>
Aug 01 18:28:48 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:28:48 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/a50fb967-36ed-4266-bf10-66606dd64320/console.log" append="off"/>
Aug 01 18:28:48 user nova-compute[72150]:     </serial>
Aug 01 18:28:48 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:28:48 user nova-compute[72150]:     <video>
Aug 01 18:28:48 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:28:48 user nova-compute[72150]:     </video>
Aug 01 18:28:48 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:28:48 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:28:48 user nova-compute[72150]:     </rng>
Aug 01 18:28:48 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:28:48 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:28:48 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:28:48 user nova-compute[72150]:     </memballoon>
Aug 01 18:28:48 user nova-compute[72150]:   </devices>
Aug 01 18:28:48 user nova-compute[72150]: </domain>
Aug 01 18:28:48 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:28:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1838942122',display_name='tempest-VolumesAdminNegativeTest-server-1838942122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1838942122',id=20,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41181268f4754733811b1abdad7eeb21',ramdisk_id='',reservation_id='r-o1dafsdk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-38137380',owner_user_name='tempest-VolumesAdminNegativeTest-38137380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:28:46Z,user_data=None,user_id='8264f17490ec46638cf38187aab3ce4c',uuid=a50fb967-36ed-4266-bf10-66606dd64320,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c67dc1c-6443-4e87-b055-6103231fd3b0", "address": "fa:16:3e:36:79:d5", "network": {"id": "633e7e89-16a6-4a46-8d94-0a1cc6891579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211447573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41181268f4754733811b1abdad7eeb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c67dc1c-64", "ovs_interfaceid": "7c67dc1c-6443-4e87-b055-6103231fd3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Converting VIF {"id": "7c67dc1c-6443-4e87-b055-6103231fd3b0", "address": "fa:16:3e:36:79:d5", "network": {"id": "633e7e89-16a6-4a46-8d94-0a1cc6891579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211447573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41181268f4754733811b1abdad7eeb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c67dc1c-64", "ovs_interfaceid": "7c67dc1c-6443-4e87-b055-6103231fd3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:79:d5,bridge_name='br-int',has_traffic_filtering=True,id=7c67dc1c-6443-4e87-b055-6103231fd3b0,network=Network(633e7e89-16a6-4a46-8d94-0a1cc6891579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c67dc1c-64') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG os_vif [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:79:d5,bridge_name='br-int',has_traffic_filtering=True,id=7c67dc1c-6443-4e87-b055-6103231fd3b0,network=Network(633e7e89-16a6-4a46-8d94-0a1cc6891579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c67dc1c-64') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c67dc1c-64, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c67dc1c-64, col_values=(('external_ids', {'iface-id': '7c67dc1c-6443-4e87-b055-6103231fd3b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:79:d5', 'vm-uuid': 'a50fb967-36ed-4266-bf10-66606dd64320'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:48 user nova-compute[72150]: INFO os_vif [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:79:d5,bridge_name='br-int',has_traffic_filtering=True,id=7c67dc1c-6443-4e87-b055-6103231fd3b0,network=Network(633e7e89-16a6-4a46-8d94-0a1cc6891579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c67dc1c-64')
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] No VIF found with MAC fa:16:3e:36:79:d5, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.network.neutron [req-eef7c2de-4880-404c-a0df-8fe5f2fecb92 req-81ff1e56-e380-418d-a341-990598082b4c service nova] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Updated VIF entry in instance network info cache for port 7c67dc1c-6443-4e87-b055-6103231fd3b0. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG nova.network.neutron [req-eef7c2de-4880-404c-a0df-8fe5f2fecb92 req-81ff1e56-e380-418d-a341-990598082b4c service nova] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Updating instance_info_cache with network_info: [{"id": "7c67dc1c-6443-4e87-b055-6103231fd3b0", "address": "fa:16:3e:36:79:d5", "network": {"id": "633e7e89-16a6-4a46-8d94-0a1cc6891579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211447573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41181268f4754733811b1abdad7eeb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c67dc1c-64", "ovs_interfaceid": "7c67dc1c-6443-4e87-b055-6103231fd3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-eef7c2de-4880-404c-a0df-8fe5f2fecb92 req-81ff1e56-e380-418d-a341-990598082b4c service nova] Releasing lock "refresh_cache-a50fb967-36ed-4266-bf10-66606dd64320" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:28:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:49 user nova-compute[72150]: INFO nova.compute.manager [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Terminating instance
Aug 01 18:28:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:28:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:49 user nova-compute[72150]: DEBUG nova.compute.manager [req-f086fcfb-d74b-441c-87a6-38ace849372f req-fd33a92c-13fe-4796-bcb4-5512f9938179 service nova] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Received event network-vif-plugged-7c67dc1c-6443-4e87-b055-6103231fd3b0 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:28:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f086fcfb-d74b-441c-87a6-38ace849372f req-fd33a92c-13fe-4796-bcb4-5512f9938179 service nova] Acquiring lock "a50fb967-36ed-4266-bf10-66606dd64320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f086fcfb-d74b-441c-87a6-38ace849372f req-fd33a92c-13fe-4796-bcb4-5512f9938179 service nova] Lock "a50fb967-36ed-4266-bf10-66606dd64320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f086fcfb-d74b-441c-87a6-38ace849372f req-fd33a92c-13fe-4796-bcb4-5512f9938179 service nova] Lock "a50fb967-36ed-4266-bf10-66606dd64320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:49 user nova-compute[72150]: DEBUG nova.compute.manager [req-f086fcfb-d74b-441c-87a6-38ace849372f req-fd33a92c-13fe-4796-bcb4-5512f9938179 service nova] [instance: a50fb967-36ed-4266-bf10-66606dd64320] No waiting events found dispatching network-vif-plugged-7c67dc1c-6443-4e87-b055-6103231fd3b0 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:28:49 user nova-compute[72150]: WARNING nova.compute.manager [req-f086fcfb-d74b-441c-87a6-38ace849372f req-fd33a92c-13fe-4796-bcb4-5512f9938179 service nova] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Received unexpected event network-vif-plugged-7c67dc1c-6443-4e87-b055-6103231fd3b0 for instance with vm_state building and task_state spawning.
Aug 01 18:28:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:50 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Instance destroyed successfully.
Aug 01 18:28:50 user nova-compute[72150]: DEBUG nova.objects.instance [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lazy-loading 'resources' on Instance uuid e298ac85-ebe3-4aa1-ae1e-91134e13e230 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:28:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-994333634',display_name='tempest-TestMinimumBasicScenario-server-994333634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-994333634',id=10,image_ref='77f1cc65-b096-4fb4-9a06-228694cfa68c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbsn8B14gNBI86YJLjn/1VQez4DBB7aV+emX4GIXXc8vb1FExIR+LmGYrOj/H27n+sU8ppSkdq7Qd+qISkUEu9gB+bpJa5naC6wPuaKhrVxha5Jkg1IxeczFB5ECbdm1A==',key_name='tempest-TestMinimumBasicScenario-1137783295',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:23:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96498272792348f3a3c36ee8544100f2',ramdisk_id='',reservation_id='r-c4g57isj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77f1cc65-b096-4fb4-9a06-228694cfa68c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-879365140',owner_user_name='tempest-TestMinimumBasicScenario-879365140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:26:12Z,user_data=None,user_id='3d89a05b857d43c48f0767eb073a2f37',uuid=e298ac85-ebe3-4aa1-ae1e-91134e13e230,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:28:50 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Converting VIF {"id": "10176957-b4a6-4052-9a16-21152c8c3da5", "address": "fa:16:3e:c1:4e:93", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10176957-b4", "ovs_interfaceid": "10176957-b4a6-4052-9a16-21152c8c3da5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:28:50 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:4e:93,bridge_name='br-int',has_traffic_filtering=True,id=10176957-b4a6-4052-9a16-21152c8c3da5,network=Network(e3a4003a-4248-4265-b270-f289b1c2810f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10176957-b4') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:28:50 user nova-compute[72150]: DEBUG os_vif [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:4e:93,bridge_name='br-int',has_traffic_filtering=True,id=10176957-b4a6-4052-9a16-21152c8c3da5,network=Network(e3a4003a-4248-4265-b270-f289b1c2810f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10176957-b4') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:28:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10176957-b4, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:28:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:28:50 user nova-compute[72150]: INFO os_vif [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:4e:93,bridge_name='br-int',has_traffic_filtering=True,id=10176957-b4a6-4052-9a16-21152c8c3da5,network=Network(e3a4003a-4248-4265-b270-f289b1c2810f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10176957-b4')
Aug 01 18:28:50 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Deleting instance files /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230_del
Aug 01 18:28:50 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Deletion of /opt/stack/data/nova/instances/e298ac85-ebe3-4aa1-ae1e-91134e13e230_del complete
Aug 01 18:28:50 user nova-compute[72150]: INFO nova.compute.manager [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 01 18:28:50 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:28:50 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:28:50 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:28:51 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Took 0.49 seconds to deallocate network for instance.
Aug 01 18:28:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:51 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Deleted allocations for instance e298ac85-ebe3-4aa1-ae1e-91134e13e230
Aug 01 18:28:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a49f1c48-40d2-429d-89ef-1153f9958591 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.838s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914531.9354224, a50fb967-36ed-4266-bf10-66606dd64320 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:28:51 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a50fb967-36ed-4266-bf10-66606dd64320] VM Resumed (Lifecycle Event)
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-af2f38ef-cec2-4491-b3b1-6c63fe46fe72 req-867b1efe-a413-4ff6-a7b6-5d375e21a03f service nova] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Received event network-vif-plugged-7c67dc1c-6443-4e87-b055-6103231fd3b0 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-af2f38ef-cec2-4491-b3b1-6c63fe46fe72 req-867b1efe-a413-4ff6-a7b6-5d375e21a03f service nova] Acquiring lock "a50fb967-36ed-4266-bf10-66606dd64320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-af2f38ef-cec2-4491-b3b1-6c63fe46fe72 req-867b1efe-a413-4ff6-a7b6-5d375e21a03f service nova] Lock "a50fb967-36ed-4266-bf10-66606dd64320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-af2f38ef-cec2-4491-b3b1-6c63fe46fe72 req-867b1efe-a413-4ff6-a7b6-5d375e21a03f service nova] Lock "a50fb967-36ed-4266-bf10-66606dd64320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-af2f38ef-cec2-4491-b3b1-6c63fe46fe72 req-867b1efe-a413-4ff6-a7b6-5d375e21a03f service nova] [instance: a50fb967-36ed-4266-bf10-66606dd64320] No waiting events found dispatching network-vif-plugged-7c67dc1c-6443-4e87-b055-6103231fd3b0 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:28:51 user nova-compute[72150]: WARNING nova.compute.manager [req-af2f38ef-cec2-4491-b3b1-6c63fe46fe72 req-867b1efe-a413-4ff6-a7b6-5d375e21a03f service nova] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Received unexpected event network-vif-plugged-7c67dc1c-6443-4e87-b055-6103231fd3b0 for instance with vm_state building and task_state spawning.
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-af2f38ef-cec2-4491-b3b1-6c63fe46fe72 req-867b1efe-a413-4ff6-a7b6-5d375e21a03f service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Received event network-vif-unplugged-10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-af2f38ef-cec2-4491-b3b1-6c63fe46fe72 req-867b1efe-a413-4ff6-a7b6-5d375e21a03f service nova] Acquiring lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-af2f38ef-cec2-4491-b3b1-6c63fe46fe72 req-867b1efe-a413-4ff6-a7b6-5d375e21a03f service nova] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-af2f38ef-cec2-4491-b3b1-6c63fe46fe72 req-867b1efe-a413-4ff6-a7b6-5d375e21a03f service nova] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-af2f38ef-cec2-4491-b3b1-6c63fe46fe72 req-867b1efe-a413-4ff6-a7b6-5d375e21a03f service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] No waiting events found dispatching network-vif-unplugged-10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:28:51 user nova-compute[72150]: WARNING nova.compute.manager [req-af2f38ef-cec2-4491-b3b1-6c63fe46fe72 req-867b1efe-a413-4ff6-a7b6-5d375e21a03f service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Received unexpected event network-vif-unplugged-10176957-b4a6-4052-9a16-21152c8c3da5 for instance with vm_state deleted and task_state None.
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-af2f38ef-cec2-4491-b3b1-6c63fe46fe72 req-867b1efe-a413-4ff6-a7b6-5d375e21a03f service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Received event network-vif-plugged-10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-af2f38ef-cec2-4491-b3b1-6c63fe46fe72 req-867b1efe-a413-4ff6-a7b6-5d375e21a03f service nova] Acquiring lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-af2f38ef-cec2-4491-b3b1-6c63fe46fe72 req-867b1efe-a413-4ff6-a7b6-5d375e21a03f service nova] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-af2f38ef-cec2-4491-b3b1-6c63fe46fe72 req-867b1efe-a413-4ff6-a7b6-5d375e21a03f service nova] Lock "e298ac85-ebe3-4aa1-ae1e-91134e13e230-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-af2f38ef-cec2-4491-b3b1-6c63fe46fe72 req-867b1efe-a413-4ff6-a7b6-5d375e21a03f service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] No waiting events found dispatching network-vif-plugged-10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:28:51 user nova-compute[72150]: WARNING nova.compute.manager [req-af2f38ef-cec2-4491-b3b1-6c63fe46fe72 req-867b1efe-a413-4ff6-a7b6-5d375e21a03f service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Received unexpected event network-vif-plugged-10176957-b4a6-4052-9a16-21152c8c3da5 for instance with vm_state deleted and task_state None.
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-af2f38ef-cec2-4491-b3b1-6c63fe46fe72 req-867b1efe-a413-4ff6-a7b6-5d375e21a03f service nova] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Received event network-vif-deleted-10176957-b4a6-4052-9a16-21152c8c3da5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:28:51 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Instance spawned successfully.
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:28:51 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a50fb967-36ed-4266-bf10-66606dd64320] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:28:51 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914531.9383132, a50fb967-36ed-4266-bf10-66606dd64320 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:28:51 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a50fb967-36ed-4266-bf10-66606dd64320] VM Started (Lifecycle Event)
Aug 01 18:28:52 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:28:52 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:28:52 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a50fb967-36ed-4266-bf10-66606dd64320] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:28:52 user nova-compute[72150]: INFO nova.compute.manager [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Took 5.56 seconds to spawn the instance on the hypervisor.
Aug 01 18:28:52 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:28:52 user nova-compute[72150]: INFO nova.compute.manager [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Took 6.41 seconds to build instance.
Aug 01 18:28:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8f5f89dc-51af-400f-b470-845a89cf3e34 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "a50fb967-36ed-4266-bf10-66606dd64320" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.502s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "441a61de-ad9d-412d-95f3-882cef273e88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "441a61de-ad9d-412d-95f3-882cef273e88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:28:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:57 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:28:57 user nova-compute[72150]: INFO nova.compute.claims [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Claim successful on node user
Aug 01 18:28:57 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:28:57 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:28:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:28:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:28:57 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:28:57 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:28:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:28:57 user nova-compute[72150]: DEBUG nova.policy [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5804d69f9f18482f9fe0e0d4d73c4e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493923414b464384bb3a1ce3e6f7a2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:28:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:28:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:28:57 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Creating image(s)
Aug 01 18:28:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "/opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "/opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "/opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.155s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk 1073741824" returned: 0 in 0.049s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.141s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:58 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:28:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:28:58 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Successfully created port: 9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:28:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:28:58 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Cannot resize image /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:28:58 user nova-compute[72150]: DEBUG nova.objects.instance [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'migration_context' on Instance uuid 441a61de-ad9d-412d-95f3-882cef273e88 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:28:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:28:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Ensure instance console log exists: /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:28:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:28:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:28:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:28:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Successfully updated port: 9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "refresh_cache-441a61de-ad9d-412d-95f3-882cef273e88" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquired lock "refresh_cache-441a61de-ad9d-412d-95f3-882cef273e88" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-89cb4187-01a6-4c88-a278-afe5e8ff7757 req-888d8068-e967-446c-ae07-2ad3c37949bd service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Received event network-changed-9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-89cb4187-01a6-4c88-a278-afe5e8ff7757 req-888d8068-e967-446c-ae07-2ad3c37949bd service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Refreshing instance network info cache due to event network-changed-9c02fc93-434e-4e02-8855-14348e691115. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-89cb4187-01a6-4c88-a278-afe5e8ff7757 req-888d8068-e967-446c-ae07-2ad3c37949bd service nova] Acquiring lock "refresh_cache-441a61de-ad9d-412d-95f3-882cef273e88" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Updating instance_info_cache with network_info: [{"id": "9c02fc93-434e-4e02-8855-14348e691115", "address": "fa:16:3e:ba:5c:56", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c02fc93-43", "ovs_interfaceid": "9c02fc93-434e-4e02-8855-14348e691115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Releasing lock "refresh_cache-441a61de-ad9d-412d-95f3-882cef273e88" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Instance network_info: |[{"id": "9c02fc93-434e-4e02-8855-14348e691115", "address": "fa:16:3e:ba:5c:56", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c02fc93-43", "ovs_interfaceid": "9c02fc93-434e-4e02-8855-14348e691115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-89cb4187-01a6-4c88-a278-afe5e8ff7757 req-888d8068-e967-446c-ae07-2ad3c37949bd service nova] Acquired lock "refresh_cache-441a61de-ad9d-412d-95f3-882cef273e88" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.network.neutron [req-89cb4187-01a6-4c88-a278-afe5e8ff7757 req-888d8068-e967-446c-ae07-2ad3c37949bd service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Refreshing network info cache for port 9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Start _get_guest_xml network_info=[{"id": "9c02fc93-434e-4e02-8855-14348e691115", "address": "fa:16:3e:ba:5c:56", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c02fc93-43", "ovs_interfaceid": "9c02fc93-434e-4e02-8855-14348e691115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:28:59 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:28:59 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:28:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1473327332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1473327332',id=21,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWQMZQX2D/HQW8cg/YsV/NE/LRrdrO+ZwZNwgE1ATaVLlle4kzRuW5pJKzece0RgDQ87aRWUqjcNBY/DtyoPUj7uXTkdjNjIryRHAPyMBeR9HCitjxLaKFcLOHTGnSeiw==',key_name='tempest-keypair-1274630906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='493923414b464384bb3a1ce3e6f7a2f0',ramdisk_id='',reservation_id='r-hphvdvst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849821930',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849821930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:28:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5804d69f9f18482f9fe0e0d4d73c4e92',uuid=441a61de-ad9d-412d-95f3-882cef273e88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c02fc93-434e-4e02-8855-14348e691115", "address": "fa:16:3e:ba:5c:56", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c02fc93-43", "ovs_interfaceid": "9c02fc93-434e-4e02-8855-14348e691115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converting VIF {"id": "9c02fc93-434e-4e02-8855-14348e691115", "address": "fa:16:3e:ba:5c:56", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c02fc93-43", "ovs_interfaceid": "9c02fc93-434e-4e02-8855-14348e691115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:56,bridge_name='br-int',has_traffic_filtering=True,id=9c02fc93-434e-4e02-8855-14348e691115,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c02fc93-43') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.objects.instance [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'pci_devices' on Instance uuid 441a61de-ad9d-412d-95f3-882cef273e88 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:28:59 user nova-compute[72150]:   <uuid>441a61de-ad9d-412d-95f3-882cef273e88</uuid>
Aug 01 18:28:59 user nova-compute[72150]:   <name>instance-00000015</name>
Aug 01 18:28:59 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:28:59 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:28:59 user nova-compute[72150]:   <metadata>
Aug 01 18:28:59 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:28:59 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:28:59 user nova-compute[72150]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1473327332</nova:name>
Aug 01 18:28:59 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:28:59</nova:creationTime>
Aug 01 18:28:59 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:28:59 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:28:59 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:28:59 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:28:59 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:28:59 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:28:59 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:28:59 user nova-compute[72150]:       <nova:owner>
Aug 01 18:28:59 user nova-compute[72150]:         <nova:user uuid="5804d69f9f18482f9fe0e0d4d73c4e92">tempest-AttachVolumeShelveTestJSON-1849821930-project-member</nova:user>
Aug 01 18:28:59 user nova-compute[72150]:         <nova:project uuid="493923414b464384bb3a1ce3e6f7a2f0">tempest-AttachVolumeShelveTestJSON-1849821930</nova:project>
Aug 01 18:28:59 user nova-compute[72150]:       </nova:owner>
Aug 01 18:28:59 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:28:59 user nova-compute[72150]:       <nova:ports>
Aug 01 18:28:59 user nova-compute[72150]:         <nova:port uuid="9c02fc93-434e-4e02-8855-14348e691115">
Aug 01 18:28:59 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 18:28:59 user nova-compute[72150]:         </nova:port>
Aug 01 18:28:59 user nova-compute[72150]:       </nova:ports>
Aug 01 18:28:59 user nova-compute[72150]:     </nova:instance>
Aug 01 18:28:59 user nova-compute[72150]:   </metadata>
Aug 01 18:28:59 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:28:59 user nova-compute[72150]:     <system>
Aug 01 18:28:59 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:28:59 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:28:59 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:28:59 user nova-compute[72150]:       <entry name="serial">441a61de-ad9d-412d-95f3-882cef273e88</entry>
Aug 01 18:28:59 user nova-compute[72150]:       <entry name="uuid">441a61de-ad9d-412d-95f3-882cef273e88</entry>
Aug 01 18:28:59 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:28:59 user nova-compute[72150]:     </system>
Aug 01 18:28:59 user nova-compute[72150]:   </sysinfo>
Aug 01 18:28:59 user nova-compute[72150]:   <os>
Aug 01 18:28:59 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:28:59 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:28:59 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:28:59 user nova-compute[72150]:   </os>
Aug 01 18:28:59 user nova-compute[72150]:   <features>
Aug 01 18:28:59 user nova-compute[72150]:     <acpi/>
Aug 01 18:28:59 user nova-compute[72150]:     <apic/>
Aug 01 18:28:59 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:28:59 user nova-compute[72150]:   </features>
Aug 01 18:28:59 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:28:59 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:28:59 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:28:59 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:28:59 user nova-compute[72150]:   </clock>
Aug 01 18:28:59 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:28:59 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:28:59 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:28:59 user nova-compute[72150]:   </cpu>
Aug 01 18:28:59 user nova-compute[72150]:   <devices>
Aug 01 18:28:59 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:28:59 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:28:59 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk"/>
Aug 01 18:28:59 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:28:59 user nova-compute[72150]:     </disk>
Aug 01 18:28:59 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:28:59 user nova-compute[72150]:       <mac address="fa:16:3e:ba:5c:56"/>
Aug 01 18:28:59 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:28:59 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:28:59 user nova-compute[72150]:       <target dev="tap9c02fc93-43"/>
Aug 01 18:28:59 user nova-compute[72150]:     </interface>
Aug 01 18:28:59 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:28:59 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/console.log" append="off"/>
Aug 01 18:28:59 user nova-compute[72150]:     </serial>
Aug 01 18:28:59 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:28:59 user nova-compute[72150]:     <video>
Aug 01 18:28:59 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:28:59 user nova-compute[72150]:     </video>
Aug 01 18:28:59 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:28:59 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:28:59 user nova-compute[72150]:     </rng>
Aug 01 18:28:59 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:28:59 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:28:59 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:28:59 user nova-compute[72150]:     </memballoon>
Aug 01 18:28:59 user nova-compute[72150]:   </devices>
Aug 01 18:28:59 user nova-compute[72150]: </domain>
Aug 01 18:28:59 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:28:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1473327332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1473327332',id=21,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWQMZQX2D/HQW8cg/YsV/NE/LRrdrO+ZwZNwgE1ATaVLlle4kzRuW5pJKzece0RgDQ87aRWUqjcNBY/DtyoPUj7uXTkdjNjIryRHAPyMBeR9HCitjxLaKFcLOHTGnSeiw==',key_name='tempest-keypair-1274630906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='493923414b464384bb3a1ce3e6f7a2f0',ramdisk_id='',reservation_id='r-hphvdvst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849821930',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849821930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:28:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5804d69f9f18482f9fe0e0d4d73c4e92',uuid=441a61de-ad9d-412d-95f3-882cef273e88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c02fc93-434e-4e02-8855-14348e691115", "address": "fa:16:3e:ba:5c:56", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c02fc93-43", "ovs_interfaceid": "9c02fc93-434e-4e02-8855-14348e691115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converting VIF {"id": "9c02fc93-434e-4e02-8855-14348e691115", "address": "fa:16:3e:ba:5c:56", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c02fc93-43", "ovs_interfaceid": "9c02fc93-434e-4e02-8855-14348e691115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:56,bridge_name='br-int',has_traffic_filtering=True,id=9c02fc93-434e-4e02-8855-14348e691115,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c02fc93-43') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG os_vif [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:56,bridge_name='br-int',has_traffic_filtering=True,id=9c02fc93-434e-4e02-8855-14348e691115,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c02fc93-43') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c02fc93-43, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c02fc93-43, col_values=(('external_ids', {'iface-id': '9c02fc93-434e-4e02-8855-14348e691115', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:5c:56', 'vm-uuid': '441a61de-ad9d-412d-95f3-882cef273e88'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:28:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:28:59 user nova-compute[72150]: INFO os_vif [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:56,bridge_name='br-int',has_traffic_filtering=True,id=9c02fc93-434e-4e02-8855-14348e691115,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c02fc93-43')
Aug 01 18:29:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:29:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] No VIF found with MAC fa:16:3e:ba:5c:56, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:29:00 user nova-compute[72150]: DEBUG nova.network.neutron [req-89cb4187-01a6-4c88-a278-afe5e8ff7757 req-888d8068-e967-446c-ae07-2ad3c37949bd service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Updated VIF entry in instance network info cache for port 9c02fc93-434e-4e02-8855-14348e691115. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:29:00 user nova-compute[72150]: DEBUG nova.network.neutron [req-89cb4187-01a6-4c88-a278-afe5e8ff7757 req-888d8068-e967-446c-ae07-2ad3c37949bd service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Updating instance_info_cache with network_info: [{"id": "9c02fc93-434e-4e02-8855-14348e691115", "address": "fa:16:3e:ba:5c:56", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c02fc93-43", "ovs_interfaceid": "9c02fc93-434e-4e02-8855-14348e691115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:29:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-89cb4187-01a6-4c88-a278-afe5e8ff7757 req-888d8068-e967-446c-ae07-2ad3c37949bd service nova] Releasing lock "refresh_cache-441a61de-ad9d-412d-95f3-882cef273e88" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:29:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:01 user nova-compute[72150]: DEBUG nova.compute.manager [req-6c8778c8-6014-49fd-bd34-0a003a405e23 req-ae241f30-bde5-49db-8a10-efe93a9f95a9 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received event network-changed-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:29:01 user nova-compute[72150]: DEBUG nova.compute.manager [req-6c8778c8-6014-49fd-bd34-0a003a405e23 req-ae241f30-bde5-49db-8a10-efe93a9f95a9 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Refreshing instance network info cache due to event network-changed-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:29:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6c8778c8-6014-49fd-bd34-0a003a405e23 req-ae241f30-bde5-49db-8a10-efe93a9f95a9 service nova] Acquiring lock "refresh_cache-a5f0eca7-d060-4226-b36e-a3cd15b15703" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:29:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6c8778c8-6014-49fd-bd34-0a003a405e23 req-ae241f30-bde5-49db-8a10-efe93a9f95a9 service nova] Acquired lock "refresh_cache-a5f0eca7-d060-4226-b36e-a3cd15b15703" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:29:01 user nova-compute[72150]: DEBUG nova.network.neutron [req-6c8778c8-6014-49fd-bd34-0a003a405e23 req-ae241f30-bde5-49db-8a10-efe93a9f95a9 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Refreshing network info cache for port e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:29:01 user nova-compute[72150]: DEBUG nova.compute.manager [req-19ef050b-d5c7-40bb-b19c-83b70b25de9d req-fb197b22-23cc-44f6-acd4-618273419a29 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Received event network-vif-plugged-9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:29:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-19ef050b-d5c7-40bb-b19c-83b70b25de9d req-fb197b22-23cc-44f6-acd4-618273419a29 service nova] Acquiring lock "441a61de-ad9d-412d-95f3-882cef273e88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-19ef050b-d5c7-40bb-b19c-83b70b25de9d req-fb197b22-23cc-44f6-acd4-618273419a29 service nova] Lock "441a61de-ad9d-412d-95f3-882cef273e88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-19ef050b-d5c7-40bb-b19c-83b70b25de9d req-fb197b22-23cc-44f6-acd4-618273419a29 service nova] Lock "441a61de-ad9d-412d-95f3-882cef273e88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:01 user nova-compute[72150]: DEBUG nova.compute.manager [req-19ef050b-d5c7-40bb-b19c-83b70b25de9d req-fb197b22-23cc-44f6-acd4-618273419a29 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] No waiting events found dispatching network-vif-plugged-9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:29:01 user nova-compute[72150]: WARNING nova.compute.manager [req-19ef050b-d5c7-40bb-b19c-83b70b25de9d req-fb197b22-23cc-44f6-acd4-618273419a29 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Received unexpected event network-vif-plugged-9c02fc93-434e-4e02-8855-14348e691115 for instance with vm_state building and task_state spawning.
Aug 01 18:29:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:02 user nova-compute[72150]: DEBUG nova.network.neutron [req-6c8778c8-6014-49fd-bd34-0a003a405e23 req-ae241f30-bde5-49db-8a10-efe93a9f95a9 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Updated VIF entry in instance network info cache for port e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:29:02 user nova-compute[72150]: DEBUG nova.network.neutron [req-6c8778c8-6014-49fd-bd34-0a003a405e23 req-ae241f30-bde5-49db-8a10-efe93a9f95a9 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Updating instance_info_cache with network_info: [{"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:29:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6c8778c8-6014-49fd-bd34-0a003a405e23 req-ae241f30-bde5-49db-8a10-efe93a9f95a9 service nova] Releasing lock "refresh_cache-a5f0eca7-d060-4226-b36e-a3cd15b15703" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:29:03 user nova-compute[72150]: DEBUG nova.compute.manager [req-07afce0a-0f4a-4322-84a1-bd62fd6ccf40 req-b66d376c-89d7-4f7d-8acb-32b121bb5d83 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Received event network-vif-plugged-9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:29:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-07afce0a-0f4a-4322-84a1-bd62fd6ccf40 req-b66d376c-89d7-4f7d-8acb-32b121bb5d83 service nova] Acquiring lock "441a61de-ad9d-412d-95f3-882cef273e88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-07afce0a-0f4a-4322-84a1-bd62fd6ccf40 req-b66d376c-89d7-4f7d-8acb-32b121bb5d83 service nova] Lock "441a61de-ad9d-412d-95f3-882cef273e88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-07afce0a-0f4a-4322-84a1-bd62fd6ccf40 req-b66d376c-89d7-4f7d-8acb-32b121bb5d83 service nova] Lock "441a61de-ad9d-412d-95f3-882cef273e88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:03 user nova-compute[72150]: DEBUG nova.compute.manager [req-07afce0a-0f4a-4322-84a1-bd62fd6ccf40 req-b66d376c-89d7-4f7d-8acb-32b121bb5d83 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] No waiting events found dispatching network-vif-plugged-9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:29:03 user nova-compute[72150]: WARNING nova.compute.manager [req-07afce0a-0f4a-4322-84a1-bd62fd6ccf40 req-b66d376c-89d7-4f7d-8acb-32b121bb5d83 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Received unexpected event network-vif-plugged-9c02fc93-434e-4e02-8855-14348e691115 for instance with vm_state building and task_state spawning.
Aug 01 18:29:03 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914543.7830698, 441a61de-ad9d-412d-95f3-882cef273e88 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:29:03 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] VM Resumed (Lifecycle Event)
Aug 01 18:29:03 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:29:03 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:29:03 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Instance spawned successfully.
Aug 01 18:29:03 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:29:03 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:29:03 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:29:03 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:03 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:03 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:03 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:03 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:03 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:03 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:29:03 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914543.7844512, 441a61de-ad9d-412d-95f3-882cef273e88 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:29:03 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] VM Started (Lifecycle Event)
Aug 01 18:29:03 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:29:03 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:29:03 user nova-compute[72150]: INFO nova.compute.manager [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Took 6.10 seconds to spawn the instance on the hypervisor.
Aug 01 18:29:03 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:29:03 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:29:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:04 user nova-compute[72150]: INFO nova.compute.manager [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Took 6.77 seconds to build instance.
Aug 01 18:29:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee8e467a-cb68-42f9-b1a5-8bb447010aff tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "441a61de-ad9d-412d-95f3-882cef273e88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.879s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:05 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914530.5998235, e298ac85-ebe3-4aa1-ae1e-91134e13e230 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:29:05 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] VM Stopped (Lifecycle Event)
Aug 01 18:29:05 user nova-compute[72150]: DEBUG nova.compute.manager [None req-87a0246d-c9fa-4535-ae08-b0b82d6a42e7 None None] [instance: e298ac85-ebe3-4aa1-ae1e-91134e13e230] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:29:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:21 user nova-compute[72150]: DEBUG nova.compute.manager [req-0d774be1-7d5b-4be4-bea7-f43fb93cadda req-7e9aac26-9904-4e38-848e-bff96cb6cf03 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received event network-changed-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:29:21 user nova-compute[72150]: DEBUG nova.compute.manager [req-0d774be1-7d5b-4be4-bea7-f43fb93cadda req-7e9aac26-9904-4e38-848e-bff96cb6cf03 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Refreshing instance network info cache due to event network-changed-ee07a0f4-222d-4863-92b2-f70a7afd75f1. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:29:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0d774be1-7d5b-4be4-bea7-f43fb93cadda req-7e9aac26-9904-4e38-848e-bff96cb6cf03 service nova] Acquiring lock "refresh_cache-ceee3912-ca68-4b15-8fe6-985d905e8128" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:29:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0d774be1-7d5b-4be4-bea7-f43fb93cadda req-7e9aac26-9904-4e38-848e-bff96cb6cf03 service nova] Acquired lock "refresh_cache-ceee3912-ca68-4b15-8fe6-985d905e8128" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:29:21 user nova-compute[72150]: DEBUG nova.network.neutron [req-0d774be1-7d5b-4be4-bea7-f43fb93cadda req-7e9aac26-9904-4e38-848e-bff96cb6cf03 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Refreshing network info cache for port ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:29:22 user nova-compute[72150]: DEBUG nova.network.neutron [req-0d774be1-7d5b-4be4-bea7-f43fb93cadda req-7e9aac26-9904-4e38-848e-bff96cb6cf03 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Updated VIF entry in instance network info cache for port ee07a0f4-222d-4863-92b2-f70a7afd75f1. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:29:22 user nova-compute[72150]: DEBUG nova.network.neutron [req-0d774be1-7d5b-4be4-bea7-f43fb93cadda req-7e9aac26-9904-4e38-848e-bff96cb6cf03 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Updating instance_info_cache with network_info: [{"id": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "address": "fa:16:3e:e0:04:f1", "network": {"id": "838d4cba-b00d-46ff-ad55-9d7dd511581a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-732384801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8759cb04dd744d7895a63bc5bd1d1c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee07a0f4-22", "ovs_interfaceid": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:29:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0d774be1-7d5b-4be4-bea7-f43fb93cadda req-7e9aac26-9904-4e38-848e-bff96cb6cf03 service nova] Releasing lock "refresh_cache-ceee3912-ca68-4b15-8fe6-985d905e8128" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:29:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:23 user nova-compute[72150]: DEBUG nova.compute.manager [None req-0d824f4b-5998-44c0-a5ac-1c190eff8c31 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:29:23 user nova-compute[72150]: INFO nova.compute.manager [None req-0d824f4b-5998-44c0-a5ac-1c190eff8c31 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] instance snapshotting
Aug 01 18:29:23 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-0d824f4b-5998-44c0-a5ac-1c190eff8c31 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Beginning live snapshot process
Aug 01 18:29:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0d824f4b-5998-44c0-a5ac-1c190eff8c31 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json -f qcow2 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0d824f4b-5998-44c0-a5ac-1c190eff8c31 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json -f qcow2" returned: 0 in 0.142s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0d824f4b-5998-44c0-a5ac-1c190eff8c31 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json -f qcow2 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0d824f4b-5998-44c0-a5ac-1c190eff8c31 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json -f qcow2" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0d824f4b-5998-44c0-a5ac-1c190eff8c31 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0d824f4b-5998-44c0-a5ac-1c190eff8c31 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0d824f4b-5998-44c0-a5ac-1c190eff8c31 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpe7pmewl6/f74481736c6a4e2d90709880aef9d476.delta 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0d824f4b-5998-44c0-a5ac-1c190eff8c31 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpe7pmewl6/f74481736c6a4e2d90709880aef9d476.delta 1073741824" returned: 0 in 0.068s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:23 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-0d824f4b-5998-44c0-a5ac-1c190eff8c31 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 18:29:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-0d824f4b-5998-44c0-a5ac-1c190eff8c31 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:29:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-0d824f4b-5998-44c0-a5ac-1c190eff8c31 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:29:25 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-0d824f4b-5998-44c0-a5ac-1c190eff8c31 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 18:29:25 user nova-compute[72150]: DEBUG nova.privsep.utils [None req-0d824f4b-5998-44c0-a5ac-1c190eff8c31 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72150) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 18:29:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0d824f4b-5998-44c0-a5ac-1c190eff8c31 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpe7pmewl6/f74481736c6a4e2d90709880aef9d476.delta /opt/stack/data/nova/instances/snapshots/tmpe7pmewl6/f74481736c6a4e2d90709880aef9d476 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0d824f4b-5998-44c0-a5ac-1c190eff8c31 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpe7pmewl6/f74481736c6a4e2d90709880aef9d476.delta /opt/stack/data/nova/instances/snapshots/tmpe7pmewl6/f74481736c6a4e2d90709880aef9d476" returned: 0 in 0.406s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:25 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-0d824f4b-5998-44c0-a5ac-1c190eff8c31 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Snapshot extracted, beginning image upload
Aug 01 18:29:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "42e75a98-beb1-4688-a375-affc63b14252" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "42e75a98-beb1-4688-a375-affc63b14252" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:26 user nova-compute[72150]: DEBUG nova.compute.manager [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:29:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:26 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:29:26 user nova-compute[72150]: INFO nova.compute.claims [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Claim successful on node user
Aug 01 18:29:26 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:29:26 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:29:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "1de0ad54-0d7a-4287-9532-7b4982b1e2bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "1de0ad54-0d7a-4287-9532-7b4982b1e2bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:26 user nova-compute[72150]: DEBUG nova.compute.manager [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:29:26 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:29:27 user nova-compute[72150]: DEBUG nova.compute.manager [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:29:27 user nova-compute[72150]: DEBUG nova.network.neutron [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:29:27 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:29:27 user nova-compute[72150]: DEBUG nova.compute.manager [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:29:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:27 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:29:27 user nova-compute[72150]: INFO nova.compute.claims [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Claim successful on node user
Aug 01 18:29:27 user nova-compute[72150]: INFO nova.virt.block_device [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Booting with blank volume at /dev/vda
Aug 01 18:29:27 user nova-compute[72150]: DEBUG nova.policy [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc00b9006f5842c6b875c5d25538b718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad8ef64d051424e9fe644a1fb40fcb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:29:27 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:29:27 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:29:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:27 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:29:27 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:29:27 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:29:27 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:29:27 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:29:27 user nova-compute[72150]: INFO nova.virt.block_device [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Booting with volume 52afa80c-1b78-452e-bfe6-468e631bd264 at /dev/vda
Aug 01 18:29:27 user nova-compute[72150]: DEBUG nova.policy [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92c7ef0ed6814f8880de76adb913a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ca44f23b114893afcfe57c52f693b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:29:27 user nova-compute[72150]: DEBUG os_brick.utils [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:29:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:27 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecb5fdf-c698-49a6-9222-a04c42d5ff15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:27 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3793f267-5889-4b2d-ab3e-9f1daef7d54a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcd7dcb-de89-4b59-a285-5928b512e3f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[803c8481-1c0b-43e2-a705-6bca9e510dae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:29:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:29:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:29:28 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:29:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[626db41d-6ab6-42d7-a7fc-21b0bd9188d5]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:29:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:29:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:29:28 user nova-compute[72150]: DEBUG os_brick.utils [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:29:28 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Updating existing volume attachment record: 9ae01277-6ad7-4e70-b6e5-482d1b88b00d {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:29:28 user nova-compute[72150]: DEBUG nova.network.neutron [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Successfully created port: 10529340-a252-4604-accb-19f26670f125 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:29:28 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-0d824f4b-5998-44c0-a5ac-1c190eff8c31 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Snapshot image upload complete
Aug 01 18:29:28 user nova-compute[72150]: INFO nova.compute.manager [None req-0d824f4b-5998-44c0-a5ac-1c190eff8c31 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Took 5.44 seconds to snapshot the instance on the hypervisor.
Aug 01 18:29:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:28 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Successfully created port: 47fc57e5-3a55-4719-944f-5d65f5fbcce4 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:29:29 user nova-compute[72150]: DEBUG nova.network.neutron [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Successfully updated port: 10529340-a252-4604-accb-19f26670f125 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:29:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "refresh_cache-42e75a98-beb1-4688-a375-affc63b14252" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:29:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquired lock "refresh_cache-42e75a98-beb1-4688-a375-affc63b14252" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:29:29 user nova-compute[72150]: DEBUG nova.network.neutron [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:29:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-cfa85fbf-a380-4bef-87be-cc4a554a3ce4 req-b83e869c-faa5-448e-a213-8346d01cfef0 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received event network-changed-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:29:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-cfa85fbf-a380-4bef-87be-cc4a554a3ce4 req-b83e869c-faa5-448e-a213-8346d01cfef0 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Refreshing instance network info cache due to event network-changed-10529340-a252-4604-accb-19f26670f125. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:29:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-cfa85fbf-a380-4bef-87be-cc4a554a3ce4 req-b83e869c-faa5-448e-a213-8346d01cfef0 service nova] Acquiring lock "refresh_cache-42e75a98-beb1-4688-a375-affc63b14252" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:29:29 user nova-compute[72150]: DEBUG nova.network.neutron [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:29:29 user nova-compute[72150]: DEBUG nova.network.neutron [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Updating instance_info_cache with network_info: [{"id": "10529340-a252-4604-accb-19f26670f125", "address": "fa:16:3e:56:f4:53", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10529340-a2", "ovs_interfaceid": "10529340-a252-4604-accb-19f26670f125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:29:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Releasing lock "refresh_cache-42e75a98-beb1-4688-a375-affc63b14252" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:29:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Instance network_info: |[{"id": "10529340-a252-4604-accb-19f26670f125", "address": "fa:16:3e:56:f4:53", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10529340-a2", "ovs_interfaceid": "10529340-a252-4604-accb-19f26670f125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:29:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-cfa85fbf-a380-4bef-87be-cc4a554a3ce4 req-b83e869c-faa5-448e-a213-8346d01cfef0 service nova] Acquired lock "refresh_cache-42e75a98-beb1-4688-a375-affc63b14252" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:29:29 user nova-compute[72150]: DEBUG nova.network.neutron [req-cfa85fbf-a380-4bef-87be-cc4a554a3ce4 req-b83e869c-faa5-448e-a213-8346d01cfef0 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Refreshing network info cache for port 10529340-a252-4604-accb-19f26670f125 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:29:29 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Successfully updated port: 47fc57e5-3a55-4719-944f-5d65f5fbcce4 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:29:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "refresh_cache-1de0ad54-0d7a-4287-9532-7b4982b1e2bf" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:29:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquired lock "refresh_cache-1de0ad54-0d7a-4287-9532-7b4982b1e2bf" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:29:29 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:29:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-3361c9ef-1e17-4103-bd56-176b2fe38e4d req-c61e5e1e-91d7-483e-bd3d-b2162d21a4ae service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Received event network-changed-47fc57e5-3a55-4719-944f-5d65f5fbcce4 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:29:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-3361c9ef-1e17-4103-bd56-176b2fe38e4d req-c61e5e1e-91d7-483e-bd3d-b2162d21a4ae service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Refreshing instance network info cache due to event network-changed-47fc57e5-3a55-4719-944f-5d65f5fbcce4. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:29:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3361c9ef-1e17-4103-bd56-176b2fe38e4d req-c61e5e1e-91d7-483e-bd3d-b2162d21a4ae service nova] Acquiring lock "refresh_cache-1de0ad54-0d7a-4287-9532-7b4982b1e2bf" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:29:29 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:29:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:30 user nova-compute[72150]: DEBUG nova.network.neutron [req-cfa85fbf-a380-4bef-87be-cc4a554a3ce4 req-b83e869c-faa5-448e-a213-8346d01cfef0 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Updated VIF entry in instance network info cache for port 10529340-a252-4604-accb-19f26670f125. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:29:30 user nova-compute[72150]: DEBUG nova.network.neutron [req-cfa85fbf-a380-4bef-87be-cc4a554a3ce4 req-b83e869c-faa5-448e-a213-8346d01cfef0 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Updating instance_info_cache with network_info: [{"id": "10529340-a252-4604-accb-19f26670f125", "address": "fa:16:3e:56:f4:53", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10529340-a2", "ovs_interfaceid": "10529340-a252-4604-accb-19f26670f125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:29:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-cfa85fbf-a380-4bef-87be-cc4a554a3ce4 req-b83e869c-faa5-448e-a213-8346d01cfef0 service nova] Releasing lock "refresh_cache-42e75a98-beb1-4688-a375-affc63b14252" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:29:30 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Updating instance_info_cache with network_info: [{"id": "47fc57e5-3a55-4719-944f-5d65f5fbcce4", "address": "fa:16:3e:20:25:3c", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc57e5-3a", "ovs_interfaceid": "47fc57e5-3a55-4719-944f-5d65f5fbcce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:29:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Releasing lock "refresh_cache-1de0ad54-0d7a-4287-9532-7b4982b1e2bf" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:29:30 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Instance network_info: |[{"id": "47fc57e5-3a55-4719-944f-5d65f5fbcce4", "address": "fa:16:3e:20:25:3c", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc57e5-3a", "ovs_interfaceid": "47fc57e5-3a55-4719-944f-5d65f5fbcce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:29:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3361c9ef-1e17-4103-bd56-176b2fe38e4d req-c61e5e1e-91d7-483e-bd3d-b2162d21a4ae service nova] Acquired lock "refresh_cache-1de0ad54-0d7a-4287-9532-7b4982b1e2bf" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:29:30 user nova-compute[72150]: DEBUG nova.network.neutron [req-3361c9ef-1e17-4103-bd56-176b2fe38e4d req-c61e5e1e-91d7-483e-bd3d-b2162d21a4ae service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Refreshing network info cache for port 47fc57e5-3a55-4719-944f-5d65f5fbcce4 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:29:30 user nova-compute[72150]: DEBUG nova.network.neutron [req-3361c9ef-1e17-4103-bd56-176b2fe38e4d req-c61e5e1e-91d7-483e-bd3d-b2162d21a4ae service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Updated VIF entry in instance network info cache for port 47fc57e5-3a55-4719-944f-5d65f5fbcce4. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:29:30 user nova-compute[72150]: DEBUG nova.network.neutron [req-3361c9ef-1e17-4103-bd56-176b2fe38e4d req-c61e5e1e-91d7-483e-bd3d-b2162d21a4ae service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Updating instance_info_cache with network_info: [{"id": "47fc57e5-3a55-4719-944f-5d65f5fbcce4", "address": "fa:16:3e:20:25:3c", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc57e5-3a", "ovs_interfaceid": "47fc57e5-3a55-4719-944f-5d65f5fbcce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:29:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3361c9ef-1e17-4103-bd56-176b2fe38e4d req-c61e5e1e-91d7-483e-bd3d-b2162d21a4ae service nova] Releasing lock "refresh_cache-1de0ad54-0d7a-4287-9532-7b4982b1e2bf" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:29:30 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:29:31 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:29:31 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:29:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:31 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:29:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG os_brick.utils [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7b2b01-2fe9-4b3a-a7a5-60755f5a93e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c96db74-0d1c-45c5-85e6-04d8ca37135e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[07089764-299c-43e2-9820-27c002be9128]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[930f4fb6-1362-4dac-ab9e-e252a9d67c2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:29:33 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b069de-cff7-458e-9f57-4be9a0e8e33a]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG os_brick.utils [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Updating existing volume attachment record: de63a39b-3bb0-44ec-83b3-12638129e9c9 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a50fb967-36ed-4266-bf10-66606dd64320/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a50fb967-36ed-4266-bf10-66606dd64320/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a50fb967-36ed-4266-bf10-66606dd64320/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a50fb967-36ed-4266-bf10-66606dd64320/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:35 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:29:35 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:29:35 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=7382MB free_disk=25.522701263427734GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:29:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:35 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 769690c8-53c5-4057-88a5-fbdbcb930e32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:29:35 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ea68420b-8362-4df3-b710-cd1cf76adba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:29:35 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance bcbfca8c-8bdb-47d2-addc-e1cec3166dc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:29:35 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 08851ec4-6f71-4ec1-a092-42aab83ee87f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:29:35 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance bf2d1f14-2227-41d1-bd73-a05ab3149aba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:29:35 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance a5f0eca7-d060-4226-b36e-a3cd15b15703 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:29:35 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ceee3912-ca68-4b15-8fe6-985d905e8128 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:29:35 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance a50fb967-36ed-4266-bf10-66606dd64320 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:29:35 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 441a61de-ad9d-412d-95f3-882cef273e88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:29:35 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 42e75a98-beb1-4688-a375-affc63b14252 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:29:35 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 1de0ad54-0d7a-4287-9532-7b4982b1e2bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:29:35 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:29:35 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:29:36 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Creating image(s)
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Did not create local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Ensure instance console log exists: /opt/stack/data/nova/instances/1de0ad54-0d7a-4287-9532-7b4982b1e2bf/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Start _get_guest_xml network_info=[{"id": "47fc57e5-3a55-4719-944f-5d65f5fbcce4", "address": "fa:16:3e:20:25:3c", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc57e5-3a", "ovs_interfaceid": "47fc57e5-3a55-4719-944f-5d65f5fbcce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9ae01277-6ad7-4e70-b6e5-482d1b88b00d', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mxcIukbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1de0ad54-0d7a-4287-9532-7b4982b1e2bf', 'attached_at': '', 'detached_at': '', 'volume_id': '52afa80c-1b78-452e-bfe6-468e631bd264', 'serial': '52afa80c-1b78-452e-bfe6-468e631bd264'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:29:36 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:29:36 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.578s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mxcIukbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:29:36 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:29:36 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:29:36 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecd3ea1-c1ea-4fbc-ab1a-390215b99b42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:29:36 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b26b9d-0fe4-4c22-87b1-ab9a72c60115]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264] added
Aug 01 18:29:36 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4619b5a-0278-4bbe-ada3-89e7983d2387]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[27889cc8-3501-4400-9f31-72d1e3230b7e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mxcIukbS {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mxcIukbS" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f54d2d-d6a2-4c7e-b4f6-1538f63dc494]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mxcIukbS'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50d6c75-96fa-4da6-8f15-76e6ac3310dc]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ffc602-ded0-47f8-9058-6d0b9fa84736]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 18:29:36 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 18:29:36 user nova-compute[72150]:  {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:29:36 user nova-compute[72150]: WARNING os_brick.initiator.connectors.iscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 18:29:36 user nova-compute[72150]: 
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6286d657-e798-498c-9739-781757181cc9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264, portal: 172.16.0.220,3260]
Aug 01 18:29:36 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264, portal: 172.16.0.220,3260] successful.
Aug 01 18:29:36 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2b788d-3e8c-4cc7-9948-ffeb2babae4f]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3fecab-106d-4721-853d-f3a0c726e0f7]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:29:36 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:29:36 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a323bb-0216-4d19-9e6c-7cc12be9f2c5]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:29:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mxcIukbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23234343432353365', 'path': '/dev/sdb'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234343432353365', 'path': '/dev/sdb'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:29:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-829016891',display_name='tempest-TestVolumeBootPattern-volume-backed-server-829016891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-829016891',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/Zr+Ocb8YCIrHaOzeaW66DJo7yyFAwj0m/obLW8/159dcQuEf2CVcL9NGhxgsjAPlmry/M82McWmgRoQ0Wy+HOFrOm4/xvY1j1BH4/W/pWbJB/Sfdzb2kQLiBMCkYKfA==',key_name='tempest-keypair-721385634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7ca44f23b114893afcfe57c52f693b1',ramdisk_id='',reservation_id='r-99c7dn9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-295340968',owner_user_name='tempest-TestVolumeBootPattern-295340968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:29:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92c7ef0ed6814f8880de76adb913a487',uuid=1de0ad54-0d7a-4287-9532-7b4982b1e2bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47fc57e5-3a55-4719-944f-5d65f5fbcce4", "address": "fa:16:3e:20:25:3c", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc57e5-3a", "ovs_interfaceid": "47fc57e5-3a55-4719-944f-5d65f5fbcce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converting VIF {"id": "47fc57e5-3a55-4719-944f-5d65f5fbcce4", "address": "fa:16:3e:20:25:3c", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc57e5-3a", "ovs_interfaceid": "47fc57e5-3a55-4719-944f-5d65f5fbcce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:25:3c,bridge_name='br-int',has_traffic_filtering=True,id=47fc57e5-3a55-4719-944f-5d65f5fbcce4,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47fc57e5-3a') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG nova.objects.instance [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lazy-loading 'pci_devices' on Instance uuid 1de0ad54-0d7a-4287-9532-7b4982b1e2bf {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:29:37 user nova-compute[72150]:   <uuid>1de0ad54-0d7a-4287-9532-7b4982b1e2bf</uuid>
Aug 01 18:29:37 user nova-compute[72150]:   <name>instance-00000017</name>
Aug 01 18:29:37 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:29:37 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:29:37 user nova-compute[72150]:   <metadata>
Aug 01 18:29:37 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:29:37 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:29:37 user nova-compute[72150]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-829016891</nova:name>
Aug 01 18:29:37 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:29:36</nova:creationTime>
Aug 01 18:29:37 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:29:37 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:29:37 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:29:37 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:29:37 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:29:37 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:29:37 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:29:37 user nova-compute[72150]:       <nova:owner>
Aug 01 18:29:37 user nova-compute[72150]:         <nova:user uuid="92c7ef0ed6814f8880de76adb913a487">tempest-TestVolumeBootPattern-295340968-project-member</nova:user>
Aug 01 18:29:37 user nova-compute[72150]:         <nova:project uuid="e7ca44f23b114893afcfe57c52f693b1">tempest-TestVolumeBootPattern-295340968</nova:project>
Aug 01 18:29:37 user nova-compute[72150]:       </nova:owner>
Aug 01 18:29:37 user nova-compute[72150]:       <nova:ports>
Aug 01 18:29:37 user nova-compute[72150]:         <nova:port uuid="47fc57e5-3a55-4719-944f-5d65f5fbcce4">
Aug 01 18:29:37 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 18:29:37 user nova-compute[72150]:         </nova:port>
Aug 01 18:29:37 user nova-compute[72150]:       </nova:ports>
Aug 01 18:29:37 user nova-compute[72150]:     </nova:instance>
Aug 01 18:29:37 user nova-compute[72150]:   </metadata>
Aug 01 18:29:37 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:29:37 user nova-compute[72150]:     <system>
Aug 01 18:29:37 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:29:37 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:29:37 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:29:37 user nova-compute[72150]:       <entry name="serial">1de0ad54-0d7a-4287-9532-7b4982b1e2bf</entry>
Aug 01 18:29:37 user nova-compute[72150]:       <entry name="uuid">1de0ad54-0d7a-4287-9532-7b4982b1e2bf</entry>
Aug 01 18:29:37 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:29:37 user nova-compute[72150]:     </system>
Aug 01 18:29:37 user nova-compute[72150]:   </sysinfo>
Aug 01 18:29:37 user nova-compute[72150]:   <os>
Aug 01 18:29:37 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:29:37 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:29:37 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:29:37 user nova-compute[72150]:   </os>
Aug 01 18:29:37 user nova-compute[72150]:   <features>
Aug 01 18:29:37 user nova-compute[72150]:     <acpi/>
Aug 01 18:29:37 user nova-compute[72150]:     <apic/>
Aug 01 18:29:37 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:29:37 user nova-compute[72150]:   </features>
Aug 01 18:29:37 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:29:37 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:29:37 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:29:37 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:29:37 user nova-compute[72150]:   </clock>
Aug 01 18:29:37 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:29:37 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:29:37 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:29:37 user nova-compute[72150]:   </cpu>
Aug 01 18:29:37 user nova-compute[72150]:   <devices>
Aug 01 18:29:37 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:29:37 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:29:37 user nova-compute[72150]:       <source dev="/dev/sdb"/>
Aug 01 18:29:37 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:29:37 user nova-compute[72150]:       <serial>52afa80c-1b78-452e-bfe6-468e631bd264</serial>
Aug 01 18:29:37 user nova-compute[72150]:     </disk>
Aug 01 18:29:37 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:29:37 user nova-compute[72150]:       <mac address="fa:16:3e:20:25:3c"/>
Aug 01 18:29:37 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:29:37 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:29:37 user nova-compute[72150]:       <target dev="tap47fc57e5-3a"/>
Aug 01 18:29:37 user nova-compute[72150]:     </interface>
Aug 01 18:29:37 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:29:37 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/1de0ad54-0d7a-4287-9532-7b4982b1e2bf/console.log" append="off"/>
Aug 01 18:29:37 user nova-compute[72150]:     </serial>
Aug 01 18:29:37 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:29:37 user nova-compute[72150]:     <video>
Aug 01 18:29:37 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:29:37 user nova-compute[72150]:     </video>
Aug 01 18:29:37 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:29:37 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:29:37 user nova-compute[72150]:     </rng>
Aug 01 18:29:37 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:29:37 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:29:37 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:29:37 user nova-compute[72150]:     </memballoon>
Aug 01 18:29:37 user nova-compute[72150]:   </devices>
Aug 01 18:29:37 user nova-compute[72150]: </domain>
Aug 01 18:29:37 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:29:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-829016891',display_name='tempest-TestVolumeBootPattern-volume-backed-server-829016891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-829016891',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/Zr+Ocb8YCIrHaOzeaW66DJo7yyFAwj0m/obLW8/159dcQuEf2CVcL9NGhxgsjAPlmry/M82McWmgRoQ0Wy+HOFrOm4/xvY1j1BH4/W/pWbJB/Sfdzb2kQLiBMCkYKfA==',key_name='tempest-keypair-721385634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7ca44f23b114893afcfe57c52f693b1',ramdisk_id='',reservation_id='r-99c7dn9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-295340968',owner_user_name='tempest-TestVolumeBootPattern-295340968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:29:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92c7ef0ed6814f8880de76adb913a487',uuid=1de0ad54-0d7a-4287-9532-7b4982b1e2bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47fc57e5-3a55-4719-944f-5d65f5fbcce4", "address": "fa:16:3e:20:25:3c", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc57e5-3a", "ovs_interfaceid": "47fc57e5-3a55-4719-944f-5d65f5fbcce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converting VIF {"id": "47fc57e5-3a55-4719-944f-5d65f5fbcce4", "address": "fa:16:3e:20:25:3c", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc57e5-3a", "ovs_interfaceid": "47fc57e5-3a55-4719-944f-5d65f5fbcce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:25:3c,bridge_name='br-int',has_traffic_filtering=True,id=47fc57e5-3a55-4719-944f-5d65f5fbcce4,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47fc57e5-3a') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG os_vif [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:25:3c,bridge_name='br-int',has_traffic_filtering=True,id=47fc57e5-3a55-4719-944f-5d65f5fbcce4,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47fc57e5-3a') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47fc57e5-3a, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap47fc57e5-3a, col_values=(('external_ids', {'iface-id': '47fc57e5-3a55-4719-944f-5d65f5fbcce4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:25:3c', 'vm-uuid': '1de0ad54-0d7a-4287-9532-7b4982b1e2bf'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:37 user nova-compute[72150]: INFO os_vif [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:25:3c,bridge_name='br-int',has_traffic_filtering=True,id=47fc57e5-3a55-4719-944f-5d65f5fbcce4,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47fc57e5-3a')
Aug 01 18:29:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] No VIF found with MAC fa:16:3e:20:25:3c, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-ea68420b-8362-4df3-b710-cd1cf76adba0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-ea68420b-8362-4df3-b710-cd1cf76adba0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:29:37 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:29:38 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Updating instance_info_cache with network_info: [{"id": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "address": "fa:16:3e:a6:bd:40", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a63bb1a-08", "ovs_interfaceid": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:29:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-ea68420b-8362-4df3-b710-cd1cf76adba0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:29:38 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:29:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:39 user nova-compute[72150]: DEBUG nova.compute.manager [req-2f37b8b6-25ef-4c1f-b7d1-8b882380a16f req-4c6e113e-b8b8-469f-9ed1-8217220ec629 service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Received event network-vif-plugged-47fc57e5-3a55-4719-944f-5d65f5fbcce4 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:29:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2f37b8b6-25ef-4c1f-b7d1-8b882380a16f req-4c6e113e-b8b8-469f-9ed1-8217220ec629 service nova] Acquiring lock "1de0ad54-0d7a-4287-9532-7b4982b1e2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2f37b8b6-25ef-4c1f-b7d1-8b882380a16f req-4c6e113e-b8b8-469f-9ed1-8217220ec629 service nova] Lock "1de0ad54-0d7a-4287-9532-7b4982b1e2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2f37b8b6-25ef-4c1f-b7d1-8b882380a16f req-4c6e113e-b8b8-469f-9ed1-8217220ec629 service nova] Lock "1de0ad54-0d7a-4287-9532-7b4982b1e2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:39 user nova-compute[72150]: DEBUG nova.compute.manager [req-2f37b8b6-25ef-4c1f-b7d1-8b882380a16f req-4c6e113e-b8b8-469f-9ed1-8217220ec629 service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] No waiting events found dispatching network-vif-plugged-47fc57e5-3a55-4719-944f-5d65f5fbcce4 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:29:39 user nova-compute[72150]: WARNING nova.compute.manager [req-2f37b8b6-25ef-4c1f-b7d1-8b882380a16f req-4c6e113e-b8b8-469f-9ed1-8217220ec629 service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Received unexpected event network-vif-plugged-47fc57e5-3a55-4719-944f-5d65f5fbcce4 for instance with vm_state building and task_state spawning.
Aug 01 18:29:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:41 user nova-compute[72150]: INFO nova.compute.manager [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Rescuing
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "refresh_cache-769690c8-53c5-4057-88a5-fbdbcb930e32" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquired lock "refresh_cache-769690c8-53c5-4057-88a5-fbdbcb930e32" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.network.neutron [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914581.0787494, 1de0ad54-0d7a-4287-9532-7b4982b1e2bf => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:29:41 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] VM Resumed (Lifecycle Event)
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:29:41 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Instance spawned successfully.
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:41 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914581.0801575, 1de0ad54-0d7a-4287-9532-7b4982b1e2bf => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:29:41 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] VM Started (Lifecycle Event)
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:29:41 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:29:41 user nova-compute[72150]: INFO nova.compute.manager [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Took 5.12 seconds to spawn the instance on the hypervisor.
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.compute.manager [req-08d756cf-35f8-41f1-a2a6-586bed184a84 req-2f0794b1-6e13-4f9e-8c2e-17aaa893626b service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Received event network-vif-plugged-47fc57e5-3a55-4719-944f-5d65f5fbcce4 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08d756cf-35f8-41f1-a2a6-586bed184a84 req-2f0794b1-6e13-4f9e-8c2e-17aaa893626b service nova] Acquiring lock "1de0ad54-0d7a-4287-9532-7b4982b1e2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08d756cf-35f8-41f1-a2a6-586bed184a84 req-2f0794b1-6e13-4f9e-8c2e-17aaa893626b service nova] Lock "1de0ad54-0d7a-4287-9532-7b4982b1e2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08d756cf-35f8-41f1-a2a6-586bed184a84 req-2f0794b1-6e13-4f9e-8c2e-17aaa893626b service nova] Lock "1de0ad54-0d7a-4287-9532-7b4982b1e2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.compute.manager [req-08d756cf-35f8-41f1-a2a6-586bed184a84 req-2f0794b1-6e13-4f9e-8c2e-17aaa893626b service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] No waiting events found dispatching network-vif-plugged-47fc57e5-3a55-4719-944f-5d65f5fbcce4 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:29:41 user nova-compute[72150]: WARNING nova.compute.manager [req-08d756cf-35f8-41f1-a2a6-586bed184a84 req-2f0794b1-6e13-4f9e-8c2e-17aaa893626b service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Received unexpected event network-vif-plugged-47fc57e5-3a55-4719-944f-5d65f5fbcce4 for instance with vm_state building and task_state spawning.
Aug 01 18:29:41 user nova-compute[72150]: INFO nova.compute.manager [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Took 14.22 seconds to build instance.
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d72c062e-c002-4198-9f7c-00ffd9d667fb tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "1de0ad54-0d7a-4287-9532-7b4982b1e2bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.346s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:29:41 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Creating image(s)
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Did not create local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Ensure instance console log exists: /opt/stack/data/nova/instances/42e75a98-beb1-4688-a375-affc63b14252/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Start _get_guest_xml network_info=[{"id": "10529340-a252-4604-accb-19f26670f125", "address": "fa:16:3e:56:f4:53", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10529340-a2", "ovs_interfaceid": "10529340-a252-4604-accb-19f26670f125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'de63a39b-3bb0-44ec-83b3-12638129e9c9', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qRsPIbfH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '42e75a98-beb1-4688-a375-affc63b14252', 'attached_at': '', 'detached_at': '', 'volume_id': '630abcbe-8adc-4bfd-9acb-228c83952d0e', 'serial': '630abcbe-8adc-4bfd-9acb-228c83952d0e'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:29:41 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:29:41 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qRsPIbfH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:29:41 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:29:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:29:41 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:29:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:29:41 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e841e09e-3c51-4264-8b03-24d70dc4fb57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:29:41 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca62c33-f1e5-4467-a340-dc358a862061]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e] added
Aug 01 18:29:41 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d04b33-8e60-4551-ad6e-6d83214362aa]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bcfc93-5751-4bea-970f-d3db27fca1a8]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qRsPIbfH {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qRsPIbfH" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ea52db-9c2a-4af9-8268-7f3a45c8dcd9]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qRsPIbfH'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a47eb2d-71af-4181-a88c-799cd274e9be]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:29:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[23abb883-9776-4bfe-8bd8-1416f2a8e718]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:29:42 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:29:42 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b89f6cd-d0cf-46bb-bd9f-4da0bef7a10a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e, portal: 172.16.0.220,3260]
Aug 01 18:29:42 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e, portal: 172.16.0.220,3260] successful.
Aug 01 18:29:42 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc3847e-d8ba-4869-be11-7407c139e62d]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG nova.network.neutron [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Updating instance_info_cache with network_info: [{"id": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "address": "fa:16:3e:8e:d7:75", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2596e33-c1", "ovs_interfaceid": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[001ade02-bc15-41e5-aaf2-81be2160b4c7]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:29:42 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:29:42 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:29:42 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:29:42 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Releasing lock "refresh_cache-769690c8-53c5-4057-88a5-fbdbcb930e32" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fd199b-66c2-451d-8cc0-75a8832b80e7]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qRsPIbfH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG nova.compute.manager [req-73208d26-508b-4872-807d-d49856d5e9ee req-871fbc3c-111a-4f43-91cc-2a6890bc6cda service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received event network-vif-unplugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-73208d26-508b-4872-807d-d49856d5e9ee req-871fbc3c-111a-4f43-91cc-2a6890bc6cda service nova] Acquiring lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-73208d26-508b-4872-807d-d49856d5e9ee req-871fbc3c-111a-4f43-91cc-2a6890bc6cda service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-73208d26-508b-4872-807d-d49856d5e9ee req-871fbc3c-111a-4f43-91cc-2a6890bc6cda service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG nova.compute.manager [req-73208d26-508b-4872-807d-d49856d5e9ee req-871fbc3c-111a-4f43-91cc-2a6890bc6cda service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] No waiting events found dispatching network-vif-unplugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:29:42 user nova-compute[72150]: WARNING nova.compute.manager [req-73208d26-508b-4872-807d-d49856d5e9ee req-871fbc3c-111a-4f43-91cc-2a6890bc6cda service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received unexpected event network-vif-unplugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a for instance with vm_state active and task_state rescuing.
Aug 01 18:29:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:43 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Instance destroyed successfully.
Aug 01 18:29:43 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Attempting rescue
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72150) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Instance directory exists: not creating {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 18:29:43 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Creating image(s)
Aug 01 18:29:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "/opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "/opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "/opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.objects.instance [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'trusted_certs' on Instance uuid 769690c8-53c5-4057-88a5-fbdbcb930e32 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23630666363303861', 'path': '/dev/sdc'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630666363303861', 'path': '/dev/sdc'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.144s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk.rescue {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-295206461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-295206461',id=22,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ad8ef64d051424e9fe644a1fb40fcb4',ramdisk_id='',reservation_id='r-r7xnryv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-23372548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:29:27Z,user_data=None,user_id='cc00b9006f5842c6b875c5d25538b718',uuid=42e75a98-beb1-4688-a375-affc63b14252,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10529340-a252-4604-accb-19f26670f125", "address": "fa:16:3e:56:f4:53", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10529340-a2", "ovs_interfaceid": "10529340-a252-4604-accb-19f26670f125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converting VIF {"id": "10529340-a252-4604-accb-19f26670f125", "address": "fa:16:3e:56:f4:53", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10529340-a2", "ovs_interfaceid": "10529340-a252-4604-accb-19f26670f125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:f4:53,bridge_name='br-int',has_traffic_filtering=True,id=10529340-a252-4604-accb-19f26670f125,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10529340-a2') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.objects.instance [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'pci_devices' on Instance uuid 42e75a98-beb1-4688-a375-affc63b14252 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk.rescue" returned: 0 in 0.061s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.objects.instance [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'migration_context' on Instance uuid 769690c8-53c5-4057-88a5-fbdbcb930e32 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:29:43 user nova-compute[72150]:   <uuid>42e75a98-beb1-4688-a375-affc63b14252</uuid>
Aug 01 18:29:43 user nova-compute[72150]:   <name>instance-00000016</name>
Aug 01 18:29:43 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:29:43 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:29:43 user nova-compute[72150]:   <metadata>
Aug 01 18:29:43 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:29:43 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:29:43 user nova-compute[72150]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-295206461</nova:name>
Aug 01 18:29:43 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:29:41</nova:creationTime>
Aug 01 18:29:43 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:29:43 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:29:43 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:29:43 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:29:43 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:29:43 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:29:43 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:29:43 user nova-compute[72150]:       <nova:owner>
Aug 01 18:29:43 user nova-compute[72150]:         <nova:user uuid="cc00b9006f5842c6b875c5d25538b718">tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member</nova:user>
Aug 01 18:29:43 user nova-compute[72150]:         <nova:project uuid="5ad8ef64d051424e9fe644a1fb40fcb4">tempest-ServerBootFromVolumeStableRescueTest-23372548</nova:project>
Aug 01 18:29:43 user nova-compute[72150]:       </nova:owner>
Aug 01 18:29:43 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:29:43 user nova-compute[72150]:       <nova:ports>
Aug 01 18:29:43 user nova-compute[72150]:         <nova:port uuid="10529340-a252-4604-accb-19f26670f125">
Aug 01 18:29:43 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 18:29:43 user nova-compute[72150]:         </nova:port>
Aug 01 18:29:43 user nova-compute[72150]:       </nova:ports>
Aug 01 18:29:43 user nova-compute[72150]:     </nova:instance>
Aug 01 18:29:43 user nova-compute[72150]:   </metadata>
Aug 01 18:29:43 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:29:43 user nova-compute[72150]:     <system>
Aug 01 18:29:43 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:29:43 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:29:43 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:29:43 user nova-compute[72150]:       <entry name="serial">42e75a98-beb1-4688-a375-affc63b14252</entry>
Aug 01 18:29:43 user nova-compute[72150]:       <entry name="uuid">42e75a98-beb1-4688-a375-affc63b14252</entry>
Aug 01 18:29:43 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:29:43 user nova-compute[72150]:     </system>
Aug 01 18:29:43 user nova-compute[72150]:   </sysinfo>
Aug 01 18:29:43 user nova-compute[72150]:   <os>
Aug 01 18:29:43 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:29:43 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:29:43 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:29:43 user nova-compute[72150]:   </os>
Aug 01 18:29:43 user nova-compute[72150]:   <features>
Aug 01 18:29:43 user nova-compute[72150]:     <acpi/>
Aug 01 18:29:43 user nova-compute[72150]:     <apic/>
Aug 01 18:29:43 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:29:43 user nova-compute[72150]:   </features>
Aug 01 18:29:43 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:29:43 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:29:43 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:29:43 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:29:43 user nova-compute[72150]:   </clock>
Aug 01 18:29:43 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:29:43 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:29:43 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:29:43 user nova-compute[72150]:   </cpu>
Aug 01 18:29:43 user nova-compute[72150]:   <devices>
Aug 01 18:29:43 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:29:43 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:29:43 user nova-compute[72150]:       <source dev="/dev/sdc"/>
Aug 01 18:29:43 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:29:43 user nova-compute[72150]:       <serial>630abcbe-8adc-4bfd-9acb-228c83952d0e</serial>
Aug 01 18:29:43 user nova-compute[72150]:     </disk>
Aug 01 18:29:43 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:29:43 user nova-compute[72150]:       <mac address="fa:16:3e:56:f4:53"/>
Aug 01 18:29:43 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:29:43 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:29:43 user nova-compute[72150]:       <target dev="tap10529340-a2"/>
Aug 01 18:29:43 user nova-compute[72150]:     </interface>
Aug 01 18:29:43 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:29:43 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/42e75a98-beb1-4688-a375-affc63b14252/console.log" append="off"/>
Aug 01 18:29:43 user nova-compute[72150]:     </serial>
Aug 01 18:29:43 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:29:43 user nova-compute[72150]:     <video>
Aug 01 18:29:43 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:29:43 user nova-compute[72150]:     </video>
Aug 01 18:29:43 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:29:43 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:29:43 user nova-compute[72150]:     </rng>
Aug 01 18:29:43 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:29:43 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:29:43 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:29:43 user nova-compute[72150]:     </memballoon>
Aug 01 18:29:43 user nova-compute[72150]:   </devices>
Aug 01 18:29:43 user nova-compute[72150]: </domain>
Aug 01 18:29:43 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-295206461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-295206461',id=22,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ad8ef64d051424e9fe644a1fb40fcb4',ramdisk_id='',reservation_id='r-r7xnryv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-23372548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:29:27Z,user_data=None,user_id='cc00b9006f5842c6b875c5d25538b718',uuid=42e75a98-beb1-4688-a375-affc63b14252,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10529340-a252-4604-accb-19f26670f125", "address": "fa:16:3e:56:f4:53", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10529340-a2", "ovs_interfaceid": "10529340-a252-4604-accb-19f26670f125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converting VIF {"id": "10529340-a252-4604-accb-19f26670f125", "address": "fa:16:3e:56:f4:53", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10529340-a2", "ovs_interfaceid": "10529340-a252-4604-accb-19f26670f125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:f4:53,bridge_name='br-int',has_traffic_filtering=True,id=10529340-a252-4604-accb-19f26670f125,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10529340-a2') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG os_vif [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:f4:53,bridge_name='br-int',has_traffic_filtering=True,id=10529340-a252-4604-accb-19f26670f125,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10529340-a2') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Start _get_guest_xml network_info=[{"id": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "address": "fa:16:3e:8e:d7:75", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "vif_mac": "fa:16:3e:8e:d7:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2596e33-c1", "ovs_interfaceid": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.objects.instance [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'resources' on Instance uuid 769690c8-53c5-4057-88a5-fbdbcb930e32 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10529340-a2, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap10529340-a2, col_values=(('external_ids', {'iface-id': '10529340-a252-4604-accb-19f26670f125', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:f4:53', 'vm-uuid': '42e75a98-beb1-4688-a375-affc63b14252'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.objects.instance [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'numa_topology' on Instance uuid 769690c8-53c5-4057-88a5-fbdbcb930e32 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:43 user nova-compute[72150]: INFO os_vif [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:f4:53,bridge_name='br-int',has_traffic_filtering=True,id=10529340-a252-4604-accb-19f26670f125,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10529340-a2')
Aug 01 18:29:43 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:29:43 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.objects.instance [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'vcpu_model' on Instance uuid 769690c8-53c5-4057-88a5-fbdbcb930e32 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-101128963',display_name='tempest-ServerRescueNegativeTestJSON-server-101128963',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-101128963',id=12,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:25:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0b70fdffe9e414aa766f7c8f7a20d50',ramdisk_id='',reservation_id='r-mwkwhm7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2003578958',owner_user_name='tempest-ServerRescueNegativeTestJSON-2003578958-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:25:05Z,user_data=None,user_id='375cd4acff1646f4a5418fb012118600',uuid=769690c8-53c5-4057-88a5-fbdbcb930e32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "address": "fa:16:3e:8e:d7:75", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "vif_mac": "fa:16:3e:8e:d7:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2596e33-c1", "ovs_interfaceid": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converting VIF {"id": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "address": "fa:16:3e:8e:d7:75", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "vif_mac": "fa:16:3e:8e:d7:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2596e33-c1", "ovs_interfaceid": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:d7:75,bridge_name='br-int',has_traffic_filtering=True,id=b2596e33-c1fc-42ae-ae83-524af44bbb0a,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2596e33-c1') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.objects.instance [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'pci_devices' on Instance uuid 769690c8-53c5-4057-88a5-fbdbcb930e32 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] No VIF found with MAC fa:16:3e:56:f4:53, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:29:43 user nova-compute[72150]:   <uuid>769690c8-53c5-4057-88a5-fbdbcb930e32</uuid>
Aug 01 18:29:43 user nova-compute[72150]:   <name>instance-0000000c</name>
Aug 01 18:29:43 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:29:43 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:29:43 user nova-compute[72150]:   <metadata>
Aug 01 18:29:43 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:29:43 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:29:43 user nova-compute[72150]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-101128963</nova:name>
Aug 01 18:29:43 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:29:43</nova:creationTime>
Aug 01 18:29:43 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:29:43 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:29:43 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:29:43 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:29:43 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:29:43 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:29:43 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:29:43 user nova-compute[72150]:       <nova:owner>
Aug 01 18:29:43 user nova-compute[72150]:         <nova:user uuid="375cd4acff1646f4a5418fb012118600">tempest-ServerRescueNegativeTestJSON-2003578958-project-member</nova:user>
Aug 01 18:29:43 user nova-compute[72150]:         <nova:project uuid="e0b70fdffe9e414aa766f7c8f7a20d50">tempest-ServerRescueNegativeTestJSON-2003578958</nova:project>
Aug 01 18:29:43 user nova-compute[72150]:       </nova:owner>
Aug 01 18:29:43 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:29:43 user nova-compute[72150]:       <nova:ports>
Aug 01 18:29:43 user nova-compute[72150]:         <nova:port uuid="b2596e33-c1fc-42ae-ae83-524af44bbb0a">
Aug 01 18:29:43 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 18:29:43 user nova-compute[72150]:         </nova:port>
Aug 01 18:29:43 user nova-compute[72150]:       </nova:ports>
Aug 01 18:29:43 user nova-compute[72150]:     </nova:instance>
Aug 01 18:29:43 user nova-compute[72150]:   </metadata>
Aug 01 18:29:43 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:29:43 user nova-compute[72150]:     <system>
Aug 01 18:29:43 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:29:43 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:29:43 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:29:43 user nova-compute[72150]:       <entry name="serial">769690c8-53c5-4057-88a5-fbdbcb930e32</entry>
Aug 01 18:29:43 user nova-compute[72150]:       <entry name="uuid">769690c8-53c5-4057-88a5-fbdbcb930e32</entry>
Aug 01 18:29:43 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:29:43 user nova-compute[72150]:     </system>
Aug 01 18:29:43 user nova-compute[72150]:   </sysinfo>
Aug 01 18:29:43 user nova-compute[72150]:   <os>
Aug 01 18:29:43 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:29:43 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:29:43 user nova-compute[72150]:   </os>
Aug 01 18:29:43 user nova-compute[72150]:   <features>
Aug 01 18:29:43 user nova-compute[72150]:     <acpi/>
Aug 01 18:29:43 user nova-compute[72150]:     <apic/>
Aug 01 18:29:43 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:29:43 user nova-compute[72150]:   </features>
Aug 01 18:29:43 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:29:43 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:29:43 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:29:43 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:29:43 user nova-compute[72150]:   </clock>
Aug 01 18:29:43 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:29:43 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:29:43 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:29:43 user nova-compute[72150]:   </cpu>
Aug 01 18:29:43 user nova-compute[72150]:   <devices>
Aug 01 18:29:43 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:29:43 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:29:43 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk.rescue"/>
Aug 01 18:29:43 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:29:43 user nova-compute[72150]:     </disk>
Aug 01 18:29:43 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:29:43 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:29:43 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk"/>
Aug 01 18:29:43 user nova-compute[72150]:       <target dev="vdb" bus="virtio"/>
Aug 01 18:29:43 user nova-compute[72150]:     </disk>
Aug 01 18:29:43 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:29:43 user nova-compute[72150]:       <mac address="fa:16:3e:8e:d7:75"/>
Aug 01 18:29:43 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:29:43 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:29:43 user nova-compute[72150]:       <target dev="tapb2596e33-c1"/>
Aug 01 18:29:43 user nova-compute[72150]:     </interface>
Aug 01 18:29:43 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:29:43 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/console.log" append="off"/>
Aug 01 18:29:43 user nova-compute[72150]:     </serial>
Aug 01 18:29:43 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:29:43 user nova-compute[72150]:     <video>
Aug 01 18:29:43 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:29:43 user nova-compute[72150]:     </video>
Aug 01 18:29:43 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:29:43 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:29:43 user nova-compute[72150]:     </rng>
Aug 01 18:29:43 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:29:43 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:29:43 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:29:43 user nova-compute[72150]:     </memballoon>
Aug 01 18:29:43 user nova-compute[72150]:   </devices>
Aug 01 18:29:43 user nova-compute[72150]: </domain>
Aug 01 18:29:43 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:29:43 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Instance destroyed successfully.
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] No VIF found with MAC fa:16:3e:8e:d7:75, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:29:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "eb113972-7a86-4cb7-9f8d-ca690693e27d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:44 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:29:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:44 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:29:44 user nova-compute[72150]: INFO nova.compute.claims [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Claim successful on node user
Aug 01 18:29:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-26d50acd-9586-4c11-974c-c0c87cf29bc2 req-15f742bd-0017-43b3-b3fb-3de030c0d612 service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received event network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:29:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-26d50acd-9586-4c11-974c-c0c87cf29bc2 req-15f742bd-0017-43b3-b3fb-3de030c0d612 service nova] Acquiring lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-26d50acd-9586-4c11-974c-c0c87cf29bc2 req-15f742bd-0017-43b3-b3fb-3de030c0d612 service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-26d50acd-9586-4c11-974c-c0c87cf29bc2 req-15f742bd-0017-43b3-b3fb-3de030c0d612 service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-26d50acd-9586-4c11-974c-c0c87cf29bc2 req-15f742bd-0017-43b3-b3fb-3de030c0d612 service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] No waiting events found dispatching network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:29:44 user nova-compute[72150]: WARNING nova.compute.manager [req-26d50acd-9586-4c11-974c-c0c87cf29bc2 req-15f742bd-0017-43b3-b3fb-3de030c0d612 service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received unexpected event network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a for instance with vm_state active and task_state rescuing.
Aug 01 18:29:44 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:29:44 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:29:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:44 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:29:44 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:29:44 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:29:44 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:29:44 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:29:45 user nova-compute[72150]: DEBUG nova.policy [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d89a05b857d43c48f0767eb073a2f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96498272792348f3a3c36ee8544100f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:29:45 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:29:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:29:45 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Creating image(s)
Aug 01 18:29:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "/opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "/opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "eb53f5de263f6d28434dc20e4eb40a1e8dbb857a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "eb53f5de263f6d28434dc20e4eb40a1e8dbb857a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb53f5de263f6d28434dc20e4eb40a1e8dbb857a.part --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb53f5de263f6d28434dc20e4eb40a1e8dbb857a.part --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:45 user nova-compute[72150]: DEBUG nova.virt.images [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] 4bc70f80-a2f7-482d-8395-58908ca01d7b was qcow2, converting to raw {{(pid=72150) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 18:29:45 user nova-compute[72150]: DEBUG nova.privsep.utils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72150) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 18:29:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eb53f5de263f6d28434dc20e4eb40a1e8dbb857a.part /opt/stack/data/nova/instances/_base/eb53f5de263f6d28434dc20e4eb40a1e8dbb857a.converted {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:45 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Successfully created port: a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:29:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eb53f5de263f6d28434dc20e4eb40a1e8dbb857a.part /opt/stack/data/nova/instances/_base/eb53f5de263f6d28434dc20e4eb40a1e8dbb857a.converted" returned: 0 in 0.171s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb53f5de263f6d28434dc20e4eb40a1e8dbb857a.converted --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb53f5de263f6d28434dc20e4eb40a1e8dbb857a.converted --force-share --output=json" returned: 0 in 0.158s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "eb53f5de263f6d28434dc20e4eb40a1e8dbb857a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.912s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb53f5de263f6d28434dc20e4eb40a1e8dbb857a --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb53f5de263f6d28434dc20e4eb40a1e8dbb857a --force-share --output=json" returned: 0 in 0.161s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "eb53f5de263f6d28434dc20e4eb40a1e8dbb857a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "eb53f5de263f6d28434dc20e4eb40a1e8dbb857a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb53f5de263f6d28434dc20e4eb40a1e8dbb857a --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb53f5de263f6d28434dc20e4eb40a1e8dbb857a --force-share --output=json" returned: 0 in 0.190s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb53f5de263f6d28434dc20e4eb40a1e8dbb857a,backing_fmt=raw /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb53f5de263f6d28434dc20e4eb40a1e8dbb857a,backing_fmt=raw /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk 1073741824" returned: 0 in 0.070s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "eb53f5de263f6d28434dc20e4eb40a1e8dbb857a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb53f5de263f6d28434dc20e4eb40a1e8dbb857a --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG nova.compute.manager [req-106c31a1-9cab-4b9c-b19c-ff0182a0bad3 req-3370e81d-f9c3-458f-9073-beb66466391b service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-106c31a1-9cab-4b9c-b19c-ff0182a0bad3 req-3370e81d-f9c3-458f-9073-beb66466391b service nova] Acquiring lock "42e75a98-beb1-4688-a375-affc63b14252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-106c31a1-9cab-4b9c-b19c-ff0182a0bad3 req-3370e81d-f9c3-458f-9073-beb66466391b service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-106c31a1-9cab-4b9c-b19c-ff0182a0bad3 req-3370e81d-f9c3-458f-9073-beb66466391b service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG nova.compute.manager [req-106c31a1-9cab-4b9c-b19c-ff0182a0bad3 req-3370e81d-f9c3-458f-9073-beb66466391b service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] No waiting events found dispatching network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:29:46 user nova-compute[72150]: WARNING nova.compute.manager [req-106c31a1-9cab-4b9c-b19c-ff0182a0bad3 req-3370e81d-f9c3-458f-9073-beb66466391b service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received unexpected event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 for instance with vm_state building and task_state spawning.
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb53f5de263f6d28434dc20e4eb40a1e8dbb857a --force-share --output=json" returned: 0 in 0.184s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG nova.compute.manager [req-94951d77-acb4-40aa-9c0b-692bc19b4861 req-4630f4ce-6d33-49cb-80f6-64cebb17bc61 service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received event network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-94951d77-acb4-40aa-9c0b-692bc19b4861 req-4630f4ce-6d33-49cb-80f6-64cebb17bc61 service nova] Acquiring lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-94951d77-acb4-40aa-9c0b-692bc19b4861 req-4630f4ce-6d33-49cb-80f6-64cebb17bc61 service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-94951d77-acb4-40aa-9c0b-692bc19b4861 req-4630f4ce-6d33-49cb-80f6-64cebb17bc61 service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG nova.compute.manager [req-94951d77-acb4-40aa-9c0b-692bc19b4861 req-4630f4ce-6d33-49cb-80f6-64cebb17bc61 service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] No waiting events found dispatching network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:29:46 user nova-compute[72150]: WARNING nova.compute.manager [req-94951d77-acb4-40aa-9c0b-692bc19b4861 req-4630f4ce-6d33-49cb-80f6-64cebb17bc61 service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received unexpected event network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a for instance with vm_state active and task_state rescuing.
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Cannot resize image /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lazy-loading 'migration_context' on Instance uuid eb113972-7a86-4cb7-9f8d-ca690693e27d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Ensure instance console log exists: /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Successfully updated port: a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "refresh_cache-eb113972-7a86-4cb7-9f8d-ca690693e27d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquired lock "refresh_cache-eb113972-7a86-4cb7-9f8d-ca690693e27d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:29:46 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Updating instance_info_cache with network_info: [{"id": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "address": "fa:16:3e:b3:96:a5", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519018d-4c", "ovs_interfaceid": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Releasing lock "refresh_cache-eb113972-7a86-4cb7-9f8d-ca690693e27d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Instance network_info: |[{"id": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "address": "fa:16:3e:b3:96:a5", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519018d-4c", "ovs_interfaceid": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Start _get_guest_xml network_info=[{"id": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "address": "fa:16:3e:b3:96:a5", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519018d-4c", "ovs_interfaceid": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:29:41Z,direct_url=<?>,disk_format='qcow2',id=4bc70f80-a2f7-482d-8395-58908ca01d7b,min_disk=0,min_ram=0,name='tempest-scenario-img--822351473',owner='96498272792348f3a3c36ee8544100f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:29:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '4bc70f80-a2f7-482d-8395-58908ca01d7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:29:47 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:29:47 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:29:41Z,direct_url=<?>,disk_format='qcow2',id=4bc70f80-a2f7-482d-8395-58908ca01d7b,min_disk=0,min_ram=0,name='tempest-scenario-img--822351473',owner='96498272792348f3a3c36ee8544100f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:29:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:29:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1800718826',display_name='tempest-TestMinimumBasicScenario-server-1800718826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1800718826',id=24,image_ref='4bc70f80-a2f7-482d-8395-58908ca01d7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8oPReI02FuGINag0FKlnJ0joSVprUFqu+HGUn3O1VOzI1R8ynKFVjJ83L1heMbU56Gi4RSJnG1LS16jayyztjBp/Sg3G4J0y+mGh4i+3RWPcDlSy3MF3Vx7G6aTOKGrg==',key_name='tempest-TestMinimumBasicScenario-1923183796',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96498272792348f3a3c36ee8544100f2',ramdisk_id='',reservation_id='r-c0m3e17x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4bc70f80-a2f7-482d-8395-58908ca01d7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-879365140',owner_user_name='tempest-TestMinimumBasicScenario-879365140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:29:45Z,user_data=None,user_id='3d89a05b857d43c48f0767eb073a2f37',uuid=eb113972-7a86-4cb7-9f8d-ca690693e27d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "address": "fa:16:3e:b3:96:a5", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519018d-4c", "ovs_interfaceid": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Converting VIF {"id": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "address": "fa:16:3e:b3:96:a5", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519018d-4c", "ovs_interfaceid": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:96:a5,bridge_name='br-int',has_traffic_filtering=True,id=a519018d-4c4e-4d06-ba14-c2d2054529ea,network=Network(e3a4003a-4248-4265-b270-f289b1c2810f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa519018d-4c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lazy-loading 'pci_devices' on Instance uuid eb113972-7a86-4cb7-9f8d-ca690693e27d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:29:47 user nova-compute[72150]:   <uuid>eb113972-7a86-4cb7-9f8d-ca690693e27d</uuid>
Aug 01 18:29:47 user nova-compute[72150]:   <name>instance-00000018</name>
Aug 01 18:29:47 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:29:47 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:29:47 user nova-compute[72150]:   <metadata>
Aug 01 18:29:47 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:29:47 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:29:47 user nova-compute[72150]:       <nova:name>tempest-TestMinimumBasicScenario-server-1800718826</nova:name>
Aug 01 18:29:47 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:29:47</nova:creationTime>
Aug 01 18:29:47 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:29:47 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:29:47 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:29:47 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:29:47 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:29:47 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:29:47 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:29:47 user nova-compute[72150]:       <nova:owner>
Aug 01 18:29:47 user nova-compute[72150]:         <nova:user uuid="3d89a05b857d43c48f0767eb073a2f37">tempest-TestMinimumBasicScenario-879365140-project-member</nova:user>
Aug 01 18:29:47 user nova-compute[72150]:         <nova:project uuid="96498272792348f3a3c36ee8544100f2">tempest-TestMinimumBasicScenario-879365140</nova:project>
Aug 01 18:29:47 user nova-compute[72150]:       </nova:owner>
Aug 01 18:29:47 user nova-compute[72150]:       <nova:root type="image" uuid="4bc70f80-a2f7-482d-8395-58908ca01d7b"/>
Aug 01 18:29:47 user nova-compute[72150]:       <nova:ports>
Aug 01 18:29:47 user nova-compute[72150]:         <nova:port uuid="a519018d-4c4e-4d06-ba14-c2d2054529ea">
Aug 01 18:29:47 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 18:29:47 user nova-compute[72150]:         </nova:port>
Aug 01 18:29:47 user nova-compute[72150]:       </nova:ports>
Aug 01 18:29:47 user nova-compute[72150]:     </nova:instance>
Aug 01 18:29:47 user nova-compute[72150]:   </metadata>
Aug 01 18:29:47 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:29:47 user nova-compute[72150]:     <system>
Aug 01 18:29:47 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:29:47 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:29:47 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:29:47 user nova-compute[72150]:       <entry name="serial">eb113972-7a86-4cb7-9f8d-ca690693e27d</entry>
Aug 01 18:29:47 user nova-compute[72150]:       <entry name="uuid">eb113972-7a86-4cb7-9f8d-ca690693e27d</entry>
Aug 01 18:29:47 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:29:47 user nova-compute[72150]:     </system>
Aug 01 18:29:47 user nova-compute[72150]:   </sysinfo>
Aug 01 18:29:47 user nova-compute[72150]:   <os>
Aug 01 18:29:47 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:29:47 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:29:47 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:29:47 user nova-compute[72150]:   </os>
Aug 01 18:29:47 user nova-compute[72150]:   <features>
Aug 01 18:29:47 user nova-compute[72150]:     <acpi/>
Aug 01 18:29:47 user nova-compute[72150]:     <apic/>
Aug 01 18:29:47 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:29:47 user nova-compute[72150]:   </features>
Aug 01 18:29:47 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:29:47 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:29:47 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:29:47 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:29:47 user nova-compute[72150]:   </clock>
Aug 01 18:29:47 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:29:47 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:29:47 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:29:47 user nova-compute[72150]:   </cpu>
Aug 01 18:29:47 user nova-compute[72150]:   <devices>
Aug 01 18:29:47 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:29:47 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:29:47 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk"/>
Aug 01 18:29:47 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:29:47 user nova-compute[72150]:     </disk>
Aug 01 18:29:47 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:29:47 user nova-compute[72150]:       <mac address="fa:16:3e:b3:96:a5"/>
Aug 01 18:29:47 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:29:47 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:29:47 user nova-compute[72150]:       <target dev="tapa519018d-4c"/>
Aug 01 18:29:47 user nova-compute[72150]:     </interface>
Aug 01 18:29:47 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:29:47 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/console.log" append="off"/>
Aug 01 18:29:47 user nova-compute[72150]:     </serial>
Aug 01 18:29:47 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:29:47 user nova-compute[72150]:     <video>
Aug 01 18:29:47 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:29:47 user nova-compute[72150]:     </video>
Aug 01 18:29:47 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:29:47 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:29:47 user nova-compute[72150]:     </rng>
Aug 01 18:29:47 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:29:47 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:29:47 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:29:47 user nova-compute[72150]:     </memballoon>
Aug 01 18:29:47 user nova-compute[72150]:   </devices>
Aug 01 18:29:47 user nova-compute[72150]: </domain>
Aug 01 18:29:47 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:29:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1800718826',display_name='tempest-TestMinimumBasicScenario-server-1800718826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1800718826',id=24,image_ref='4bc70f80-a2f7-482d-8395-58908ca01d7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8oPReI02FuGINag0FKlnJ0joSVprUFqu+HGUn3O1VOzI1R8ynKFVjJ83L1heMbU56Gi4RSJnG1LS16jayyztjBp/Sg3G4J0y+mGh4i+3RWPcDlSy3MF3Vx7G6aTOKGrg==',key_name='tempest-TestMinimumBasicScenario-1923183796',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96498272792348f3a3c36ee8544100f2',ramdisk_id='',reservation_id='r-c0m3e17x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4bc70f80-a2f7-482d-8395-58908ca01d7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-879365140',owner_user_name='tempest-TestMinimumBasicScenario-879365140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:29:45Z,user_data=None,user_id='3d89a05b857d43c48f0767eb073a2f37',uuid=eb113972-7a86-4cb7-9f8d-ca690693e27d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "address": "fa:16:3e:b3:96:a5", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519018d-4c", "ovs_interfaceid": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Converting VIF {"id": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "address": "fa:16:3e:b3:96:a5", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519018d-4c", "ovs_interfaceid": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:96:a5,bridge_name='br-int',has_traffic_filtering=True,id=a519018d-4c4e-4d06-ba14-c2d2054529ea,network=Network(e3a4003a-4248-4265-b270-f289b1c2810f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa519018d-4c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG os_vif [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:96:a5,bridge_name='br-int',has_traffic_filtering=True,id=a519018d-4c4e-4d06-ba14-c2d2054529ea,network=Network(e3a4003a-4248-4265-b270-f289b1c2810f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa519018d-4c') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa519018d-4c, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa519018d-4c, col_values=(('external_ids', {'iface-id': 'a519018d-4c4e-4d06-ba14-c2d2054529ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:96:a5', 'vm-uuid': 'eb113972-7a86-4cb7-9f8d-ca690693e27d'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:47 user nova-compute[72150]: INFO os_vif [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:96:a5,bridge_name='br-int',has_traffic_filtering=True,id=a519018d-4c4e-4d06-ba14-c2d2054529ea,network=Network(e3a4003a-4248-4265-b270-f289b1c2810f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa519018d-4c')
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:29:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] No VIF found with MAC fa:16:3e:b3:96:a5, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:29:48 user nova-compute[72150]: DEBUG nova.compute.manager [req-1c80e9d8-a3c7-474a-81be-b0e4b60d8c7a req-94c44123-08fc-4130-9650-455394c629d5 service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Received event network-changed-a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:29:48 user nova-compute[72150]: DEBUG nova.compute.manager [req-1c80e9d8-a3c7-474a-81be-b0e4b60d8c7a req-94c44123-08fc-4130-9650-455394c629d5 service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Refreshing instance network info cache due to event network-changed-a519018d-4c4e-4d06-ba14-c2d2054529ea. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:29:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1c80e9d8-a3c7-474a-81be-b0e4b60d8c7a req-94c44123-08fc-4130-9650-455394c629d5 service nova] Acquiring lock "refresh_cache-eb113972-7a86-4cb7-9f8d-ca690693e27d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:29:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1c80e9d8-a3c7-474a-81be-b0e4b60d8c7a req-94c44123-08fc-4130-9650-455394c629d5 service nova] Acquired lock "refresh_cache-eb113972-7a86-4cb7-9f8d-ca690693e27d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:29:48 user nova-compute[72150]: DEBUG nova.network.neutron [req-1c80e9d8-a3c7-474a-81be-b0e4b60d8c7a req-94c44123-08fc-4130-9650-455394c629d5 service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Refreshing network info cache for port a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:29:48 user nova-compute[72150]: DEBUG nova.compute.manager [req-5d4cab30-ede4-4309-b679-bd738d5b3617 req-fb70b41a-071d-42f4-8ed2-b6938854e82c service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received event network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:29:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5d4cab30-ede4-4309-b679-bd738d5b3617 req-fb70b41a-071d-42f4-8ed2-b6938854e82c service nova] Acquiring lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5d4cab30-ede4-4309-b679-bd738d5b3617 req-fb70b41a-071d-42f4-8ed2-b6938854e82c service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5d4cab30-ede4-4309-b679-bd738d5b3617 req-fb70b41a-071d-42f4-8ed2-b6938854e82c service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:48 user nova-compute[72150]: DEBUG nova.compute.manager [req-5d4cab30-ede4-4309-b679-bd738d5b3617 req-fb70b41a-071d-42f4-8ed2-b6938854e82c service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] No waiting events found dispatching network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:29:48 user nova-compute[72150]: WARNING nova.compute.manager [req-5d4cab30-ede4-4309-b679-bd738d5b3617 req-fb70b41a-071d-42f4-8ed2-b6938854e82c service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received unexpected event network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a for instance with vm_state active and task_state rescuing.
Aug 01 18:29:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914589.112212, 42e75a98-beb1-4688-a375-affc63b14252 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:29:49 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] VM Resumed (Lifecycle Event)
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-1534c3fd-7f7f-4fb4-86b0-2bdd0857340b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:29:49 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Instance spawned successfully.
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:49 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914589.1126215, 42e75a98-beb1-4688-a375-affc63b14252 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:29:49 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] VM Started (Lifecycle Event)
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.network.neutron [req-1c80e9d8-a3c7-474a-81be-b0e4b60d8c7a req-94c44123-08fc-4130-9650-455394c629d5 service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Updated VIF entry in instance network info cache for port a519018d-4c4e-4d06-ba14-c2d2054529ea. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.network.neutron [req-1c80e9d8-a3c7-474a-81be-b0e4b60d8c7a req-94c44123-08fc-4130-9650-455394c629d5 service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Updating instance_info_cache with network_info: [{"id": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "address": "fa:16:3e:b3:96:a5", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519018d-4c", "ovs_interfaceid": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1c80e9d8-a3c7-474a-81be-b0e4b60d8c7a req-94c44123-08fc-4130-9650-455394c629d5 service nova] Releasing lock "refresh_cache-eb113972-7a86-4cb7-9f8d-ca690693e27d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.compute.manager [req-1c80e9d8-a3c7-474a-81be-b0e4b60d8c7a req-94c44123-08fc-4130-9650-455394c629d5 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1c80e9d8-a3c7-474a-81be-b0e4b60d8c7a req-94c44123-08fc-4130-9650-455394c629d5 service nova] Acquiring lock "42e75a98-beb1-4688-a375-affc63b14252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1c80e9d8-a3c7-474a-81be-b0e4b60d8c7a req-94c44123-08fc-4130-9650-455394c629d5 service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1c80e9d8-a3c7-474a-81be-b0e4b60d8c7a req-94c44123-08fc-4130-9650-455394c629d5 service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.compute.manager [req-1c80e9d8-a3c7-474a-81be-b0e4b60d8c7a req-94c44123-08fc-4130-9650-455394c629d5 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] No waiting events found dispatching network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:29:49 user nova-compute[72150]: WARNING nova.compute.manager [req-1c80e9d8-a3c7-474a-81be-b0e4b60d8c7a req-94c44123-08fc-4130-9650-455394c629d5 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received unexpected event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 for instance with vm_state building and task_state spawning.
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:29:49 user nova-compute[72150]: INFO nova.compute.manager [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Took 7.57 seconds to spawn the instance on the hypervisor.
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:29:49 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Removed pending event for 769690c8-53c5-4057-88a5-fbdbcb930e32 due to event {{(pid=72150) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914589.1348948, 769690c8-53c5-4057-88a5-fbdbcb930e32 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:29:49 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] VM Resumed (Lifecycle Event)
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914589.1354253, 769690c8-53c5-4057-88a5-fbdbcb930e32 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:29:49 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] VM Started (Lifecycle Event)
Aug 01 18:29:49 user nova-compute[72150]: INFO nova.compute.manager [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Took 22.91 seconds to build instance.
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-10b93f33-2a3d-48f3-b6b3-3067214a2d02 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "42e75a98-beb1-4688-a375-affc63b14252" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.037s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-eccdd166-21ad-4d8a-aefe-b61668ce4495 req-4b0511b4-006e-4c25-8df3-4bca84f7ca2a service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Received event network-vif-plugged-a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:29:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-eccdd166-21ad-4d8a-aefe-b61668ce4495 req-4b0511b4-006e-4c25-8df3-4bca84f7ca2a service nova] Acquiring lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-eccdd166-21ad-4d8a-aefe-b61668ce4495 req-4b0511b4-006e-4c25-8df3-4bca84f7ca2a service nova] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-eccdd166-21ad-4d8a-aefe-b61668ce4495 req-4b0511b4-006e-4c25-8df3-4bca84f7ca2a service nova] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-eccdd166-21ad-4d8a-aefe-b61668ce4495 req-4b0511b4-006e-4c25-8df3-4bca84f7ca2a service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] No waiting events found dispatching network-vif-plugged-a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:29:50 user nova-compute[72150]: WARNING nova.compute.manager [req-eccdd166-21ad-4d8a-aefe-b61668ce4495 req-4b0511b4-006e-4c25-8df3-4bca84f7ca2a service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Received unexpected event network-vif-plugged-a519018d-4c4e-4d06-ba14-c2d2054529ea for instance with vm_state building and task_state spawning.
Aug 01 18:29:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-eccdd166-21ad-4d8a-aefe-b61668ce4495 req-4b0511b4-006e-4c25-8df3-4bca84f7ca2a service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Received event network-vif-plugged-a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:29:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-eccdd166-21ad-4d8a-aefe-b61668ce4495 req-4b0511b4-006e-4c25-8df3-4bca84f7ca2a service nova] Acquiring lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:29:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-eccdd166-21ad-4d8a-aefe-b61668ce4495 req-4b0511b4-006e-4c25-8df3-4bca84f7ca2a service nova] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:29:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-eccdd166-21ad-4d8a-aefe-b61668ce4495 req-4b0511b4-006e-4c25-8df3-4bca84f7ca2a service nova] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-eccdd166-21ad-4d8a-aefe-b61668ce4495 req-4b0511b4-006e-4c25-8df3-4bca84f7ca2a service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] No waiting events found dispatching network-vif-plugged-a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:29:50 user nova-compute[72150]: WARNING nova.compute.manager [req-eccdd166-21ad-4d8a-aefe-b61668ce4495 req-4b0511b4-006e-4c25-8df3-4bca84f7ca2a service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Received unexpected event network-vif-plugged-a519018d-4c4e-4d06-ba14-c2d2054529ea for instance with vm_state building and task_state spawning.
Aug 01 18:29:51 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914591.2897527, eb113972-7a86-4cb7-9f8d-ca690693e27d => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:29:51 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] VM Resumed (Lifecycle Event)
Aug 01 18:29:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:29:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:29:51 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Instance spawned successfully.
Aug 01 18:29:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:29:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:29:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:29:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:29:51 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:29:51 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914591.291306, eb113972-7a86-4cb7-9f8d-ca690693e27d => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:29:51 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] VM Started (Lifecycle Event)
Aug 01 18:29:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:29:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:29:51 user nova-compute[72150]: INFO nova.compute.manager [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Took 6.35 seconds to spawn the instance on the hypervisor.
Aug 01 18:29:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:29:51 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:29:51 user nova-compute[72150]: INFO nova.compute.manager [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Took 7.22 seconds to build instance.
Aug 01 18:29:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d384e20-1585-46aa-ab13-517dd90df25b tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.327s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:29:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:29:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "beb6d063-d147-4033-ae73-55ff95a48efa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "beb6d063-d147-4033-ae73-55ff95a48efa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:08 user nova-compute[72150]: DEBUG nova.compute.manager [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:30:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:08 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:30:08 user nova-compute[72150]: INFO nova.compute.claims [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Claim successful on node user
Aug 01 18:30:08 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:30:08 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG nova.network.neutron [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:30:09 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:30:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG nova.policy [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c975577646d746d192f038a3608d1f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efbd504761845f88d59b78115119d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:30:09 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Creating image(s)
Aug 01 18:30:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "/opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "/opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "/opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.178s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/disk 1073741824" returned: 0 in 0.051s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Checking if we can resize image /opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Cannot resize image /opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG nova.objects.instance [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lazy-loading 'migration_context' on Instance uuid beb6d063-d147-4033-ae73-55ff95a48efa {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG nova.network.neutron [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Successfully created port: 486cf8af-74cf-4a5c-8e58-159e7fd1a36c {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Ensure instance console log exists: /opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:10 user nova-compute[72150]: DEBUG nova.network.neutron [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Successfully updated port: 486cf8af-74cf-4a5c-8e58-159e7fd1a36c {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:30:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "refresh_cache-beb6d063-d147-4033-ae73-55ff95a48efa" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:30:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquired lock "refresh_cache-beb6d063-d147-4033-ae73-55ff95a48efa" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:30:10 user nova-compute[72150]: DEBUG nova.network.neutron [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:30:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-9ef53360-5c13-4609-a961-c61e657d560d req-3d5fed2a-b10c-40a2-b184-ef0b6875f090 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Received event network-changed-486cf8af-74cf-4a5c-8e58-159e7fd1a36c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:30:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-9ef53360-5c13-4609-a961-c61e657d560d req-3d5fed2a-b10c-40a2-b184-ef0b6875f090 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Refreshing instance network info cache due to event network-changed-486cf8af-74cf-4a5c-8e58-159e7fd1a36c. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:30:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9ef53360-5c13-4609-a961-c61e657d560d req-3d5fed2a-b10c-40a2-b184-ef0b6875f090 service nova] Acquiring lock "refresh_cache-beb6d063-d147-4033-ae73-55ff95a48efa" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:30:10 user nova-compute[72150]: DEBUG nova.network.neutron [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.network.neutron [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Updating instance_info_cache with network_info: [{"id": "486cf8af-74cf-4a5c-8e58-159e7fd1a36c", "address": "fa:16:3e:2d:d2:ae", "network": {"id": "87bd2699-a52f-4b66-9d6c-fbf9fa54792d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1887490690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efbd504761845f88d59b78115119d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486cf8af-74", "ovs_interfaceid": "486cf8af-74cf-4a5c-8e58-159e7fd1a36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Releasing lock "refresh_cache-beb6d063-d147-4033-ae73-55ff95a48efa" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.compute.manager [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Instance network_info: |[{"id": "486cf8af-74cf-4a5c-8e58-159e7fd1a36c", "address": "fa:16:3e:2d:d2:ae", "network": {"id": "87bd2699-a52f-4b66-9d6c-fbf9fa54792d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1887490690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efbd504761845f88d59b78115119d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486cf8af-74", "ovs_interfaceid": "486cf8af-74cf-4a5c-8e58-159e7fd1a36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9ef53360-5c13-4609-a961-c61e657d560d req-3d5fed2a-b10c-40a2-b184-ef0b6875f090 service nova] Acquired lock "refresh_cache-beb6d063-d147-4033-ae73-55ff95a48efa" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.network.neutron [req-9ef53360-5c13-4609-a961-c61e657d560d req-3d5fed2a-b10c-40a2-b184-ef0b6875f090 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Refreshing network info cache for port 486cf8af-74cf-4a5c-8e58-159e7fd1a36c {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Start _get_guest_xml network_info=[{"id": "486cf8af-74cf-4a5c-8e58-159e7fd1a36c", "address": "fa:16:3e:2d:d2:ae", "network": {"id": "87bd2699-a52f-4b66-9d6c-fbf9fa54792d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1887490690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efbd504761845f88d59b78115119d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486cf8af-74", "ovs_interfaceid": "486cf8af-74cf-4a5c-8e58-159e7fd1a36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:30:11 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:30:11 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1926720016',display_name='tempest-VolumesSnapshotTestJSON-instance-1926720016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1926720016',id=25,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFMMqXiT5VdBSIZ1X1VTO/nfV3xaz7Bt5y+1xCsEnyIwpxaVXzdxPIC2fAuTSaIxRzGP9nSznSOmDdYN+6wIfBjoXZgON82tXvp/RmqJ/SGT7VMj2NVh8t8VOjnFFOuUw==',key_name='tempest-keypair-233711911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5efbd504761845f88d59b78115119d62',ramdisk_id='',reservation_id='r-am7y01fr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-710086109',owner_user_name='tempest-VolumesSnapshotTestJSON-710086109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:30:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c975577646d746d192f038a3608d1f76',uuid=beb6d063-d147-4033-ae73-55ff95a48efa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "486cf8af-74cf-4a5c-8e58-159e7fd1a36c", "address": "fa:16:3e:2d:d2:ae", "network": {"id": "87bd2699-a52f-4b66-9d6c-fbf9fa54792d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1887490690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efbd504761845f88d59b78115119d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486cf8af-74", "ovs_interfaceid": "486cf8af-74cf-4a5c-8e58-159e7fd1a36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Converting VIF {"id": "486cf8af-74cf-4a5c-8e58-159e7fd1a36c", "address": "fa:16:3e:2d:d2:ae", "network": {"id": "87bd2699-a52f-4b66-9d6c-fbf9fa54792d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1887490690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efbd504761845f88d59b78115119d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486cf8af-74", "ovs_interfaceid": "486cf8af-74cf-4a5c-8e58-159e7fd1a36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=486cf8af-74cf-4a5c-8e58-159e7fd1a36c,network=Network(87bd2699-a52f-4b66-9d6c-fbf9fa54792d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap486cf8af-74') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.objects.instance [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lazy-loading 'pci_devices' on Instance uuid beb6d063-d147-4033-ae73-55ff95a48efa {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:30:11 user nova-compute[72150]:   <uuid>beb6d063-d147-4033-ae73-55ff95a48efa</uuid>
Aug 01 18:30:11 user nova-compute[72150]:   <name>instance-00000019</name>
Aug 01 18:30:11 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:30:11 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:30:11 user nova-compute[72150]:   <metadata>
Aug 01 18:30:11 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:30:11 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:30:11 user nova-compute[72150]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1926720016</nova:name>
Aug 01 18:30:11 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:30:11</nova:creationTime>
Aug 01 18:30:11 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:30:11 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:30:11 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:30:11 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:30:11 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:30:11 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:30:11 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:30:11 user nova-compute[72150]:       <nova:owner>
Aug 01 18:30:11 user nova-compute[72150]:         <nova:user uuid="c975577646d746d192f038a3608d1f76">tempest-VolumesSnapshotTestJSON-710086109-project-member</nova:user>
Aug 01 18:30:11 user nova-compute[72150]:         <nova:project uuid="5efbd504761845f88d59b78115119d62">tempest-VolumesSnapshotTestJSON-710086109</nova:project>
Aug 01 18:30:11 user nova-compute[72150]:       </nova:owner>
Aug 01 18:30:11 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:30:11 user nova-compute[72150]:       <nova:ports>
Aug 01 18:30:11 user nova-compute[72150]:         <nova:port uuid="486cf8af-74cf-4a5c-8e58-159e7fd1a36c">
Aug 01 18:30:11 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 18:30:11 user nova-compute[72150]:         </nova:port>
Aug 01 18:30:11 user nova-compute[72150]:       </nova:ports>
Aug 01 18:30:11 user nova-compute[72150]:     </nova:instance>
Aug 01 18:30:11 user nova-compute[72150]:   </metadata>
Aug 01 18:30:11 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:30:11 user nova-compute[72150]:     <system>
Aug 01 18:30:11 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:30:11 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:30:11 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:30:11 user nova-compute[72150]:       <entry name="serial">beb6d063-d147-4033-ae73-55ff95a48efa</entry>
Aug 01 18:30:11 user nova-compute[72150]:       <entry name="uuid">beb6d063-d147-4033-ae73-55ff95a48efa</entry>
Aug 01 18:30:11 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:30:11 user nova-compute[72150]:     </system>
Aug 01 18:30:11 user nova-compute[72150]:   </sysinfo>
Aug 01 18:30:11 user nova-compute[72150]:   <os>
Aug 01 18:30:11 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:30:11 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:30:11 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:30:11 user nova-compute[72150]:   </os>
Aug 01 18:30:11 user nova-compute[72150]:   <features>
Aug 01 18:30:11 user nova-compute[72150]:     <acpi/>
Aug 01 18:30:11 user nova-compute[72150]:     <apic/>
Aug 01 18:30:11 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:30:11 user nova-compute[72150]:   </features>
Aug 01 18:30:11 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:30:11 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:30:11 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:30:11 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:30:11 user nova-compute[72150]:   </clock>
Aug 01 18:30:11 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:30:11 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:30:11 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:30:11 user nova-compute[72150]:   </cpu>
Aug 01 18:30:11 user nova-compute[72150]:   <devices>
Aug 01 18:30:11 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:30:11 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:30:11 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/disk"/>
Aug 01 18:30:11 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:30:11 user nova-compute[72150]:     </disk>
Aug 01 18:30:11 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:30:11 user nova-compute[72150]:       <mac address="fa:16:3e:2d:d2:ae"/>
Aug 01 18:30:11 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:30:11 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:30:11 user nova-compute[72150]:       <target dev="tap486cf8af-74"/>
Aug 01 18:30:11 user nova-compute[72150]:     </interface>
Aug 01 18:30:11 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:30:11 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/console.log" append="off"/>
Aug 01 18:30:11 user nova-compute[72150]:     </serial>
Aug 01 18:30:11 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:30:11 user nova-compute[72150]:     <video>
Aug 01 18:30:11 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:30:11 user nova-compute[72150]:     </video>
Aug 01 18:30:11 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:30:11 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:30:11 user nova-compute[72150]:     </rng>
Aug 01 18:30:11 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:30:11 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:30:11 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:30:11 user nova-compute[72150]:     </memballoon>
Aug 01 18:30:11 user nova-compute[72150]:   </devices>
Aug 01 18:30:11 user nova-compute[72150]: </domain>
Aug 01 18:30:11 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1926720016',display_name='tempest-VolumesSnapshotTestJSON-instance-1926720016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1926720016',id=25,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFMMqXiT5VdBSIZ1X1VTO/nfV3xaz7Bt5y+1xCsEnyIwpxaVXzdxPIC2fAuTSaIxRzGP9nSznSOmDdYN+6wIfBjoXZgON82tXvp/RmqJ/SGT7VMj2NVh8t8VOjnFFOuUw==',key_name='tempest-keypair-233711911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5efbd504761845f88d59b78115119d62',ramdisk_id='',reservation_id='r-am7y01fr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-710086109',owner_user_name='tempest-VolumesSnapshotTestJSON-710086109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:30:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c975577646d746d192f038a3608d1f76',uuid=beb6d063-d147-4033-ae73-55ff95a48efa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "486cf8af-74cf-4a5c-8e58-159e7fd1a36c", "address": "fa:16:3e:2d:d2:ae", "network": {"id": "87bd2699-a52f-4b66-9d6c-fbf9fa54792d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1887490690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efbd504761845f88d59b78115119d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486cf8af-74", "ovs_interfaceid": "486cf8af-74cf-4a5c-8e58-159e7fd1a36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Converting VIF {"id": "486cf8af-74cf-4a5c-8e58-159e7fd1a36c", "address": "fa:16:3e:2d:d2:ae", "network": {"id": "87bd2699-a52f-4b66-9d6c-fbf9fa54792d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1887490690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efbd504761845f88d59b78115119d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486cf8af-74", "ovs_interfaceid": "486cf8af-74cf-4a5c-8e58-159e7fd1a36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=486cf8af-74cf-4a5c-8e58-159e7fd1a36c,network=Network(87bd2699-a52f-4b66-9d6c-fbf9fa54792d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap486cf8af-74') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG os_vif [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=486cf8af-74cf-4a5c-8e58-159e7fd1a36c,network=Network(87bd2699-a52f-4b66-9d6c-fbf9fa54792d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap486cf8af-74') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap486cf8af-74, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap486cf8af-74, col_values=(('external_ids', {'iface-id': '486cf8af-74cf-4a5c-8e58-159e7fd1a36c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:d2:ae', 'vm-uuid': 'beb6d063-d147-4033-ae73-55ff95a48efa'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:11 user nova-compute[72150]: INFO os_vif [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=486cf8af-74cf-4a5c-8e58-159e7fd1a36c,network=Network(87bd2699-a52f-4b66-9d6c-fbf9fa54792d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap486cf8af-74')
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] No VIF found with MAC fa:16:3e:2d:d2:ae, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.network.neutron [req-9ef53360-5c13-4609-a961-c61e657d560d req-3d5fed2a-b10c-40a2-b184-ef0b6875f090 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Updated VIF entry in instance network info cache for port 486cf8af-74cf-4a5c-8e58-159e7fd1a36c. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG nova.network.neutron [req-9ef53360-5c13-4609-a961-c61e657d560d req-3d5fed2a-b10c-40a2-b184-ef0b6875f090 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Updating instance_info_cache with network_info: [{"id": "486cf8af-74cf-4a5c-8e58-159e7fd1a36c", "address": "fa:16:3e:2d:d2:ae", "network": {"id": "87bd2699-a52f-4b66-9d6c-fbf9fa54792d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1887490690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efbd504761845f88d59b78115119d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486cf8af-74", "ovs_interfaceid": "486cf8af-74cf-4a5c-8e58-159e7fd1a36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:30:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9ef53360-5c13-4609-a961-c61e657d560d req-3d5fed2a-b10c-40a2-b184-ef0b6875f090 service nova] Releasing lock "refresh_cache-beb6d063-d147-4033-ae73-55ff95a48efa" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:30:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:12 user nova-compute[72150]: DEBUG nova.compute.manager [req-183715f6-623c-4f25-a3f1-939b0f444059 req-1aced61e-fd93-4cbb-931b-8b3b3e0a4e24 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Received event network-vif-plugged-486cf8af-74cf-4a5c-8e58-159e7fd1a36c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:30:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-183715f6-623c-4f25-a3f1-939b0f444059 req-1aced61e-fd93-4cbb-931b-8b3b3e0a4e24 service nova] Acquiring lock "beb6d063-d147-4033-ae73-55ff95a48efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-183715f6-623c-4f25-a3f1-939b0f444059 req-1aced61e-fd93-4cbb-931b-8b3b3e0a4e24 service nova] Lock "beb6d063-d147-4033-ae73-55ff95a48efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-183715f6-623c-4f25-a3f1-939b0f444059 req-1aced61e-fd93-4cbb-931b-8b3b3e0a4e24 service nova] Lock "beb6d063-d147-4033-ae73-55ff95a48efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:12 user nova-compute[72150]: DEBUG nova.compute.manager [req-183715f6-623c-4f25-a3f1-939b0f444059 req-1aced61e-fd93-4cbb-931b-8b3b3e0a4e24 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] No waiting events found dispatching network-vif-plugged-486cf8af-74cf-4a5c-8e58-159e7fd1a36c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:30:12 user nova-compute[72150]: WARNING nova.compute.manager [req-183715f6-623c-4f25-a3f1-939b0f444059 req-1aced61e-fd93-4cbb-931b-8b3b3e0a4e24 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Received unexpected event network-vif-plugged-486cf8af-74cf-4a5c-8e58-159e7fd1a36c for instance with vm_state building and task_state spawning.
Aug 01 18:30:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:14 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914614.6813617, beb6d063-d147-4033-ae73-55ff95a48efa => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:30:14 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] VM Resumed (Lifecycle Event)
Aug 01 18:30:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:30:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:30:14 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Instance spawned successfully.
Aug 01 18:30:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:30:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:30:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:30:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:30:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:30:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:30:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:30:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:30:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:30:14 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:30:14 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914614.683154, beb6d063-d147-4033-ae73-55ff95a48efa => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:30:14 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] VM Started (Lifecycle Event)
Aug 01 18:30:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:30:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:30:14 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:30:14 user nova-compute[72150]: INFO nova.compute.manager [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Took 5.57 seconds to spawn the instance on the hypervisor.
Aug 01 18:30:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:30:14 user nova-compute[72150]: DEBUG nova.compute.manager [req-953176fb-139e-4a25-9bce-0bc8e2f60689 req-53386e2d-0349-455e-97dc-5641486a16c0 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Received event network-vif-plugged-486cf8af-74cf-4a5c-8e58-159e7fd1a36c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:30:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-953176fb-139e-4a25-9bce-0bc8e2f60689 req-53386e2d-0349-455e-97dc-5641486a16c0 service nova] Acquiring lock "beb6d063-d147-4033-ae73-55ff95a48efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-953176fb-139e-4a25-9bce-0bc8e2f60689 req-53386e2d-0349-455e-97dc-5641486a16c0 service nova] Lock "beb6d063-d147-4033-ae73-55ff95a48efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-953176fb-139e-4a25-9bce-0bc8e2f60689 req-53386e2d-0349-455e-97dc-5641486a16c0 service nova] Lock "beb6d063-d147-4033-ae73-55ff95a48efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:14 user nova-compute[72150]: DEBUG nova.compute.manager [req-953176fb-139e-4a25-9bce-0bc8e2f60689 req-53386e2d-0349-455e-97dc-5641486a16c0 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] No waiting events found dispatching network-vif-plugged-486cf8af-74cf-4a5c-8e58-159e7fd1a36c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:30:14 user nova-compute[72150]: WARNING nova.compute.manager [req-953176fb-139e-4a25-9bce-0bc8e2f60689 req-53386e2d-0349-455e-97dc-5641486a16c0 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Received unexpected event network-vif-plugged-486cf8af-74cf-4a5c-8e58-159e7fd1a36c for instance with vm_state active and task_state None.
Aug 01 18:30:14 user nova-compute[72150]: INFO nova.compute.manager [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Took 6.36 seconds to build instance.
Aug 01 18:30:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-577815ec-1651-42b9-b25e-c58eff12d110 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "beb6d063-d147-4033-ae73-55ff95a48efa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.474s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:30:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:30:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:30:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:30:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:31 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:30:32 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:30:33 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:30:33 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:30:33 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:30:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:33 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:30:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a50fb967-36ed-4266-bf10-66606dd64320/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:35 user nova-compute[72150]: DEBUG nova.objects.instance [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lazy-loading 'flavor' on Instance uuid bf2d1f14-2227-41d1-bd73-a05ab3149aba {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:30:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a50fb967-36ed-4266-bf10-66606dd64320/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a50fb967-36ed-4266-bf10-66606dd64320/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a50fb967-36ed-4266-bf10-66606dd64320/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:36 user nova-compute[72150]: INFO nova.compute.manager [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Attaching volume a4f14ea5-97f3-4c69-8f61-d956809a15d5 to /dev/vdb
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG os_brick.utils [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3db6f3-065a-4a5f-a533-a9c9a59c2656]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f9f211-e26a-4a28-aed0-0349e17dd6f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd452fe-c0e1-40ea-b84f-8f34e5d49ab1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[eead76cb-0abb-4f1b-bc16-af54846be84c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:30:36 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76ac58b-7129-4146-8945-1630d8c97e99]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG os_brick.utils [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Updating existing volume attachment record: 4f561721-d086-4f3b-8606-2851be99bfdd {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:30:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:38 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:30:38 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:30:38 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=7017MB free_disk=25.432838439941406GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:30:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:38 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 769690c8-53c5-4057-88a5-fbdbcb930e32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:30:38 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ea68420b-8362-4df3-b710-cd1cf76adba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:30:38 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance bcbfca8c-8bdb-47d2-addc-e1cec3166dc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:30:38 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 08851ec4-6f71-4ec1-a092-42aab83ee87f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:30:38 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance bf2d1f14-2227-41d1-bd73-a05ab3149aba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:30:38 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance a5f0eca7-d060-4226-b36e-a3cd15b15703 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:30:38 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ceee3912-ca68-4b15-8fe6-985d905e8128 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:30:38 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance a50fb967-36ed-4266-bf10-66606dd64320 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:30:38 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 441a61de-ad9d-412d-95f3-882cef273e88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:30:38 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 42e75a98-beb1-4688-a375-affc63b14252 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:30:38 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 1de0ad54-0d7a-4287-9532-7b4982b1e2bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:30:38 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance eb113972-7a86-4cb7-9f8d-ca690693e27d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:30:38 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance beb6d063-d147-4033-ae73-55ff95a48efa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:30:38 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:30:38 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:30:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:39 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:30:39 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:30:39 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:30:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.610s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:40 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:30:40 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:30:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:30:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:30:40 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:30:41 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Updating instance_info_cache with network_info: [{"id": "242e141b-d5fa-4e86-82ae-26b993342476", "address": "fa:16:3e:26:8b:9c", "network": {"id": "633e7e89-16a6-4a46-8d94-0a1cc6891579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211447573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41181268f4754733811b1abdad7eeb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242e141b-d5", "ovs_interfaceid": "242e141b-d5fa-4e86-82ae-26b993342476", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:30:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:30:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:30:41 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:30:41 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:30:41 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:30:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:30:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:30:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PGUlJqzL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:30:43 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:30:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:30:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:30:43 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:30:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:30:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:30:43 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:30:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "a50fb967-36ed-4266-bf10-66606dd64320" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "a50fb967-36ed-4266-bf10-66606dd64320" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "a50fb967-36ed-4266-bf10-66606dd64320-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "a50fb967-36ed-4266-bf10-66606dd64320-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "a50fb967-36ed-4266-bf10-66606dd64320-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:43 user nova-compute[72150]: INFO nova.compute.manager [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Terminating instance
Aug 01 18:30:43 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:30:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78b3a08-60a1-4eab-bc83-a324d610d46e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:30:43 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:30:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[926c5ecb-460f-4267-87b0-d7670c0fc9e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5] added
Aug 01 18:30:44 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a66fcb8-5fcf-4f69-9272-5af7c538e3b4]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb621a4-cc8b-4edd-8ff0-1f9fc8f629df]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PGUlJqzL {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PGUlJqzL" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8b73cf-a716-47d7-86f5-f16972527966]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PGUlJqzL'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da2dd0d-8482-4c7d-9fa8-aca9bc791234]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dda57a-f903-4a57-8b9b-2d55725d8492]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:30:44 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:30:44 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:30:44 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:30:44 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1484ba-2bff-4732-9189-7467b6c299b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5, portal: 172.16.0.220,3260]
Aug 01 18:30:44 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5, portal: 172.16.0.220,3260] successful.
Aug 01 18:30:44 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d886a4c-4d07-4ec2-9547-eb05f0009105]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4749813-13df-4b1b-9585-8db735359d4d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:30:44 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:30:44 user nova-compute[72150]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:30:44 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:30:44 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:30:44 user nova-compute[72150]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:30:44 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef880c6a-bc87-4865-9500-1ad68128caf5]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PGUlJqzL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-b6b583a0-038d-4832-970c-09dd2cc35184 req-5674737c-5662-458a-ab7c-44a3920538e3 service nova] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Received event network-vif-unplugged-7c67dc1c-6443-4e87-b055-6103231fd3b0 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b6b583a0-038d-4832-970c-09dd2cc35184 req-5674737c-5662-458a-ab7c-44a3920538e3 service nova] Acquiring lock "a50fb967-36ed-4266-bf10-66606dd64320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b6b583a0-038d-4832-970c-09dd2cc35184 req-5674737c-5662-458a-ab7c-44a3920538e3 service nova] Lock "a50fb967-36ed-4266-bf10-66606dd64320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b6b583a0-038d-4832-970c-09dd2cc35184 req-5674737c-5662-458a-ab7c-44a3920538e3 service nova] Lock "a50fb967-36ed-4266-bf10-66606dd64320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-b6b583a0-038d-4832-970c-09dd2cc35184 req-5674737c-5662-458a-ab7c-44a3920538e3 service nova] [instance: a50fb967-36ed-4266-bf10-66606dd64320] No waiting events found dispatching network-vif-unplugged-7c67dc1c-6443-4e87-b055-6103231fd3b0 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-b6b583a0-038d-4832-970c-09dd2cc35184 req-5674737c-5662-458a-ab7c-44a3920538e3 service nova] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Received event network-vif-unplugged-7c67dc1c-6443-4e87-b055-6103231fd3b0 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:30:44 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Instance destroyed successfully.
Aug 01 18:30:44 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lazy-loading 'resources' on Instance uuid a50fb967-36ed-4266-bf10-66606dd64320 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:28:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1838942122',display_name='tempest-VolumesAdminNegativeTest-server-1838942122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1838942122',id=20,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:28:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41181268f4754733811b1abdad7eeb21',ramdisk_id='',reservation_id='r-o1dafsdk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-38137380',owner_user_name='tempest-VolumesAdminNegativeTest-38137380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:28:52Z,user_data=None,user_id='8264f17490ec46638cf38187aab3ce4c',uuid=a50fb967-36ed-4266-bf10-66606dd64320,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c67dc1c-6443-4e87-b055-6103231fd3b0", "address": "fa:16:3e:36:79:d5", "network": {"id": "633e7e89-16a6-4a46-8d94-0a1cc6891579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211447573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41181268f4754733811b1abdad7eeb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c67dc1c-64", "ovs_interfaceid": "7c67dc1c-6443-4e87-b055-6103231fd3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Converting VIF {"id": "7c67dc1c-6443-4e87-b055-6103231fd3b0", "address": "fa:16:3e:36:79:d5", "network": {"id": "633e7e89-16a6-4a46-8d94-0a1cc6891579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211447573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41181268f4754733811b1abdad7eeb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c67dc1c-64", "ovs_interfaceid": "7c67dc1c-6443-4e87-b055-6103231fd3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:79:d5,bridge_name='br-int',has_traffic_filtering=True,id=7c67dc1c-6443-4e87-b055-6103231fd3b0,network=Network(633e7e89-16a6-4a46-8d94-0a1cc6891579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c67dc1c-64') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG os_vif [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:79:d5,bridge_name='br-int',has_traffic_filtering=True,id=7c67dc1c-6443-4e87-b055-6103231fd3b0,network=Network(633e7e89-16a6-4a46-8d94-0a1cc6891579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c67dc1c-64') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c67dc1c-64, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:44 user nova-compute[72150]: INFO os_vif [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:79:d5,bridge_name='br-int',has_traffic_filtering=True,id=7c67dc1c-6443-4e87-b055-6103231fd3b0,network=Network(633e7e89-16a6-4a46-8d94-0a1cc6891579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c67dc1c-64')
Aug 01 18:30:44 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Deleting instance files /opt/stack/data/nova/instances/a50fb967-36ed-4266-bf10-66606dd64320_del
Aug 01 18:30:44 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Deletion of /opt/stack/data/nova/instances/a50fb967-36ed-4266-bf10-66606dd64320_del complete
Aug 01 18:30:44 user nova-compute[72150]: INFO nova.compute.manager [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 01 18:30:44 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: a50fb967-36ed-4266-bf10-66606dd64320] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:30:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:45 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:30:45 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Took 0.57 seconds to deallocate network for instance.
Aug 01 18:30:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-91c06325-c3f6-47c9-99e9-8c2872ddbe7b req-f683dbd7-6f86-4b56-a493-a22bc5a70c0b service nova] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Received event network-vif-deleted-7c67dc1c-6443-4e87-b055-6103231fd3b0 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:30:45 user nova-compute[72150]: INFO nova.compute.manager [req-91c06325-c3f6-47c9-99e9-8c2872ddbe7b req-f683dbd7-6f86-4b56-a493-a22bc5a70c0b service nova] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Neutron deleted interface 7c67dc1c-6443-4e87-b055-6103231fd3b0; detaching it from the instance and deleting it from the info cache
Aug 01 18:30:45 user nova-compute[72150]: DEBUG nova.network.neutron [req-91c06325-c3f6-47c9-99e9-8c2872ddbe7b req-f683dbd7-6f86-4b56-a493-a22bc5a70c0b service nova] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:30:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-91c06325-c3f6-47c9-99e9-8c2872ddbe7b req-f683dbd7-6f86-4b56-a493-a22bc5a70c0b service nova] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Detach interface failed, port_id=7c67dc1c-6443-4e87-b055-6103231fd3b0, reason: Instance a50fb967-36ed-4266-bf10-66606dd64320 could not be found. {{(pid=72150) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 18:30:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:30:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23832353932303736', 'path': '/dev/sdd'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:30:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832353932303736', 'path': '/dev/sdd'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:30:45 user nova-compute[72150]: DEBUG nova.objects.instance [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lazy-loading 'flavor' on Instance uuid bf2d1f14-2227-41d1-bd73-a05ab3149aba {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:30:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:30:45 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:30:45 user nova-compute[72150]:   <source dev="/dev/sdd"/>
Aug 01 18:30:45 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:30:45 user nova-compute[72150]:   <serial>a4f14ea5-97f3-4c69-8f61-d956809a15d5</serial>
Aug 01 18:30:45 user nova-compute[72150]: </disk>
Aug 01 18:30:45 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:30:45 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:30:45 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:30:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:45 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Deleted allocations for instance a50fb967-36ed-4266-bf10-66606dd64320
Aug 01 18:30:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:30:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:30:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] No VIF found with MAC fa:16:3e:63:c8:50, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:30:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9778458d-6b92-4ba2-b569-af3ae63a1611 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "a50fb967-36ed-4266-bf10-66606dd64320" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.885s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5bede133-017a-4c49-8df8-b920b0c1a843 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.900s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:46 user nova-compute[72150]: DEBUG nova.compute.manager [req-c47ff5df-571a-40a7-8065-882a8659c362 req-17c401a5-4d95-41cb-93a8-1075727b1936 service nova] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Received event network-vif-plugged-7c67dc1c-6443-4e87-b055-6103231fd3b0 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:30:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c47ff5df-571a-40a7-8065-882a8659c362 req-17c401a5-4d95-41cb-93a8-1075727b1936 service nova] Acquiring lock "a50fb967-36ed-4266-bf10-66606dd64320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c47ff5df-571a-40a7-8065-882a8659c362 req-17c401a5-4d95-41cb-93a8-1075727b1936 service nova] Lock "a50fb967-36ed-4266-bf10-66606dd64320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c47ff5df-571a-40a7-8065-882a8659c362 req-17c401a5-4d95-41cb-93a8-1075727b1936 service nova] Lock "a50fb967-36ed-4266-bf10-66606dd64320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:46 user nova-compute[72150]: DEBUG nova.compute.manager [req-c47ff5df-571a-40a7-8065-882a8659c362 req-17c401a5-4d95-41cb-93a8-1075727b1936 service nova] [instance: a50fb967-36ed-4266-bf10-66606dd64320] No waiting events found dispatching network-vif-plugged-7c67dc1c-6443-4e87-b055-6103231fd3b0 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:30:46 user nova-compute[72150]: WARNING nova.compute.manager [req-c47ff5df-571a-40a7-8065-882a8659c362 req-17c401a5-4d95-41cb-93a8-1075727b1936 service nova] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Received unexpected event network-vif-plugged-7c67dc1c-6443-4e87-b055-6103231fd3b0 for instance with vm_state deleted and task_state None.
Aug 01 18:30:47 user nova-compute[72150]: INFO nova.compute.manager [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Rebuilding instance
Aug 01 18:30:47 user nova-compute[72150]: DEBUG nova.objects.instance [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lazy-loading 'trusted_certs' on Instance uuid bf2d1f14-2227-41d1-bd73-a05ab3149aba {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:30:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:30:47 user nova-compute[72150]: DEBUG nova.objects.instance [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lazy-loading 'pci_requests' on Instance uuid bf2d1f14-2227-41d1-bd73-a05ab3149aba {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:30:47 user nova-compute[72150]: DEBUG nova.objects.instance [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lazy-loading 'pci_devices' on Instance uuid bf2d1f14-2227-41d1-bd73-a05ab3149aba {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:30:47 user nova-compute[72150]: DEBUG nova.objects.instance [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lazy-loading 'resources' on Instance uuid bf2d1f14-2227-41d1-bd73-a05ab3149aba {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:30:47 user nova-compute[72150]: DEBUG nova.objects.instance [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lazy-loading 'migration_context' on Instance uuid bf2d1f14-2227-41d1-bd73-a05ab3149aba {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:30:47 user nova-compute[72150]: DEBUG nova.objects.instance [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72150) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 18:30:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-a121d7f1-34f3-49c5-a3f6-9a7e3a811dd0 req-14dd1e88-5fe4-4fbd-8c5f-0b64324ce041 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Received event network-vif-unplugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:30:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a121d7f1-34f3-49c5-a3f6-9a7e3a811dd0 req-14dd1e88-5fe4-4fbd-8c5f-0b64324ce041 service nova] Acquiring lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a121d7f1-34f3-49c5-a3f6-9a7e3a811dd0 req-14dd1e88-5fe4-4fbd-8c5f-0b64324ce041 service nova] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a121d7f1-34f3-49c5-a3f6-9a7e3a811dd0 req-14dd1e88-5fe4-4fbd-8c5f-0b64324ce041 service nova] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-a121d7f1-34f3-49c5-a3f6-9a7e3a811dd0 req-14dd1e88-5fe4-4fbd-8c5f-0b64324ce041 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] No waiting events found dispatching network-vif-unplugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:30:47 user nova-compute[72150]: WARNING nova.compute.manager [req-a121d7f1-34f3-49c5-a3f6-9a7e3a811dd0 req-14dd1e88-5fe4-4fbd-8c5f-0b64324ce041 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Received unexpected event network-vif-unplugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 for instance with vm_state active and task_state rebuilding.
Aug 01 18:30:48 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Instance destroyed successfully.
Aug 01 18:30:48 user nova-compute[72150]: INFO nova.compute.manager [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Detaching volume a4f14ea5-97f3-4c69-8f61-d956809a15d5
Aug 01 18:30:48 user nova-compute[72150]: INFO nova.virt.block_device [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Attempting to driver detach volume a4f14ea5-97f3-4c69-8f61-d956809a15d5 from mountpoint /dev/vdb
Aug 01 18:30:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Attempting to detach device vdb from instance bf2d1f14-2227-41d1-bd73-a05ab3149aba from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:30:48 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:30:48 user nova-compute[72150]:   <source dev="/dev/sdd"/>
Aug 01 18:30:48 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:30:48 user nova-compute[72150]:   <serial>a4f14ea5-97f3-4c69-8f61-d956809a15d5</serial>
Aug 01 18:30:48 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:30:48 user nova-compute[72150]: </disk>
Aug 01 18:30:48 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:30:48 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Successfully detached device vdb from instance bf2d1f14-2227-41d1-bd73-a05ab3149aba from the persistent domain config.
Aug 01 18:30:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PGUlJqzL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:30:48 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 18:30:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e8ac32-d5f8-4f34-be8f-b2a38591fef6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0936dc-0839-498f-a707-392f267975d4]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:30:48 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:30:48 user nova-compute[72150]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:30:48 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:30:48 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:30:48 user nova-compute[72150]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:30:48 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c41c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5'): ({'sdd'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Removing single pathed devices sdd {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79cffe6-593a-4cc4-af8b-f5c986db4107]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4b87b2-e193-43e1-af2f-3da9c70123d3]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Flushing IO for device /dev/sdd {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9b21b5-1850-43ca-94c0-1a477cfd5903]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0fa2d0-6dee-4aa0-9f68-8367d3c04093]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] SCSI volumes sdd have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9455dc5-7c4d-4457-992c-0ab1af3fb727]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b86446-dea1-4214-9cd0-7a16c19dbed4]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5, portal: 172.16.0.220,3260]
Aug 01 18:30:48 user nova-compute[72150]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5, portal: 172.16.0.220,3260] successful.
Aug 01 18:30:48 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57afc30-fbbf-4606-b061-0530cbfc8354]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] <== disconnect_volume: return (278ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:30:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:49 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Instance destroyed successfully.
Aug 01 18:30:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-301869653',display_name='tempest-ServerActionsTestOtherA-server-1812214243',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-301869653',id=17,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJY2FlDJuzmLBeUAuDA5wUSU2UHRGDTZlkebFFQy7IaCc3RvIIFGPPP6kDQA5KkLRYt2dsIc0CUwBhPl2TFzcR9udfpfPek2FdJAmKOoaMyPBsGZqlWc4+qDiA+nCRd2Q==',key_name='tempest-keypair-605536790',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:26:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1c393fdc0b774cd8a6208200011ba16b',ramdisk_id='',reservation_id='r-djtbnitg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-993571413',owner_user_name='tempest-ServerActionsTestOtherA-993571413-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9470bee775394bf5a3368d27b64911cb',uuid=bf2d1f14-2227-41d1-bd73-a05ab3149aba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "address": "fa:16:3e:63:c8:50", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41eb682d-9c", "ovs_interfaceid": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converting VIF {"id": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "address": "fa:16:3e:63:c8:50", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41eb682d-9c", "ovs_interfaceid": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=41eb682d-9c56-46b8-bd1d-b479d120b8a1,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41eb682d-9c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG os_vif [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=41eb682d-9c56-46b8-bd1d-b479d120b8a1,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41eb682d-9c') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41eb682d-9c, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:49 user nova-compute[72150]: INFO os_vif [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=41eb682d-9c56-46b8-bd1d-b479d120b8a1,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41eb682d-9c')
Aug 01 18:30:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PGUlJqzL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:30:49 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 18:30:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[000b5d23-d976-42e0-8d42-08b7df918bbf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ba3e11-7cbc-45e1-8237-65d0a659fffb]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:30:49 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:30:49 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:30:49 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:30:49 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec565ea0>, {}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Disconnecting from: [] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.049s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] <== disconnect_volume: return (51ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:30:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:30:49 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Deleting instance files /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba_del
Aug 01 18:30:49 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Deletion of /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba_del complete
Aug 01 18:30:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-5b235d29-abba-470e-8496-2b9ed1b141e4 req-e5afe4cb-f84a-43ea-ba69-fc1cb8ec9fa8 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Received event network-vif-plugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b235d29-abba-470e-8496-2b9ed1b141e4 req-e5afe4cb-f84a-43ea-ba69-fc1cb8ec9fa8 service nova] Acquiring lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b235d29-abba-470e-8496-2b9ed1b141e4 req-e5afe4cb-f84a-43ea-ba69-fc1cb8ec9fa8 service nova] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b235d29-abba-470e-8496-2b9ed1b141e4 req-e5afe4cb-f84a-43ea-ba69-fc1cb8ec9fa8 service nova] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-5b235d29-abba-470e-8496-2b9ed1b141e4 req-e5afe4cb-f84a-43ea-ba69-fc1cb8ec9fa8 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] No waiting events found dispatching network-vif-plugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:30:50 user nova-compute[72150]: WARNING nova.compute.manager [req-5b235d29-abba-470e-8496-2b9ed1b141e4 req-e5afe4cb-f84a-43ea-ba69-fc1cb8ec9fa8 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Received unexpected event network-vif-plugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 for instance with vm_state active and task_state rebuilding.
Aug 01 18:30:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-5b235d29-abba-470e-8496-2b9ed1b141e4 req-e5afe4cb-f84a-43ea-ba69-fc1cb8ec9fa8 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Received event network-changed-9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-5b235d29-abba-470e-8496-2b9ed1b141e4 req-e5afe4cb-f84a-43ea-ba69-fc1cb8ec9fa8 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Refreshing instance network info cache due to event network-changed-9c02fc93-434e-4e02-8855-14348e691115. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b235d29-abba-470e-8496-2b9ed1b141e4 req-e5afe4cb-f84a-43ea-ba69-fc1cb8ec9fa8 service nova] Acquiring lock "refresh_cache-441a61de-ad9d-412d-95f3-882cef273e88" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b235d29-abba-470e-8496-2b9ed1b141e4 req-e5afe4cb-f84a-43ea-ba69-fc1cb8ec9fa8 service nova] Acquired lock "refresh_cache-441a61de-ad9d-412d-95f3-882cef273e88" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG nova.network.neutron [req-5b235d29-abba-470e-8496-2b9ed1b141e4 req-e5afe4cb-f84a-43ea-ba69-fc1cb8ec9fa8 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Refreshing network info cache for port 9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:30:50 user nova-compute[72150]: INFO nova.virt.block_device [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Booting with volume a4f14ea5-97f3-4c69-8f61-d956809a15d5 at /dev/vdb
Aug 01 18:30:50 user nova-compute[72150]: DEBUG os_brick.utils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d841b82c-f2f9-4b64-b32c-155eac0347d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9016b52-e5b6-4795-80e0-d4e5d522c073]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9404665-2d8f-47ee-a790-744d53c69550]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a29dbb-eee8-472a-b6c6-41fd2efc40e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:30:50 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:30:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f19f72-9c4e-4d00-8604-e0fb558154dd]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG os_brick.utils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Updating existing volume attachment record: c28587bc-e180-4625-bb5f-e40e653d3aa0 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG nova.network.neutron [req-5b235d29-abba-470e-8496-2b9ed1b141e4 req-e5afe4cb-f84a-43ea-ba69-fc1cb8ec9fa8 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Updated VIF entry in instance network info cache for port 9c02fc93-434e-4e02-8855-14348e691115. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG nova.network.neutron [req-5b235d29-abba-470e-8496-2b9ed1b141e4 req-e5afe4cb-f84a-43ea-ba69-fc1cb8ec9fa8 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Updating instance_info_cache with network_info: [{"id": "9c02fc93-434e-4e02-8855-14348e691115", "address": "fa:16:3e:ba:5c:56", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c02fc93-43", "ovs_interfaceid": "9c02fc93-434e-4e02-8855-14348e691115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:30:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b235d29-abba-470e-8496-2b9ed1b141e4 req-e5afe4cb-f84a-43ea-ba69-fc1cb8ec9fa8 service nova] Releasing lock "refresh_cache-441a61de-ad9d-412d-95f3-882cef273e88" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:30:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "441a61de-ad9d-412d-95f3-882cef273e88" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "441a61de-ad9d-412d-95f3-882cef273e88" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:53 user nova-compute[72150]: INFO nova.compute.manager [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Shelving
Aug 01 18:30:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:54 user nova-compute[72150]: DEBUG nova.compute.manager [req-65b61f19-2e5e-4111-a780-457f25a9c8df req-bfdcf354-f8b4-4088-9db4-815d48a0a11a service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Received event network-vif-unplugged-9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:30:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-65b61f19-2e5e-4111-a780-457f25a9c8df req-bfdcf354-f8b4-4088-9db4-815d48a0a11a service nova] Acquiring lock "441a61de-ad9d-412d-95f3-882cef273e88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-65b61f19-2e5e-4111-a780-457f25a9c8df req-bfdcf354-f8b4-4088-9db4-815d48a0a11a service nova] Lock "441a61de-ad9d-412d-95f3-882cef273e88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-65b61f19-2e5e-4111-a780-457f25a9c8df req-bfdcf354-f8b4-4088-9db4-815d48a0a11a service nova] Lock "441a61de-ad9d-412d-95f3-882cef273e88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:54 user nova-compute[72150]: DEBUG nova.compute.manager [req-65b61f19-2e5e-4111-a780-457f25a9c8df req-bfdcf354-f8b4-4088-9db4-815d48a0a11a service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] No waiting events found dispatching network-vif-unplugged-9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:30:54 user nova-compute[72150]: WARNING nova.compute.manager [req-65b61f19-2e5e-4111-a780-457f25a9c8df req-bfdcf354-f8b4-4088-9db4-815d48a0a11a service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Received unexpected event network-vif-unplugged-9c02fc93-434e-4e02-8855-14348e691115 for instance with vm_state active and task_state shelving.
Aug 01 18:30:54 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Instance destroyed successfully.
Aug 01 18:30:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:54 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Beginning cold snapshot process
Aug 01 18:30:54 user nova-compute[72150]: DEBUG nova.privsep.utils [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72150) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 18:30:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk /opt/stack/data/nova/instances/snapshots/tmpm99v9d34/547acc9f35bd4d3683b152e5de73520e {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk /opt/stack/data/nova/instances/snapshots/tmpm99v9d34/547acc9f35bd4d3683b152e5de73520e" returned: 0 in 0.578s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:55 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Snapshot extracted, beginning image upload
Aug 01 18:30:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-cea15f29-714d-4dc0-81f9-848fad6a0bf9 req-dd76b930-e5b2-4f39-8fce-139b27c4dc4e service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Received event network-vif-plugged-9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:30:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-cea15f29-714d-4dc0-81f9-848fad6a0bf9 req-dd76b930-e5b2-4f39-8fce-139b27c4dc4e service nova] Acquiring lock "441a61de-ad9d-412d-95f3-882cef273e88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-cea15f29-714d-4dc0-81f9-848fad6a0bf9 req-dd76b930-e5b2-4f39-8fce-139b27c4dc4e service nova] Lock "441a61de-ad9d-412d-95f3-882cef273e88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-cea15f29-714d-4dc0-81f9-848fad6a0bf9 req-dd76b930-e5b2-4f39-8fce-139b27c4dc4e service nova] Lock "441a61de-ad9d-412d-95f3-882cef273e88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-cea15f29-714d-4dc0-81f9-848fad6a0bf9 req-dd76b930-e5b2-4f39-8fce-139b27c4dc4e service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] No waiting events found dispatching network-vif-plugged-9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:30:56 user nova-compute[72150]: WARNING nova.compute.manager [req-cea15f29-714d-4dc0-81f9-848fad6a0bf9 req-dd76b930-e5b2-4f39-8fce-139b27c4dc4e service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Received unexpected event network-vif-plugged-9c02fc93-434e-4e02-8855-14348e691115 for instance with vm_state active and task_state shelving_image_uploading.
Aug 01 18:30:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "a5f0eca7-d060-4226-b36e-a3cd15b15703" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG nova.objects.instance [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lazy-loading 'flavor' on Instance uuid a5f0eca7-d060-4226-b36e-a3cd15b15703 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "a5f0eca7-d060-4226-b36e-a3cd15b15703" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:57 user nova-compute[72150]: INFO nova.compute.manager [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Attaching volume db690b5a-dd50-4971-9f5b-486fad1b1834 to /dev/vdb
Aug 01 18:30:57 user nova-compute[72150]: DEBUG os_brick.utils [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44fb0c0-c54c-41f3-9b43-92f2e36dc22a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[64131438-e249-485b-b8f5-486cb5706b71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd844ef7-e2cf-4dd8-ad8c-8ac009473ae6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4209bba5-03ae-43f4-97d1-7712a1164ac7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:30:57 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:30:57 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33cfd54-231f-4d84-942d-553066aa016e]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG os_brick.utils [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Updating existing volume attachment record: 8c1fa3e7-f45c-49dc-ac4a-69a8afd7913b {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:30:57 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Snapshot image upload complete
Aug 01 18:30:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:30:57 user nova-compute[72150]: INFO nova.compute.manager [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Shelve offloading
Aug 01 18:30:57 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Instance destroyed successfully.
Aug 01 18:30:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "refresh_cache-441a61de-ad9d-412d-95f3-882cef273e88" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquired lock "refresh_cache-441a61de-ad9d-412d-95f3-882cef273e88" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:30:57 user nova-compute[72150]: DEBUG nova.network.neutron [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:30:58 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Creating image(s)
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "/opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "/opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.134s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.network.neutron [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Updating instance_info_cache with network_info: [{"id": "9c02fc93-434e-4e02-8855-14348e691115", "address": "fa:16:3e:ba:5c:56", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c02fc93-43", "ovs_interfaceid": "9c02fc93-434e-4e02-8855-14348e691115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Releasing lock "refresh_cache-441a61de-ad9d-412d-95f3-882cef273e88" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.178s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk 1073741824" returned: 0 in 0.052s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.172s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Cannot resize image /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Ensure instance console log exists: /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Start _get_guest_xml network_info=[{"id": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "address": "fa:16:3e:63:c8:50", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41eb682d-9c", "ovs_interfaceid": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c28587bc-e180-4625-bb5f-e40e653d3aa0', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PGUlJqzL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bf2d1f14-2227-41d1-bd73-a05ab3149aba', 'attached_at': '', 'detached_at': '', 'volume_id': 'a4f14ea5-97f3-4c69-8f61-d956809a15d5', 'serial': 'a4f14ea5-97f3-4c69-8f61-d956809a15d5'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:30:58 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 18:30:58 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.objects.instance [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lazy-loading 'vcpu_model' on Instance uuid bf2d1f14-2227-41d1-bd73-a05ab3149aba {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PGUlJqzL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:30:58 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 18:30:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:30:58 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 18:30:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:30:58 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b294ea9-244b-46d8-a2d7-12098b4dfb19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:30:58 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:30:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.281s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71748ab-e680-4e2c-8aa3-1b61d17fb5af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5] added
Aug 01 18:30:59 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-08dba670-853a-44f6-b2ae-4c5332c37c97 req-c2bfeccd-c911-4137-a677-e5dd574cb785 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Received event network-changed-9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-08dba670-853a-44f6-b2ae-4c5332c37c97 req-c2bfeccd-c911-4137-a677-e5dd574cb785 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Refreshing instance network info cache due to event network-changed-9c02fc93-434e-4e02-8855-14348e691115. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08dba670-853a-44f6-b2ae-4c5332c37c97 req-c2bfeccd-c911-4137-a677-e5dd574cb785 service nova] Acquiring lock "refresh_cache-441a61de-ad9d-412d-95f3-882cef273e88" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08dba670-853a-44f6-b2ae-4c5332c37c97 req-c2bfeccd-c911-4137-a677-e5dd574cb785 service nova] Acquired lock "refresh_cache-441a61de-ad9d-412d-95f3-882cef273e88" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG nova.network.neutron [req-08dba670-853a-44f6-b2ae-4c5332c37c97 req-c2bfeccd-c911-4137-a677-e5dd574cb785 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Refreshing network info cache for port 9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7547ac57-d7f8-46e7-86bd-b3f1f2eaf160]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:59 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Instance destroyed successfully.
Aug 01 18:30:59 user nova-compute[72150]: DEBUG nova.objects.instance [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'resources' on Instance uuid 441a61de-ad9d-412d-95f3-882cef273e88 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbec14d-bd96-4704-9864-962b3d958bec]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PGUlJqzL {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:28:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1473327332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1473327332',id=21,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWQMZQX2D/HQW8cg/YsV/NE/LRrdrO+ZwZNwgE1ATaVLlle4kzRuW5pJKzece0RgDQ87aRWUqjcNBY/DtyoPUj7uXTkdjNjIryRHAPyMBeR9HCitjxLaKFcLOHTGnSeiw==',key_name='tempest-keypair-1274630906',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:29:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='493923414b464384bb3a1ce3e6f7a2f0',ramdisk_id='',reservation_id='r-hphvdvst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849821930',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849821930-project-member',shelved_at='2023-08-01T18:30:57.776832',shelved_host='user',shelved_image_id='a6a8d0c9-37b2-45d3-aed3-b93d23058d78'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:30:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5804d69f9f18482f9fe0e0d4d73c4e92',uuid=441a61de-ad9d-412d-95f3-882cef273e88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "9c02fc93-434e-4e02-8855-14348e691115", "address": "fa:16:3e:ba:5c:56", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c02fc93-43", "ovs_interfaceid": "9c02fc93-434e-4e02-8855-14348e691115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converting VIF {"id": "9c02fc93-434e-4e02-8855-14348e691115", "address": "fa:16:3e:ba:5c:56", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c02fc93-43", "ovs_interfaceid": "9c02fc93-434e-4e02-8855-14348e691115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:56,bridge_name='br-int',has_traffic_filtering=True,id=9c02fc93-434e-4e02-8855-14348e691115,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c02fc93-43') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG os_vif [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:56,bridge_name='br-int',has_traffic_filtering=True,id=9c02fc93-434e-4e02-8855-14348e691115,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c02fc93-43') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c02fc93-43, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:30:59 user nova-compute[72150]: INFO os_vif [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:56,bridge_name='br-int',has_traffic_filtering=True,id=9c02fc93-434e-4e02-8855-14348e691115,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c02fc93-43')
Aug 01 18:30:59 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Deleting instance files /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88_del
Aug 01 18:30:59 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Deletion of /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88_del complete
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PGUlJqzL" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2c2b61-e377-429b-aa91-d4ba17517791]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PGUlJqzL'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[085c48d0-50f6-4087-8fa1-25d6403e0894]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3c9d55-21d5-4cc5-aa99-b7bac7df0068]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:30:59 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:30:59 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:30:59 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:30:59 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[985ef105-6d07-43a6-a3da-0d936ec8a9bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5, portal: 172.16.0.220,3260]
Aug 01 18:30:59 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5, portal: 172.16.0.220,3260] successful.
Aug 01 18:30:59 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:59 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Deleted allocations for instance 441a61de-ad9d-412d-95f3-882cef273e88
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea06cf94-8d4f-4bf9-84a6-072c7b7776bd]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28d4297-ea4c-4fa2-8ea7-8bf97523ee3f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:30:59 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:30:59 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:30:59 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:30:59 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:30:59 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:30:59 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.552s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0042e44-1d54-40b8-9791-637bf262ce01]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PGUlJqzL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG nova.objects.instance [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'numa_topology' on Instance uuid 441a61de-ad9d-412d-95f3-882cef273e88 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914644.5580423, a50fb967-36ed-4266-bf10-66606dd64320 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:30:59 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: a50fb967-36ed-4266-bf10-66606dd64320] VM Stopped (Lifecycle Event)
Aug 01 18:30:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-f562771c-685b-4c56-8bac-72b11b9c1de2 None None] [instance: a50fb967-36ed-4266-bf10-66606dd64320] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG nova.network.neutron [req-08dba670-853a-44f6-b2ae-4c5332c37c97 req-c2bfeccd-c911-4137-a677-e5dd574cb785 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Updated VIF entry in instance network info cache for port 9c02fc93-434e-4e02-8855-14348e691115. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG nova.network.neutron [req-08dba670-853a-44f6-b2ae-4c5332c37c97 req-c2bfeccd-c911-4137-a677-e5dd574cb785 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Updating instance_info_cache with network_info: [{"id": "9c02fc93-434e-4e02-8855-14348e691115", "address": "fa:16:3e:ba:5c:56", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9c02fc93-43", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08dba670-853a-44f6-b2ae-4c5332c37c97 req-c2bfeccd-c911-4137-a677-e5dd574cb785 service nova] Releasing lock "refresh_cache-441a61de-ad9d-412d-95f3-882cef273e88" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:30:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f8809c67-cf10-4b49-bf5e-cc82837fcab3 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "441a61de-ad9d-412d-95f3-882cef273e88" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.987s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.586s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:31:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] <== connect_volume: return (1588ms) {'type': 'block', 'scsi_wwn': '23832353932303736', 'path': '/dev/sdd'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:31:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832353932303736', 'path': '/dev/sdd'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:31:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T18:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-301869653',display_name='tempest-ServerActionsTestOtherA-server-1812214243',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-301869653',id=17,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJY2FlDJuzmLBeUAuDA5wUSU2UHRGDTZlkebFFQy7IaCc3RvIIFGPPP6kDQA5KkLRYt2dsIc0CUwBhPl2TFzcR9udfpfPek2FdJAmKOoaMyPBsGZqlWc4+qDiA+nCRd2Q==',key_name='tempest-keypair-605536790',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:26:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1c393fdc0b774cd8a6208200011ba16b',ramdisk_id='',reservation_id='r-djtbnitg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-993571413',owner_user_name='tempest-ServerActionsTestOtherA-993571413-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:30:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9470bee775394bf5a3368d27b64911cb',uuid=bf2d1f14-2227-41d1-bd73-a05ab3149aba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "address": "fa:16:3e:63:c8:50", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41eb682d-9c", "ovs_interfaceid": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:31:00 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converting VIF {"id": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "address": "fa:16:3e:63:c8:50", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41eb682d-9c", "ovs_interfaceid": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:31:00 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=41eb682d-9c56-46b8-bd1d-b479d120b8a1,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41eb682d-9c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:31:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:31:00 user nova-compute[72150]:   <uuid>bf2d1f14-2227-41d1-bd73-a05ab3149aba</uuid>
Aug 01 18:31:00 user nova-compute[72150]:   <name>instance-00000011</name>
Aug 01 18:31:00 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:31:00 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:31:00 user nova-compute[72150]:   <metadata>
Aug 01 18:31:00 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:31:00 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:31:00 user nova-compute[72150]:       <nova:name>tempest-ServerActionsTestOtherA-server-1812214243</nova:name>
Aug 01 18:31:00 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:30:58</nova:creationTime>
Aug 01 18:31:00 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:31:00 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:31:00 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:31:00 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:31:00 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:31:00 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:31:00 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:31:00 user nova-compute[72150]:       <nova:owner>
Aug 01 18:31:00 user nova-compute[72150]:         <nova:user uuid="9470bee775394bf5a3368d27b64911cb">tempest-ServerActionsTestOtherA-993571413-project-member</nova:user>
Aug 01 18:31:00 user nova-compute[72150]:         <nova:project uuid="1c393fdc0b774cd8a6208200011ba16b">tempest-ServerActionsTestOtherA-993571413</nova:project>
Aug 01 18:31:00 user nova-compute[72150]:       </nova:owner>
Aug 01 18:31:00 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:31:00 user nova-compute[72150]:       <nova:ports>
Aug 01 18:31:00 user nova-compute[72150]:         <nova:port uuid="41eb682d-9c56-46b8-bd1d-b479d120b8a1">
Aug 01 18:31:00 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 18:31:00 user nova-compute[72150]:         </nova:port>
Aug 01 18:31:00 user nova-compute[72150]:       </nova:ports>
Aug 01 18:31:00 user nova-compute[72150]:     </nova:instance>
Aug 01 18:31:00 user nova-compute[72150]:   </metadata>
Aug 01 18:31:00 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:31:00 user nova-compute[72150]:     <system>
Aug 01 18:31:00 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:31:00 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:31:00 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:31:00 user nova-compute[72150]:       <entry name="serial">bf2d1f14-2227-41d1-bd73-a05ab3149aba</entry>
Aug 01 18:31:00 user nova-compute[72150]:       <entry name="uuid">bf2d1f14-2227-41d1-bd73-a05ab3149aba</entry>
Aug 01 18:31:00 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:31:00 user nova-compute[72150]:     </system>
Aug 01 18:31:00 user nova-compute[72150]:   </sysinfo>
Aug 01 18:31:00 user nova-compute[72150]:   <os>
Aug 01 18:31:00 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:31:00 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:31:00 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:31:00 user nova-compute[72150]:   </os>
Aug 01 18:31:00 user nova-compute[72150]:   <features>
Aug 01 18:31:00 user nova-compute[72150]:     <acpi/>
Aug 01 18:31:00 user nova-compute[72150]:     <apic/>
Aug 01 18:31:00 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:31:00 user nova-compute[72150]:   </features>
Aug 01 18:31:00 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:31:00 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:31:00 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:31:00 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:31:00 user nova-compute[72150]:   </clock>
Aug 01 18:31:00 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:31:00 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:31:00 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:31:00 user nova-compute[72150]:   </cpu>
Aug 01 18:31:00 user nova-compute[72150]:   <devices>
Aug 01 18:31:00 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:31:00 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:31:00 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk"/>
Aug 01 18:31:00 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:31:00 user nova-compute[72150]:     </disk>
Aug 01 18:31:00 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:31:00 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:31:00 user nova-compute[72150]:       <source dev="/dev/sdd"/>
Aug 01 18:31:00 user nova-compute[72150]:       <target dev="vdb" bus="virtio"/>
Aug 01 18:31:00 user nova-compute[72150]:       <serial>a4f14ea5-97f3-4c69-8f61-d956809a15d5</serial>
Aug 01 18:31:00 user nova-compute[72150]:     </disk>
Aug 01 18:31:00 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:31:00 user nova-compute[72150]:       <mac address="fa:16:3e:63:c8:50"/>
Aug 01 18:31:00 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:31:00 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:31:00 user nova-compute[72150]:       <target dev="tap41eb682d-9c"/>
Aug 01 18:31:00 user nova-compute[72150]:     </interface>
Aug 01 18:31:00 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:31:00 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/console.log" append="off"/>
Aug 01 18:31:00 user nova-compute[72150]:     </serial>
Aug 01 18:31:00 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:31:00 user nova-compute[72150]:     <video>
Aug 01 18:31:00 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:31:00 user nova-compute[72150]:     </video>
Aug 01 18:31:00 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:31:00 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:31:00 user nova-compute[72150]:     </rng>
Aug 01 18:31:00 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:31:00 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:31:00 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:31:00 user nova-compute[72150]:     </memballoon>
Aug 01 18:31:00 user nova-compute[72150]:   </devices>
Aug 01 18:31:00 user nova-compute[72150]: </domain>
Aug 01 18:31:00 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:31:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T18:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-301869653',display_name='tempest-ServerActionsTestOtherA-server-1812214243',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-301869653',id=17,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJY2FlDJuzmLBeUAuDA5wUSU2UHRGDTZlkebFFQy7IaCc3RvIIFGPPP6kDQA5KkLRYt2dsIc0CUwBhPl2TFzcR9udfpfPek2FdJAmKOoaMyPBsGZqlWc4+qDiA+nCRd2Q==',key_name='tempest-keypair-605536790',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:26:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1c393fdc0b774cd8a6208200011ba16b',ramdisk_id='',reservation_id='r-djtbnitg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-993571413',owner_user_name='tempest-ServerActionsTestOtherA-993571413-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:30:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9470bee775394bf5a3368d27b64911cb',uuid=bf2d1f14-2227-41d1-bd73-a05ab3149aba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "address": "fa:16:3e:63:c8:50", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41eb682d-9c", "ovs_interfaceid": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:31:00 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converting VIF {"id": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "address": "fa:16:3e:63:c8:50", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41eb682d-9c", "ovs_interfaceid": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:31:00 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=41eb682d-9c56-46b8-bd1d-b479d120b8a1,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41eb682d-9c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:31:00 user nova-compute[72150]: DEBUG os_vif [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=41eb682d-9c56-46b8-bd1d-b479d120b8a1,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41eb682d-9c') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:31:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:31:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:31:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41eb682d-9c, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:31:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap41eb682d-9c, col_values=(('external_ids', {'iface-id': '41eb682d-9c56-46b8-bd1d-b479d120b8a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:c8:50', 'vm-uuid': 'bf2d1f14-2227-41d1-bd73-a05ab3149aba'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:31:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:31:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:00 user nova-compute[72150]: INFO os_vif [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=41eb682d-9c56-46b8-bd1d-b479d120b8a1,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41eb682d-9c')
Aug 01 18:31:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:31:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:31:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] No VIF found with MAC fa:16:3e:63:c8:50, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:31:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:02 user nova-compute[72150]: DEBUG nova.compute.manager [req-bc44ec7c-8f5a-4658-8df4-5eb87681d446 req-8757630d-5bd5-4fdf-84c3-7d68df228b3f service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Received event network-vif-plugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bc44ec7c-8f5a-4658-8df4-5eb87681d446 req-8757630d-5bd5-4fdf-84c3-7d68df228b3f service nova] Acquiring lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bc44ec7c-8f5a-4658-8df4-5eb87681d446 req-8757630d-5bd5-4fdf-84c3-7d68df228b3f service nova] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bc44ec7c-8f5a-4658-8df4-5eb87681d446 req-8757630d-5bd5-4fdf-84c3-7d68df228b3f service nova] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:02 user nova-compute[72150]: DEBUG nova.compute.manager [req-bc44ec7c-8f5a-4658-8df4-5eb87681d446 req-8757630d-5bd5-4fdf-84c3-7d68df228b3f service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] No waiting events found dispatching network-vif-plugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:31:02 user nova-compute[72150]: WARNING nova.compute.manager [req-bc44ec7c-8f5a-4658-8df4-5eb87681d446 req-8757630d-5bd5-4fdf-84c3-7d68df228b3f service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Received unexpected event network-vif-plugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 18:31:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:03 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914648.3438704, bf2d1f14-2227-41d1-bd73-a05ab3149aba => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:31:03 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] VM Stopped (Lifecycle Event)
Aug 01 18:31:03 user nova-compute[72150]: DEBUG nova.compute.manager [None req-05f7b456-9129-411b-9372-11374953e410 None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:31:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:04 user nova-compute[72150]: DEBUG nova.compute.manager [req-18b63eda-64ec-484b-9bd3-546cae6bd907 req-6d93ed01-a707-408e-9c34-7fd06ca1d9a9 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Received event network-vif-plugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-18b63eda-64ec-484b-9bd3-546cae6bd907 req-6d93ed01-a707-408e-9c34-7fd06ca1d9a9 service nova] Acquiring lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-18b63eda-64ec-484b-9bd3-546cae6bd907 req-6d93ed01-a707-408e-9c34-7fd06ca1d9a9 service nova] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-18b63eda-64ec-484b-9bd3-546cae6bd907 req-6d93ed01-a707-408e-9c34-7fd06ca1d9a9 service nova] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:04 user nova-compute[72150]: DEBUG nova.compute.manager [req-18b63eda-64ec-484b-9bd3-546cae6bd907 req-6d93ed01-a707-408e-9c34-7fd06ca1d9a9 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] No waiting events found dispatching network-vif-plugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:31:04 user nova-compute[72150]: WARNING nova.compute.manager [req-18b63eda-64ec-484b-9bd3-546cae6bd907 req-6d93ed01-a707-408e-9c34-7fd06ca1d9a9 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Received unexpected event network-vif-plugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 18:31:04 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914664.4091456, bf2d1f14-2227-41d1-bd73-a05ab3149aba => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:31:04 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] VM Resumed (Lifecycle Event)
Aug 01 18:31:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:31:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:31:04 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Instance spawned successfully.
Aug 01 18:31:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:31:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:31:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:31:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:31:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:31:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:31:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:31:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:31:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:31:04 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 18:31:04 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914664.4106889, bf2d1f14-2227-41d1-bd73-a05ab3149aba => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:31:04 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] VM Started (Lifecycle Event)
Aug 01 18:31:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:31:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:31:04 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 18:31:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:31:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:04 user nova-compute[72150]: DEBUG nova.objects.instance [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72150) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 18:31:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c84799e0-69be-4a9a-a7a9-20c5c052685c tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.091s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDySdpws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:31:05 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:31:05 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:31:05 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:31:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[631eb75a-8ca6-44c5-81d9-1c7f072d54c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:31:05 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7115d1cd-5991-4c3b-a5c1-72b8946c9658]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834] added
Aug 01 18:31:05 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d405e106-2e1d-4b6e-b57a-1d3c84c44242]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5c3d20-e284-402b-8e77-a6d3ea3261f0]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gDySdpws {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gDySdpws" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7b619c-0273-4704-ac2a-51b96cf65112]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gDySdpws'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac59e49-3d01-459e-9d0f-2451b0067c6f]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[27666377-2320-42c8-bb5d-88f00f44d050]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:05 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:05 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:05 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:05 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:05 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:05 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a0adbd-47ed-4172-b30e-bb9455226624]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260]
Aug 01 18:31:05 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260] successful.
Aug 01 18:31:05 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb59fc6-80d1-4208-bccf-c5141894be3c]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34a23ea-28fd-4076-8fda-55345961e840]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:05 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:05 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:05 user nova-compute[72150]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:31:05 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:05 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:05 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:05 user nova-compute[72150]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:31:05 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c9cd82-f96d-4515-b6ef-82eaf8e1558b]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:31:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDySdpws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:31:06 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:31:06 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23966623265323939', 'path': '/dev/sde'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:31:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966623265323939', 'path': '/dev/sde'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:31:06 user nova-compute[72150]: DEBUG nova.objects.instance [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lazy-loading 'flavor' on Instance uuid a5f0eca7-d060-4226-b36e-a3cd15b15703 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:31:06 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:31:06 user nova-compute[72150]:   <source dev="/dev/sde"/>
Aug 01 18:31:06 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:31:06 user nova-compute[72150]:   <serial>db690b5a-dd50-4971-9f5b-486fad1b1834</serial>
Aug 01 18:31:06 user nova-compute[72150]: </disk>
Aug 01 18:31:06 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:31:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:31:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:31:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] No VIF found with MAC fa:16:3e:65:82:a8, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:31:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5c685f88-b965-40aa-9206-afdc94fbc63e tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.253s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Stashing vm_state: active {{(pid=72150) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 01 18:31:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:09 user nova-compute[72150]: DEBUG nova.objects.instance [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lazy-loading 'pci_requests' on Instance uuid a5f0eca7-d060-4226-b36e-a3cd15b15703 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:09 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:31:09 user nova-compute[72150]: INFO nova.compute.claims [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Claim successful on node user
Aug 01 18:31:09 user nova-compute[72150]: DEBUG nova.objects.instance [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lazy-loading 'resources' on Instance uuid a5f0eca7-d060-4226-b36e-a3cd15b15703 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:09 user nova-compute[72150]: DEBUG nova.objects.instance [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lazy-loading 'pci_devices' on Instance uuid a5f0eca7-d060-4226-b36e-a3cd15b15703 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:09 user nova-compute[72150]: INFO nova.compute.resource_tracker [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Updating resource usage from migration 2182feaa-9b23-4385-8e0a-7709471ff371
Aug 01 18:31:09 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914654.7508574, 441a61de-ad9d-412d-95f3-882cef273e88 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:31:09 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] VM Stopped (Lifecycle Event)
Aug 01 18:31:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-2512f7e5-d455-4475-bd5b-850fe5764364 None None] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:31:10 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:31:10 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:31:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.541s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:10 user nova-compute[72150]: INFO nova.compute.manager [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Migrating
Aug 01 18:31:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:31:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:31:10 user nova-compute[72150]: INFO nova.compute.rpcapi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 01 18:31:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:31:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "refresh_cache-a5f0eca7-d060-4226-b36e-a3cd15b15703" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:31:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquired lock "refresh_cache-a5f0eca7-d060-4226-b36e-a3cd15b15703" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:31:10 user nova-compute[72150]: DEBUG nova.network.neutron [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:31:10 user nova-compute[72150]: DEBUG nova.network.neutron [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Updating instance_info_cache with network_info: [{"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:31:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Releasing lock "refresh_cache-a5f0eca7-d060-4226-b36e-a3cd15b15703" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:31:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Starting migrate_disk_and_power_off {{(pid=72150) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 01 18:31:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG nova.compute.manager [req-acbbeb84-1dda-440f-bfe9-b729e0e22853 req-c9549a1b-54ab-4150-bdfe-1d5fe06de2e7 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received event network-vif-unplugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-acbbeb84-1dda-440f-bfe9-b729e0e22853 req-c9549a1b-54ab-4150-bdfe-1d5fe06de2e7 service nova] Acquiring lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-acbbeb84-1dda-440f-bfe9-b729e0e22853 req-c9549a1b-54ab-4150-bdfe-1d5fe06de2e7 service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-acbbeb84-1dda-440f-bfe9-b729e0e22853 req-c9549a1b-54ab-4150-bdfe-1d5fe06de2e7 service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG nova.compute.manager [req-acbbeb84-1dda-440f-bfe9-b729e0e22853 req-c9549a1b-54ab-4150-bdfe-1d5fe06de2e7 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] No waiting events found dispatching network-vif-unplugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:31:11 user nova-compute[72150]: WARNING nova.compute.manager [req-acbbeb84-1dda-440f-bfe9-b729e0e22853 req-c9549a1b-54ab-4150-bdfe-1d5fe06de2e7 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received unexpected event network-vif-unplugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc for instance with vm_state active and task_state resize_migrating.
Aug 01 18:31:11 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Instance destroyed successfully.
Aug 01 18:31:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1769556587',display_name='tempest-ServerActionsTestOtherB-server-1769556587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1769556587',id=18,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHk1JfNPFXl8HOej4l4GGAFwiUlyr68TuvMkyJFt7CHfDXuZjpGZ30rkbU/oouT3R2Q9X+Pk0+5iMSh/dzvrWC0rsJ078sX31sP2prrj5uYPobmNDT4n3BlWJvWW4raDpA==',key_name='tempest-keypair-792111278',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:27:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3d566eb776234eb4a834d0e3f6dd7792',ramdisk_id='',reservation_id='r-o20tu0o3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-623575398',owner_user_name='tempest-ServerActionsTestOtherB-623575398-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:31:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68c9836c352b488b934723c56f892c10',uuid=a5f0eca7-d060-4226-b36e-a3cd15b15703,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1870690944-network", "vif_mac": "fa:16:3e:65:82:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Converting VIF {"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1870690944-network", "vif_mac": "fa:16:3e:65:82:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc,network=Network(36c41dfd-577c-4ceb-a1f7-69187368b386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0a2205a-4b') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG os_vif [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc,network=Network(36c41dfd-577c-4ceb-a1f7-69187368b386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0a2205a-4b') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0a2205a-4b, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:11 user nova-compute[72150]: INFO os_vif [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc,network=Network(36c41dfd-577c-4ceb-a1f7-69187368b386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0a2205a-4b')
Aug 01 18:31:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDySdpws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:31:11 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:31:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a9ff73-299e-429c-9e24-c6caf9d3c09e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ea8539-4f6c-4376-a443-d5ce8179194b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:11 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:11 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:11 user nova-compute[72150]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:31:11 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:11 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:11 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:11 user nova-compute[72150]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:31:11 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c452710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834'): ({'sde'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Removing single pathed devices sde {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[61063bdc-0bbd-4c94-9d8c-4b96fae276c4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3030fd8-7fd5-4890-8b21-2cd5be1dcd38]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Flushing IO for device /dev/sde {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f66f3b-dd8a-428e-acdd-c18ad907ecc2]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4665a4-1b07-43f5-a028-2534d1a4db6c]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] SCSI volumes sde have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1290038-1e74-4fda-8160-ba701b02787c]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbc9e3d-7a28-4cb4-98c7-7fe720365adb]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260]
Aug 01 18:31:11 user nova-compute[72150]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260] successful.
Aug 01 18:31:11 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3430477-3a70-4c29-8b4d-31a64ade9a58]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.258s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] <== disconnect_volume: return (260ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:31:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703_resize/disk /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] CMD "cp -r /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703_resize/disk /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk" returned: 0 in 0.404s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703_resize/disk.info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk.info {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] CMD "cp -r /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703_resize/disk.info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk.info" returned: 0 in 0.033s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:13 user nova-compute[72150]: DEBUG nova.compute.manager [req-798e1a88-c2d2-418c-b78f-06949c7c224d req-aa93d60f-3c56-4a97-8e21-04e49a5f0e1b service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received event network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-798e1a88-c2d2-418c-b78f-06949c7c224d req-aa93d60f-3c56-4a97-8e21-04e49a5f0e1b service nova] Acquiring lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-798e1a88-c2d2-418c-b78f-06949c7c224d req-aa93d60f-3c56-4a97-8e21-04e49a5f0e1b service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-798e1a88-c2d2-418c-b78f-06949c7c224d req-aa93d60f-3c56-4a97-8e21-04e49a5f0e1b service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:13 user nova-compute[72150]: DEBUG nova.compute.manager [req-798e1a88-c2d2-418c-b78f-06949c7c224d req-aa93d60f-3c56-4a97-8e21-04e49a5f0e1b service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] No waiting events found dispatching network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:31:13 user nova-compute[72150]: WARNING nova.compute.manager [req-798e1a88-c2d2-418c-b78f-06949c7c224d req-aa93d60f-3c56-4a97-8e21-04e49a5f0e1b service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received unexpected event network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc for instance with vm_state active and task_state resize_migrating.
Aug 01 18:31:13 user nova-compute[72150]: DEBUG nova.network.neutron [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Port e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc binding to destination host user is already ACTIVE {{(pid=72150) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquiring lock "ceee3912-ca68-4b15-8fe6-985d905e8128" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG nova.objects.instance [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lazy-loading 'flavor' on Instance uuid ceee3912-ca68-4b15-8fe6-985d905e8128 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "refresh_cache-a5f0eca7-d060-4226-b36e-a3cd15b15703" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquired lock "refresh_cache-a5f0eca7-d060-4226-b36e-a3cd15b15703" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG nova.network.neutron [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquiring lock "ceee3912-ca68-4b15-8fe6-985d905e8128" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:14 user nova-compute[72150]: INFO nova.compute.manager [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Attaching volume 4853a41d-803e-4f6f-b35f-0fb4cf2ba697 to /dev/vdb
Aug 01 18:31:14 user nova-compute[72150]: DEBUG os_brick.utils [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7481ac28-2833-482d-9138-c4b7f98fcfa3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf3b099-2783-406a-afd0-dd0453afcdc0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc54353-bbb8-4035-9677-8936e05d2623]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[00796472-a18a-4254-8599-33a39bad7387]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:31:14 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58d2d75-8ea7-44e3-9028-3030c0405543]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG os_brick.utils [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Updating existing volume attachment record: 5f190934-1553-4654-b931-dc613a69f676 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG nova.network.neutron [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Updating instance_info_cache with network_info: [{"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Releasing lock "refresh_cache-a5f0eca7-d060-4226-b36e-a3cd15b15703" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG os_brick.utils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[98250c62-e08b-4518-a7d9-c935e90f1a1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68c81ba-242f-4385-a997-dee7bfd8053e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9084169c-5756-493c-b923-7cca803ce265]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c46c928-389e-47ac-a39a-0f3aebb7c3a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:31:14 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:31:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef53878a-3d0e-4d10-aa1a-927eb8224ed1]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:31:14 user nova-compute[72150]: DEBUG os_brick.utils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:31:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:16 user nova-compute[72150]: INFO nova.compute.manager [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Rescuing
Aug 01 18:31:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "refresh_cache-42e75a98-beb1-4688-a375-affc63b14252" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:31:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquired lock "refresh_cache-42e75a98-beb1-4688-a375-affc63b14252" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:31:16 user nova-compute[72150]: DEBUG nova.network.neutron [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:31:17 user nova-compute[72150]: DEBUG nova.network.neutron [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Updating instance_info_cache with network_info: [{"id": "10529340-a252-4604-accb-19f26670f125", "address": "fa:16:3e:56:f4:53", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10529340-a2", "ovs_interfaceid": "10529340-a252-4604-accb-19f26670f125", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:31:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Releasing lock "refresh_cache-42e75a98-beb1-4688-a375-affc63b14252" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:31:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:17 user nova-compute[72150]: DEBUG nova.compute.manager [req-0acb7f5d-c0ff-4b6b-b4d4-b63eb894ca7b req-0d6b6ae4-b3a4-4b61-af48-e8214c20ee2c service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received event network-vif-unplugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0acb7f5d-c0ff-4b6b-b4d4-b63eb894ca7b req-0d6b6ae4-b3a4-4b61-af48-e8214c20ee2c service nova] Acquiring lock "42e75a98-beb1-4688-a375-affc63b14252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0acb7f5d-c0ff-4b6b-b4d4-b63eb894ca7b req-0d6b6ae4-b3a4-4b61-af48-e8214c20ee2c service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0acb7f5d-c0ff-4b6b-b4d4-b63eb894ca7b req-0d6b6ae4-b3a4-4b61-af48-e8214c20ee2c service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:17 user nova-compute[72150]: DEBUG nova.compute.manager [req-0acb7f5d-c0ff-4b6b-b4d4-b63eb894ca7b req-0d6b6ae4-b3a4-4b61-af48-e8214c20ee2c service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] No waiting events found dispatching network-vif-unplugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:31:17 user nova-compute[72150]: WARNING nova.compute.manager [req-0acb7f5d-c0ff-4b6b-b4d4-b63eb894ca7b req-0d6b6ae4-b3a4-4b61-af48-e8214c20ee2c service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received unexpected event network-vif-unplugged-10529340-a252-4604-accb-19f26670f125 for instance with vm_state active and task_state rescuing.
Aug 01 18:31:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:18 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Instance destroyed successfully.
Aug 01 18:31:18 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Attempting a stable device rescue
Aug 01 18:31:18 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72150) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 18:31:18 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Instance directory exists: not creating {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 18:31:18 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Creating image(s)
Aug 01 18:31:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "/opt/stack/data/nova/instances/42e75a98-beb1-4688-a375-affc63b14252/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "/opt/stack/data/nova/instances/42e75a98-beb1-4688-a375-affc63b14252/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "/opt/stack/data/nova/instances/42e75a98-beb1-4688-a375-affc63b14252/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:18 user nova-compute[72150]: DEBUG nova.objects.instance [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'trusted_certs' on Instance uuid 42e75a98-beb1-4688-a375-affc63b14252 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "09a1e306902c6d883d3e37533a2be245ab064bf6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "09a1e306902c6d883d3e37533a2be245ab064bf6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:18 user nova-compute[72150]: DEBUG nova.compute.manager [req-e248280a-98e7-4326-a0f9-7b964df8e2ee req-922ecd6b-1494-42d5-8da4-4d1e254acf4f service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Received event network-changed-47fc57e5-3a55-4719-944f-5d65f5fbcce4 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:18 user nova-compute[72150]: DEBUG nova.compute.manager [req-e248280a-98e7-4326-a0f9-7b964df8e2ee req-922ecd6b-1494-42d5-8da4-4d1e254acf4f service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Refreshing instance network info cache due to event network-changed-47fc57e5-3a55-4719-944f-5d65f5fbcce4. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:31:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e248280a-98e7-4326-a0f9-7b964df8e2ee req-922ecd6b-1494-42d5-8da4-4d1e254acf4f service nova] Acquiring lock "refresh_cache-1de0ad54-0d7a-4287-9532-7b4982b1e2bf" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:31:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e248280a-98e7-4326-a0f9-7b964df8e2ee req-922ecd6b-1494-42d5-8da4-4d1e254acf4f service nova] Acquired lock "refresh_cache-1de0ad54-0d7a-4287-9532-7b4982b1e2bf" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:31:18 user nova-compute[72150]: DEBUG nova.network.neutron [req-e248280a-98e7-4326-a0f9-7b964df8e2ee req-922ecd6b-1494-42d5-8da4-4d1e254acf4f service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Refreshing network info cache for port 47fc57e5-3a55-4719-944f-5d65f5fbcce4 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09a1e306902c6d883d3e37533a2be245ab064bf6.part --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09a1e306902c6d883d3e37533a2be245ab064bf6.part --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG nova.virt.images [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] bf9c1156-3737-41b5-836f-3fd3dd701fa3 was qcow2, converting to raw {{(pid=72150) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG nova.privsep.utils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72150) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/09a1e306902c6d883d3e37533a2be245ab064bf6.part /opt/stack/data/nova/instances/_base/09a1e306902c6d883d3e37533a2be245ab064bf6.converted {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/09a1e306902c6d883d3e37533a2be245ab064bf6.part /opt/stack/data/nova/instances/_base/09a1e306902c6d883d3e37533a2be245ab064bf6.converted" returned: 0 in 0.229s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09a1e306902c6d883d3e37533a2be245ab064bf6.converted --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09a1e306902c6d883d3e37533a2be245ab064bf6.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "09a1e306902c6d883d3e37533a2be245ab064bf6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.367s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "09a1e306902c6d883d3e37533a2be245ab064bf6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "09a1e306902c6d883d3e37533a2be245ab064bf6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09a1e306902c6d883d3e37533a2be245ab064bf6 --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG nova.network.neutron [req-e248280a-98e7-4326-a0f9-7b964df8e2ee req-922ecd6b-1494-42d5-8da4-4d1e254acf4f service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Updated VIF entry in instance network info cache for port 47fc57e5-3a55-4719-944f-5d65f5fbcce4. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG nova.network.neutron [req-e248280a-98e7-4326-a0f9-7b964df8e2ee req-922ecd6b-1494-42d5-8da4-4d1e254acf4f service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Updating instance_info_cache with network_info: [{"id": "47fc57e5-3a55-4719-944f-5d65f5fbcce4", "address": "fa:16:3e:20:25:3c", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc57e5-3a", "ovs_interfaceid": "47fc57e5-3a55-4719-944f-5d65f5fbcce4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG nova.compute.manager [req-07155bb1-9d7f-4941-8fb3-0863b772fc9c req-b045511c-f919-433a-8cb7-70519a2b3f65 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-07155bb1-9d7f-4941-8fb3-0863b772fc9c req-b045511c-f919-433a-8cb7-70519a2b3f65 service nova] Acquiring lock "42e75a98-beb1-4688-a375-affc63b14252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-07155bb1-9d7f-4941-8fb3-0863b772fc9c req-b045511c-f919-433a-8cb7-70519a2b3f65 service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-07155bb1-9d7f-4941-8fb3-0863b772fc9c req-b045511c-f919-433a-8cb7-70519a2b3f65 service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG nova.compute.manager [req-07155bb1-9d7f-4941-8fb3-0863b772fc9c req-b045511c-f919-433a-8cb7-70519a2b3f65 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] No waiting events found dispatching network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:31:19 user nova-compute[72150]: WARNING nova.compute.manager [req-07155bb1-9d7f-4941-8fb3-0863b772fc9c req-b045511c-f919-433a-8cb7-70519a2b3f65 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received unexpected event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 for instance with vm_state active and task_state rescuing.
Aug 01 18:31:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e248280a-98e7-4326-a0f9-7b964df8e2ee req-922ecd6b-1494-42d5-8da4-4d1e254acf4f service nova] Releasing lock "refresh_cache-1de0ad54-0d7a-4287-9532-7b4982b1e2bf" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09a1e306902c6d883d3e37533a2be245ab064bf6 --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09a1e306902c6d883d3e37533a2be245ab064bf6,backing_fmt=raw /opt/stack/data/nova/instances/42e75a98-beb1-4688-a375-affc63b14252/disk.rescue {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09a1e306902c6d883d3e37533a2be245ab064bf6,backing_fmt=raw /opt/stack/data/nova/instances/42e75a98-beb1-4688-a375-affc63b14252/disk.rescue" returned: 0 in 0.053s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "09a1e306902c6d883d3e37533a2be245ab064bf6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:19 user nova-compute[72150]: DEBUG nova.objects.instance [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'migration_context' on Instance uuid 42e75a98-beb1-4688-a375-affc63b14252 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Start _get_guest_xml network_info=[{"id": "10529340-a252-4604-accb-19f26670f125", "address": "fa:16:3e:56:f4:53", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "vif_mac": "fa:16:3e:56:f4:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10529340-a2", "ovs_interfaceid": "10529340-a252-4604-accb-19f26670f125", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bf9c1156-3737-41b5-836f-3fd3dd701fa3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'de63a39b-3bb0-44ec-83b3-12638129e9c9', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qRsPIbfH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '42e75a98-beb1-4688-a375-affc63b14252', 'attached_at': '', 'detached_at': '', 'volume_id': '630abcbe-8adc-4bfd-9acb-228c83952d0e', 'serial': '630abcbe-8adc-4bfd-9acb-228c83952d0e'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.objects.instance [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'resources' on Instance uuid 42e75a98-beb1-4688-a375-affc63b14252 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.objects.instance [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'numa_topology' on Instance uuid 42e75a98-beb1-4688-a375-affc63b14252 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:20 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:31:20 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.objects.instance [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'vcpu_model' on Instance uuid 42e75a98-beb1-4688-a375-affc63b14252 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qRsPIbfH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:31:20 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:31:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:31:20 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:31:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:31:20 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:31:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32afd0a-c5d4-41af-a5a2-c12f3ea8bf2b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = qRsPIbfH\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 18:31:20 user nova-compute[72150]: node.name = iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e
Aug 01 18:31:20 user nova-compute[72150]: node.tpgt = -1
Aug 01 18:31:20 user nova-compute[72150]: node.startup = automatic
Aug 01 18:31:20 user nova-compute[72150]: node.leading_login = No
Aug 01 18:31:20 user nova-compute[72150]: iface.iscsi_ifacename = default
Aug 01 18:31:20 user nova-compute[72150]: iface.net_ifacename = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.ipaddress = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.prefix_len = 0
Aug 01 18:31:20 user nova-compute[72150]: iface.hwaddress = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.transport_name = tcp
Aug 01 18:31:20 user nova-compute[72150]: iface.initiatorname = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.state = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.vlan_id = 0
Aug 01 18:31:20 user nova-compute[72150]: iface.vlan_priority = 0
Aug 01 18:31:20 user nova-compute[72150]: iface.vlan_state = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.iface_num = 0
Aug 01 18:31:20 user nova-compute[72150]: iface.mtu = 0
Aug 01 18:31:20 user nova-compute[72150]: iface.port = 0
Aug 01 18:31:20 user nova-compute[72150]: iface.bootproto = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.subnet_mask = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.gateway = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.dhcp_alt_client_id = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.dhcp_dns = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.dhcp_learn_iqn = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.dhcp_vendor_id_state = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.dhcp_vendor_id = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.dhcp_slp_da = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.fragmentation = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.gratuitous_arp = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.incoming_forwarding = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.tos_state = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.tos = 0
Aug 01 18:31:20 user nova-compute[72150]: iface.ttl = 0
Aug 01 18:31:20 user nova-compute[72150]: iface.delayed_ack = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.tcp_nagle = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.tcp_wsf_state = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.tcp_wsf = 0
Aug 01 18:31:20 user nova-compute[72150]: iface.tcp_timer_scale = 0
Aug 01 18:31:20 user nova-compute[72150]: iface.tcp_timestamp = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.redirect = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.def_task_mgmt_timeout = 0
Aug 01 18:31:20 user nova-compute[72150]: iface.header_digest = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.data_digest = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.immediate_data = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.initial_r2t = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.data_seq_inorder = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.data_pdu_inorder = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.erl = 0
Aug 01 18:31:20 user nova-compute[72150]: iface.max_receive_data_len = 0
Aug 01 18:31:20 user nova-compute[72150]: iface.first_burst_len = 0
Aug 01 18:31:20 user nova-compute[72150]: iface.max_outstanding_r2t = 0
Aug 01 18:31:20 user nova-compute[72150]: iface.max_burst_len = 0
Aug 01 18:31:20 user nova-compute[72150]: iface.chap_auth = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.bidi_chap = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.strict_login_compliance = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.discovery_auth = <empty>
Aug 01 18:31:20 user nova-compute[72150]: iface.discovery_logout = <empty>
Aug 01 18:31:20 user nova-compute[72150]: node.discovery_address = <empty>
Aug 01 18:31:20 user nova-compute[72150]: node.discovery_port = 0
Aug 01 18:31:20 user nova-compute[72150]: node.discovery_type = static
Aug 01 18:31:20 user nova-compute[72150]: node.session.initial_cmdsn = 0
Aug 01 18:31:20 user nova-compute[72150]: node.session.initial_login_retry_max = 8
Aug 01 18:31:20 user nova-compute[72150]: node.session.xmit_thread_priority = -20
Aug 01 18:31:20 user nova-compute[72150]: node.session.cmds_max = 128
Aug 01 18:31:20 user nova-compute[72150]: node.session.queue_depth = 32
Aug 01 18:31:20 user nova-compute[72150]: node.session.nr_sessions = 1
Aug 01 18:31:20 user nova-compute[72150]: node.session.auth.authmethod = CHAP
Aug 01 18:31:20 user nova-compute[72150]: node.session.auth.username = qRsPIbfH
Aug 01 18:31:20 user nova-compute[72150]: node.session.auth.password = ***
Aug 01 18:31:20 user nova-compute[72150]: node.session.auth.username_in = <empty>
Aug 01 18:31:20 user nova-compute[72150]: node.session.auth.password_in = <empty>
Aug 01 18:31:20 user nova-compute[72150]: node.session.auth.chap_algs = MD5
Aug 01 18:31:20 user nova-compute[72150]: node.session.timeo.replacement_timeout = 120
Aug 01 18:31:20 user nova-compute[72150]: node.session.err_timeo.abort_timeout = 15
Aug 01 18:31:20 user nova-compute[72150]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 18:31:20 user nova-compute[72150]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 18:31:20 user nova-compute[72150]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 18:31:20 user nova-compute[72150]: node.session.iscsi.FastAbort = Yes
Aug 01 18:31:20 user nova-compute[72150]: node.session.iscsi.InitialR2T = No
Aug 01 18:31:20 user nova-compute[72150]: node.session.iscsi.ImmediateData = Yes
Aug 01 18:31:20 user nova-compute[72150]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 18:31:20 user nova-compute[72150]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 18:31:20 user nova-compute[72150]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 18:31:20 user nova-compute[72150]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 18:31:20 user nova-compute[72150]: node.session.iscsi.MaxConnections = 1
Aug 01 18:31:20 user nova-compute[72150]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 18:31:20 user nova-compute[72150]: node.session.iscsi.ERL = 0
Aug 01 18:31:20 user nova-compute[72150]: node.session.scan = manual
Aug 01 18:31:20 user nova-compute[72150]: node.session.reopen_max = 0
Aug 01 18:31:20 user nova-compute[72150]: node.conn[0].address = 172.16.0.220
Aug 01 18:31:20 user nova-compute[72150]: node.conn[0].port = 3260
Aug 01 18:31:20 user nova-compute[72150]: node.conn[0].startup = manual
Aug 01 18:31:20 user nova-compute[72150]: node.conn[0].tcp.window_size = 524288
Aug 01 18:31:20 user nova-compute[72150]: node.conn[0].tcp.type_of_service = 0
Aug 01 18:31:20 user nova-compute[72150]: node.conn[0].timeo.logout_timeout = 15
Aug 01 18:31:20 user nova-compute[72150]: node.conn[0].timeo.login_timeout = 15
Aug 01 18:31:20 user nova-compute[72150]: node.conn[0].timeo.auth_timeout = 45
Aug 01 18:31:20 user nova-compute[72150]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 18:31:20 user nova-compute[72150]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 18:31:20 user nova-compute[72150]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 18:31:20 user nova-compute[72150]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 18:31:20 user nova-compute[72150]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 18:31:20 user nova-compute[72150]: node.conn[0].iscsi.DataDigest = None
Aug 01 18:31:20 user nova-compute[72150]: node.conn[0].iscsi.IFMarker = No
Aug 01 18:31:20 user nova-compute[72150]: node.conn[0].iscsi.OFMarker = No
Aug 01 18:31:20 user nova-compute[72150]: # END RECORD
Aug 01 18:31:20 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d20bb5a-b8d0-4f16-9d0c-fedc98e4f15b]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[44520d9b-40bb-4557-9091-ea5c197c38bb]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qRsPIbfH {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qRsPIbfH" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[59639f3f-a3c4-41c8-965f-63f47ef2f264]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qRsPIbfH'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[780cd8c8-a4cb-4264-8158-9c87a7a14426]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf4edf7-2860-4131-a00b-9b6370f04a34]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:20 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:20 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:20 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:20 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:20 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:20 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.153s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] HCTL ('34', '0', '0', 0) found on session 25 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4b7a94-4235-4acb-9733-53bc7283fc68]: (4, ('0 0 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Searching for a device in session 25 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qRsPIbfH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.182s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] <== connect_volume: return (183ms) {'type': 'block', 'scsi_wwn': '23630666363303861', 'path': '/dev/sdc'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630666363303861', 'path': '/dev/sdc'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-295206461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-295206461',id=22,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:29:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ad8ef64d051424e9fe644a1fb40fcb4',ramdisk_id='',reservation_id='r-r7xnryv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-23372548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:29:49Z,user_data=None,user_id='cc00b9006f5842c6b875c5d25538b718',uuid=42e75a98-beb1-4688-a375-affc63b14252,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10529340-a252-4604-accb-19f26670f125", "address": "fa:16:3e:56:f4:53", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "vif_mac": "fa:16:3e:56:f4:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10529340-a2", "ovs_interfaceid": "10529340-a252-4604-accb-19f26670f125", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converting VIF {"id": "10529340-a252-4604-accb-19f26670f125", "address": "fa:16:3e:56:f4:53", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "vif_mac": "fa:16:3e:56:f4:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10529340-a2", "ovs_interfaceid": "10529340-a252-4604-accb-19f26670f125", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:f4:53,bridge_name='br-int',has_traffic_filtering=True,id=10529340-a252-4604-accb-19f26670f125,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10529340-a2') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.objects.instance [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'pci_devices' on Instance uuid 42e75a98-beb1-4688-a375-affc63b14252 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:31:20 user nova-compute[72150]:   <uuid>42e75a98-beb1-4688-a375-affc63b14252</uuid>
Aug 01 18:31:20 user nova-compute[72150]:   <name>instance-00000016</name>
Aug 01 18:31:20 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:31:20 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:31:20 user nova-compute[72150]:   <metadata>
Aug 01 18:31:20 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:31:20 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:31:20 user nova-compute[72150]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-295206461</nova:name>
Aug 01 18:31:20 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:31:20</nova:creationTime>
Aug 01 18:31:20 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:31:20 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:31:20 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:31:20 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:31:20 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:31:20 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:31:20 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:31:20 user nova-compute[72150]:       <nova:owner>
Aug 01 18:31:20 user nova-compute[72150]:         <nova:user uuid="cc00b9006f5842c6b875c5d25538b718">tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member</nova:user>
Aug 01 18:31:20 user nova-compute[72150]:         <nova:project uuid="5ad8ef64d051424e9fe644a1fb40fcb4">tempest-ServerBootFromVolumeStableRescueTest-23372548</nova:project>
Aug 01 18:31:20 user nova-compute[72150]:       </nova:owner>
Aug 01 18:31:20 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:31:20 user nova-compute[72150]:       <nova:ports>
Aug 01 18:31:20 user nova-compute[72150]:         <nova:port uuid="10529340-a252-4604-accb-19f26670f125">
Aug 01 18:31:20 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 18:31:20 user nova-compute[72150]:         </nova:port>
Aug 01 18:31:20 user nova-compute[72150]:       </nova:ports>
Aug 01 18:31:20 user nova-compute[72150]:     </nova:instance>
Aug 01 18:31:20 user nova-compute[72150]:   </metadata>
Aug 01 18:31:20 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:31:20 user nova-compute[72150]:     <system>
Aug 01 18:31:20 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:31:20 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:31:20 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:31:20 user nova-compute[72150]:       <entry name="serial">42e75a98-beb1-4688-a375-affc63b14252</entry>
Aug 01 18:31:20 user nova-compute[72150]:       <entry name="uuid">42e75a98-beb1-4688-a375-affc63b14252</entry>
Aug 01 18:31:20 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:31:20 user nova-compute[72150]:     </system>
Aug 01 18:31:20 user nova-compute[72150]:   </sysinfo>
Aug 01 18:31:20 user nova-compute[72150]:   <os>
Aug 01 18:31:20 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:31:20 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:31:20 user nova-compute[72150]:   </os>
Aug 01 18:31:20 user nova-compute[72150]:   <features>
Aug 01 18:31:20 user nova-compute[72150]:     <acpi/>
Aug 01 18:31:20 user nova-compute[72150]:     <apic/>
Aug 01 18:31:20 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:31:20 user nova-compute[72150]:   </features>
Aug 01 18:31:20 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:31:20 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:31:20 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:31:20 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:31:20 user nova-compute[72150]:   </clock>
Aug 01 18:31:20 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:31:20 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:31:20 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:31:20 user nova-compute[72150]:   </cpu>
Aug 01 18:31:20 user nova-compute[72150]:   <devices>
Aug 01 18:31:20 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:31:20 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:31:20 user nova-compute[72150]:       <source dev="/dev/sdc"/>
Aug 01 18:31:20 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:31:20 user nova-compute[72150]:       <serial>630abcbe-8adc-4bfd-9acb-228c83952d0e</serial>
Aug 01 18:31:20 user nova-compute[72150]:     </disk>
Aug 01 18:31:20 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:31:20 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:31:20 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/42e75a98-beb1-4688-a375-affc63b14252/disk.rescue"/>
Aug 01 18:31:20 user nova-compute[72150]:       <target dev="vdb" bus="virtio"/>
Aug 01 18:31:20 user nova-compute[72150]:       <boot order="1"/>
Aug 01 18:31:20 user nova-compute[72150]:     </disk>
Aug 01 18:31:20 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:31:20 user nova-compute[72150]:       <mac address="fa:16:3e:56:f4:53"/>
Aug 01 18:31:20 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:31:20 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:31:20 user nova-compute[72150]:       <target dev="tap10529340-a2"/>
Aug 01 18:31:20 user nova-compute[72150]:     </interface>
Aug 01 18:31:20 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:31:20 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/42e75a98-beb1-4688-a375-affc63b14252/console.log" append="off"/>
Aug 01 18:31:20 user nova-compute[72150]:     </serial>
Aug 01 18:31:20 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:31:20 user nova-compute[72150]:     <video>
Aug 01 18:31:20 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:31:20 user nova-compute[72150]:     </video>
Aug 01 18:31:20 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:31:20 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:31:20 user nova-compute[72150]:     </rng>
Aug 01 18:31:20 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:31:20 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:31:20 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:31:20 user nova-compute[72150]:     </memballoon>
Aug 01 18:31:20 user nova-compute[72150]:   </devices>
Aug 01 18:31:20 user nova-compute[72150]: </domain>
Aug 01 18:31:20 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:31:20 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Instance destroyed successfully.
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:31:20 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] No VIF found with MAC fa:16:3e:56:f4:53, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:31:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:22 user nova-compute[72150]: DEBUG nova.compute.manager [req-52f34821-4883-468d-8b19-7da6bc394a46 req-4ab9b605-fd09-4443-92b4-ebd4b159bbd1 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-52f34821-4883-468d-8b19-7da6bc394a46 req-4ab9b605-fd09-4443-92b4-ebd4b159bbd1 service nova] Acquiring lock "42e75a98-beb1-4688-a375-affc63b14252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-52f34821-4883-468d-8b19-7da6bc394a46 req-4ab9b605-fd09-4443-92b4-ebd4b159bbd1 service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-52f34821-4883-468d-8b19-7da6bc394a46 req-4ab9b605-fd09-4443-92b4-ebd4b159bbd1 service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:22 user nova-compute[72150]: DEBUG nova.compute.manager [req-52f34821-4883-468d-8b19-7da6bc394a46 req-4ab9b605-fd09-4443-92b4-ebd4b159bbd1 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] No waiting events found dispatching network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:31:22 user nova-compute[72150]: WARNING nova.compute.manager [req-52f34821-4883-468d-8b19-7da6bc394a46 req-4ab9b605-fd09-4443-92b4-ebd4b159bbd1 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received unexpected event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 for instance with vm_state active and task_state rescuing.
Aug 01 18:31:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:23 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Removed pending event for 42e75a98-beb1-4688-a375-affc63b14252 due to event {{(pid=72150) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 18:31:23 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914683.915841, 42e75a98-beb1-4688-a375-affc63b14252 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:31:23 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] VM Resumed (Lifecycle Event)
Aug 01 18:31:23 user nova-compute[72150]: DEBUG nova.compute.manager [None req-0435c09c-1d62-4f54-abee-6dfe091af784 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:31:23 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:31:23 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:31:23 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 18:31:23 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914683.9180894, 42e75a98-beb1-4688-a375-affc63b14252 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:31:23 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] VM Started (Lifecycle Event)
Aug 01 18:31:23 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:31:24 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:31:24 user nova-compute[72150]: DEBUG nova.compute.manager [req-678d5a96-d99f-423b-be39-b73691b5bcb7 req-467b0c85-972c-403a-87bb-533c8ef084bd service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-678d5a96-d99f-423b-be39-b73691b5bcb7 req-467b0c85-972c-403a-87bb-533c8ef084bd service nova] Acquiring lock "42e75a98-beb1-4688-a375-affc63b14252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-678d5a96-d99f-423b-be39-b73691b5bcb7 req-467b0c85-972c-403a-87bb-533c8ef084bd service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-678d5a96-d99f-423b-be39-b73691b5bcb7 req-467b0c85-972c-403a-87bb-533c8ef084bd service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:24 user nova-compute[72150]: DEBUG nova.compute.manager [req-678d5a96-d99f-423b-be39-b73691b5bcb7 req-467b0c85-972c-403a-87bb-533c8ef084bd service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] No waiting events found dispatching network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:31:24 user nova-compute[72150]: WARNING nova.compute.manager [req-678d5a96-d99f-423b-be39-b73691b5bcb7 req-467b0c85-972c-403a-87bb-533c8ef084bd service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received unexpected event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 for instance with vm_state rescued and task_state None.
Aug 01 18:31:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IaRyAEMh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:31:25 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:31:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:31:25 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:31:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:31:25 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[de18d479-95a3-44de-8f78-d49fc92228a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:31:25 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a5e9c5-4285-40da-9230-c8acc773c83c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697] added
Aug 01 18:31:25 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef50b737-972b-41e7-90be-52c696882d83]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac994c4d-cb8f-41f4-b1f9-a62bcf86e3f3]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IaRyAEMh {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IaRyAEMh" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f78795-f075-40e0-89e9-fc1732114650]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IaRyAEMh'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87cb321-e278-43d0-a888-7c99422f96b6]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be21bd8-636d-467f-8789-11c8bc52ca2c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:25 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:25 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:25 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:25 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:25 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:25 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaeb0be0-8769-4969-b3b5-94056072280f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697, portal: 172.16.0.220,3260]
Aug 01 18:31:25 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697, portal: 172.16.0.220,3260] successful.
Aug 01 18:31:25 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3098859-b88a-48a9-9e32-3c083f5d3c2a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f05adf-32a1-4305-b2af-aaeb2dc25aba]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:25 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:25 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:25 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:31:25 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:25 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:25 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:25 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:31:25 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[874be6fe-7ece-42a1-b7c5-105fc80c2dfd]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:25 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: None {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:31:26 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914671.50642, a5f0eca7-d060-4226-b36e-a3cd15b15703 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:31:26 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] VM Stopped (Lifecycle Event)
Aug 01 18:31:26 user nova-compute[72150]: DEBUG nova.compute.manager [None req-f8f23f66-1bb0-4a3e-a06c-b18425e1c536 None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:31:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:26 user nova-compute[72150]: DEBUG nova.compute.manager [None req-f8f23f66-1bb0-4a3e-a06c-b18425e1c536 None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:31:26 user nova-compute[72150]: INFO nova.compute.manager [None req-f8f23f66-1bb0-4a3e-a06c-b18425e1c536 None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 18:31:26 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:31:26 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IaRyAEMh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:31:26 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:31:26 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23564613238363635', 'path': '/dev/sde'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:31:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564613238363635', 'path': '/dev/sde'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:31:26 user nova-compute[72150]: DEBUG nova.objects.instance [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lazy-loading 'flavor' on Instance uuid ceee3912-ca68-4b15-8fe6-985d905e8128 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:31:26 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:31:26 user nova-compute[72150]:   <source dev="/dev/sde"/>
Aug 01 18:31:26 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:31:26 user nova-compute[72150]:   <serial>4853a41d-803e-4f6f-b35f-0fb4cf2ba697</serial>
Aug 01 18:31:26 user nova-compute[72150]: </disk>
Aug 01 18:31:26 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:31:27 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:31:27 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:31:27 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] No VIF found with MAC fa:16:3e:e0:04:f1, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:31:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-90e65258-2a12-4574-841c-e23f091b07dd tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.977s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "12a8b6e5-617d-466d-bb62-64b6b188f8f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "12a8b6e5-617d-466d-bb62-64b6b188f8f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:31:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:28 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:31:28 user nova-compute[72150]: INFO nova.compute.claims [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Claim successful on node user
Aug 01 18:31:28 user nova-compute[72150]: INFO nova.compute.manager [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Rescuing
Aug 01 18:31:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquiring lock "refresh_cache-ceee3912-ca68-4b15-8fe6-985d905e8128" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:31:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquired lock "refresh_cache-ceee3912-ca68-4b15-8fe6-985d905e8128" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:31:28 user nova-compute[72150]: DEBUG nova.network.neutron [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:31:28 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:31:28 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:31:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:31:28 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:31:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:31:28 user nova-compute[72150]: DEBUG nova.network.neutron [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:31:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:31:29 user nova-compute[72150]: INFO nova.virt.block_device [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Booting with volume snapshot cc10aca3-686e-4966-8f50-678fb9a710f2 at /dev/vda
Aug 01 18:31:29 user nova-compute[72150]: DEBUG nova.policy [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92c7ef0ed6814f8880de76adb913a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ca44f23b114893afcfe57c52f693b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:31:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:29 user nova-compute[72150]: DEBUG nova.network.neutron [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Updating instance_info_cache with network_info: [{"id": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "address": "fa:16:3e:e0:04:f1", "network": {"id": "838d4cba-b00d-46ff-ad55-9d7dd511581a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-732384801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8759cb04dd744d7895a63bc5bd1d1c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee07a0f4-22", "ovs_interfaceid": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:31:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Releasing lock "refresh_cache-ceee3912-ca68-4b15-8fe6-985d905e8128" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:31:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:29 user nova-compute[72150]: DEBUG nova.network.neutron [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Successfully created port: 2eee643a-cddb-40a2-bd09-a601fb3e773c {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:31:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-003bac79-d8fd-46ea-9495-ff2e0829e982 req-3cc3ed43-2257-4af7-88d9-bd1c62ea7e88 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received event network-vif-unplugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-003bac79-d8fd-46ea-9495-ff2e0829e982 req-3cc3ed43-2257-4af7-88d9-bd1c62ea7e88 service nova] Acquiring lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-003bac79-d8fd-46ea-9495-ff2e0829e982 req-3cc3ed43-2257-4af7-88d9-bd1c62ea7e88 service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-003bac79-d8fd-46ea-9495-ff2e0829e982 req-3cc3ed43-2257-4af7-88d9-bd1c62ea7e88 service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-003bac79-d8fd-46ea-9495-ff2e0829e982 req-3cc3ed43-2257-4af7-88d9-bd1c62ea7e88 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] No waiting events found dispatching network-vif-unplugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:31:29 user nova-compute[72150]: WARNING nova.compute.manager [req-003bac79-d8fd-46ea-9495-ff2e0829e982 req-3cc3ed43-2257-4af7-88d9-bd1c62ea7e88 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received unexpected event network-vif-unplugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 for instance with vm_state active and task_state rescuing.
Aug 01 18:31:30 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Instance destroyed successfully.
Aug 01 18:31:30 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Attempting a stable device rescue
Aug 01 18:31:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72150) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 18:31:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Instance directory exists: not creating {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 18:31:30 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Creating image(s)
Aug 01 18:31:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquiring lock "/opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "/opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "/opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:30 user nova-compute[72150]: DEBUG nova.objects.instance [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lazy-loading 'trusted_certs' on Instance uuid ceee3912-ca68-4b15-8fe6-985d905e8128 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquiring lock "58db76b0e1ae0f99284eea7f6d1ccd0da95d5bb1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "58db76b0e1ae0f99284eea7f6d1ccd0da95d5bb1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:30 user nova-compute[72150]: DEBUG nova.network.neutron [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Successfully updated port: 2eee643a-cddb-40a2-bd09-a601fb3e773c {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:31:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58db76b0e1ae0f99284eea7f6d1ccd0da95d5bb1.part --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:31 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:31:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "refresh_cache-12a8b6e5-617d-466d-bb62-64b6b188f8f2" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:31:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquired lock "refresh_cache-12a8b6e5-617d-466d-bb62-64b6b188f8f2" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:31:31 user nova-compute[72150]: DEBUG nova.network.neutron [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:31:31 user nova-compute[72150]: DEBUG nova.compute.manager [req-0ebd0541-72ff-439d-ae64-a758e2825cdc req-15a818d4-5fac-4175-8c05-28936dd937a8 service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Received event network-changed-2eee643a-cddb-40a2-bd09-a601fb3e773c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:31 user nova-compute[72150]: DEBUG nova.compute.manager [req-0ebd0541-72ff-439d-ae64-a758e2825cdc req-15a818d4-5fac-4175-8c05-28936dd937a8 service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Refreshing instance network info cache due to event network-changed-2eee643a-cddb-40a2-bd09-a601fb3e773c. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:31:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0ebd0541-72ff-439d-ae64-a758e2825cdc req-15a818d4-5fac-4175-8c05-28936dd937a8 service nova] Acquiring lock "refresh_cache-12a8b6e5-617d-466d-bb62-64b6b188f8f2" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:31:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58db76b0e1ae0f99284eea7f6d1ccd0da95d5bb1.part --force-share --output=json" returned: 0 in 0.158s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:31 user nova-compute[72150]: DEBUG nova.virt.images [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] ca3624fb-cce5-494e-a993-a14e39b304f7 was qcow2, converting to raw {{(pid=72150) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 18:31:31 user nova-compute[72150]: DEBUG nova.privsep.utils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72150) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/58db76b0e1ae0f99284eea7f6d1ccd0da95d5bb1.part /opt/stack/data/nova/instances/_base/58db76b0e1ae0f99284eea7f6d1ccd0da95d5bb1.converted {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.network.neutron [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.compute.manager [req-5853f36e-0873-4d56-bbe6-896802c13be5 req-c02e38e9-cd54-4616-87eb-e2164f95670a service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received event network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5853f36e-0873-4d56-bbe6-896802c13be5 req-c02e38e9-cd54-4616-87eb-e2164f95670a service nova] Acquiring lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5853f36e-0873-4d56-bbe6-896802c13be5 req-c02e38e9-cd54-4616-87eb-e2164f95670a service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5853f36e-0873-4d56-bbe6-896802c13be5 req-c02e38e9-cd54-4616-87eb-e2164f95670a service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.compute.manager [req-5853f36e-0873-4d56-bbe6-896802c13be5 req-c02e38e9-cd54-4616-87eb-e2164f95670a service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] No waiting events found dispatching network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:31:32 user nova-compute[72150]: WARNING nova.compute.manager [req-5853f36e-0873-4d56-bbe6-896802c13be5 req-c02e38e9-cd54-4616-87eb-e2164f95670a service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received unexpected event network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 for instance with vm_state active and task_state rescuing.
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Starting finish_migration {{(pid=72150) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Instance directory exists: not creating {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 18:31:32 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Creating image(s)
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.objects.instance [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lazy-loading 'trusted_certs' on Instance uuid a5f0eca7-d060-4226-b36e-a3cd15b15703 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.145s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk. size=21474836480 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/58db76b0e1ae0f99284eea7f6d1ccd0da95d5bb1.part /opt/stack/data/nova/instances/_base/58db76b0e1ae0f99284eea7f6d1ccd0da95d5bb1.converted" returned: 0 in 0.363s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58db76b0e1ae0f99284eea7f6d1ccd0da95d5bb1.converted --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk 21474836480 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk 21474836480" returned: 0 in 0.043s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Did not create local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Ensure instance console log exists: /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Start _get_guest_xml network_info=[{"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1870690944-network", "vif_mac": "fa:16:3e:65:82:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fa5d7ef6-94c0-4bec-983d-6e3b5125546d', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDySdpws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a5f0eca7-d060-4226-b36e-a3cd15b15703', 'attached_at': '2023-08-01T18:31:31.000000', 'detached_at': '', 'volume_id': 'db690b5a-dd50-4971-9f5b-486fad1b1834', 'serial': 'db690b5a-dd50-4971-9f5b-486fad1b1834'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.network.neutron [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Updating instance_info_cache with network_info: [{"id": "2eee643a-cddb-40a2-bd09-a601fb3e773c", "address": "fa:16:3e:06:3b:ee", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee643a-cd", "ovs_interfaceid": "2eee643a-cddb-40a2-bd09-a601fb3e773c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Releasing lock "refresh_cache-12a8b6e5-617d-466d-bb62-64b6b188f8f2" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Instance network_info: |[{"id": "2eee643a-cddb-40a2-bd09-a601fb3e773c", "address": "fa:16:3e:06:3b:ee", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee643a-cd", "ovs_interfaceid": "2eee643a-cddb-40a2-bd09-a601fb3e773c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58db76b0e1ae0f99284eea7f6d1ccd0da95d5bb1.converted --force-share --output=json" returned: 0 in 0.164s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0ebd0541-72ff-439d-ae64-a758e2825cdc req-15a818d4-5fac-4175-8c05-28936dd937a8 service nova] Acquired lock "refresh_cache-12a8b6e5-617d-466d-bb62-64b6b188f8f2" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.network.neutron [req-0ebd0541-72ff-439d-ae64-a758e2825cdc req-15a818d4-5fac-4175-8c05-28936dd937a8 service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Refreshing network info cache for port 2eee643a-cddb-40a2-bd09-a601fb3e773c {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "58db76b0e1ae0f99284eea7f6d1ccd0da95d5bb1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.926s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquiring lock "58db76b0e1ae0f99284eea7f6d1ccd0da95d5bb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "58db76b0e1ae0f99284eea7f6d1ccd0da95d5bb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58db76b0e1ae0f99284eea7f6d1ccd0da95d5bb1 --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:32 user nova-compute[72150]: INFO nova.compute.manager [None req-72819698-9c0f-4964-ba2c-bc3c4ada90f7 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Unrescuing
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-72819698-9c0f-4964-ba2c-bc3c4ada90f7 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "refresh_cache-769690c8-53c5-4057-88a5-fbdbcb930e32" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-72819698-9c0f-4964-ba2c-bc3c4ada90f7 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquired lock "refresh_cache-769690c8-53c5-4057-88a5-fbdbcb930e32" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.network.neutron [None req-72819698-9c0f-4964-ba2c-bc3c4ada90f7 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:31:32 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:31:32 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.objects.instance [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lazy-loading 'vcpu_model' on Instance uuid a5f0eca7-d060-4226-b36e-a3cd15b15703 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDySdpws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:31:32 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:31:32 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:31:32 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:31:32 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:31:32 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58db76b0e1ae0f99284eea7f6d1ccd0da95d5bb1 --force-share --output=json" returned: 0 in 0.164s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/58db76b0e1ae0f99284eea7f6d1ccd0da95d5bb1,backing_fmt=raw /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk.rescue {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79da8d4-c41e-4895-87b1-0fc17b1b833d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:31:32 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/58db76b0e1ae0f99284eea7f6d1ccd0da95d5bb1,backing_fmt=raw /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk.rescue" returned: 0 in 0.058s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "58db76b0e1ae0f99284eea7f6d1ccd0da95d5bb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.objects.instance [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lazy-loading 'migration_context' on Instance uuid ceee3912-ca68-4b15-8fe6-985d905e8128 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Start _get_guest_xml network_info=[{"id": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "address": "fa:16:3e:e0:04:f1", "network": {"id": "838d4cba-b00d-46ff-ad55-9d7dd511581a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-732384801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-732384801-network", "vif_mac": "fa:16:3e:e0:04:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8759cb04dd744d7895a63bc5bd1d1c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee07a0f4-22", "ovs_interfaceid": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ca3624fb-cce5-494e-a993-a14e39b304f7', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5f190934-1553-4654-b931-dc613a69f676', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IaRyAEMh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'ceee3912-ca68-4b15-8fe6-985d905e8128', 'attached_at': '', 'detached_at': '', 'volume_id': '4853a41d-803e-4f6f-b35f-0fb4cf2ba697', 'serial': '4853a41d-803e-4f6f-b35f-0fb4cf2ba697'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.objects.instance [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lazy-loading 'resources' on Instance uuid ceee3912-ca68-4b15-8fe6-985d905e8128 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c2ecad-a3d2-4161-bbab-ea8c2ffb05db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834] added
Aug 01 18:31:32 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.objects.instance [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lazy-loading 'numa_topology' on Instance uuid ceee3912-ca68-4b15-8fe6-985d905e8128 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:32 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:31:32 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3e8799-c4ef-436d-b127-e784daf2ca13]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.objects.instance [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lazy-loading 'vcpu_model' on Instance uuid ceee3912-ca68-4b15-8fe6-985d905e8128 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IaRyAEMh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:31:32 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:31:32 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1353dd-0bf5-484b-9663-a6d595d2ae41]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gDySdpws {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gDySdpws" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0871fa-36d6-4163-8081-4bbf6d23ab0b]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gDySdpws'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a63bc2c-89f1-4d62-8771-41d520e5d2d3]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bee8de-f711-4cf6-ac64-4ff280ee118a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:32 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:32 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:32 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:31:32 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:32 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:32 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:32 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:31:32 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:31:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03a9768-719c-4d6c-b67e-abb5d1de9782]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260]
Aug 01 18:31:33 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260] successful.
Aug 01 18:31:33 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[444e5eb5-cda6-40d0-9a37-e9e63a7d2a45]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG nova.network.neutron [req-0ebd0541-72ff-439d-ae64-a758e2825cdc req-15a818d4-5fac-4175-8c05-28936dd937a8 service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Updated VIF entry in instance network info cache for port 2eee643a-cddb-40a2-bd09-a601fb3e773c. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG nova.network.neutron [req-0ebd0541-72ff-439d-ae64-a758e2825cdc req-15a818d4-5fac-4175-8c05-28936dd937a8 service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Updating instance_info_cache with network_info: [{"id": "2eee643a-cddb-40a2-bd09-a601fb3e773c", "address": "fa:16:3e:06:3b:ee", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee643a-cd", "ovs_interfaceid": "2eee643a-cddb-40a2-bd09-a601fb3e773c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b2236b-6a56-4161-86c7-4fee601b32b1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:33 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:33 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:33 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:31:33 user nova-compute[72150]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:31:33 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:33 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:33 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:33 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:31:33 user nova-compute[72150]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:31:33 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.429s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0ebd0541-72ff-439d-ae64-a758e2825cdc req-15a818d4-5fac-4175-8c05-28936dd937a8 service nova] Releasing lock "refresh_cache-12a8b6e5-617d-466d-bb62-64b6b188f8f2" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b30bbb-214a-4416-a5ca-eee0a618b27a]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDySdpws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG nova.network.neutron [None req-72819698-9c0f-4964-ba2c-bc3c4ada90f7 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Updating instance_info_cache with network_info: [{"id": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "address": "fa:16:3e:8e:d7:75", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2596e33-c1", "ovs_interfaceid": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-72819698-9c0f-4964-ba2c-bc3c4ada90f7 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Releasing lock "refresh_cache-769690c8-53c5-4057-88a5-fbdbcb930e32" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG nova.objects.instance [None req-72819698-9c0f-4964-ba2c-bc3c4ada90f7 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'flavor' on Instance uuid 769690c8-53c5-4057-88a5-fbdbcb930e32 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG nova.compute.manager [req-34414539-0c13-4bdc-9e47-3e084a728de9 req-12ba3eaa-1f02-4fb6-8ffa-5572e1acef58 service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received event network-vif-unplugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-34414539-0c13-4bdc-9e47-3e084a728de9 req-12ba3eaa-1f02-4fb6-8ffa-5572e1acef58 service nova] Acquiring lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-34414539-0c13-4bdc-9e47-3e084a728de9 req-12ba3eaa-1f02-4fb6-8ffa-5572e1acef58 service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-34414539-0c13-4bdc-9e47-3e084a728de9 req-12ba3eaa-1f02-4fb6-8ffa-5572e1acef58 service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG nova.compute.manager [req-34414539-0c13-4bdc-9e47-3e084a728de9 req-12ba3eaa-1f02-4fb6-8ffa-5572e1acef58 service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] No waiting events found dispatching network-vif-unplugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:31:33 user nova-compute[72150]: WARNING nova.compute.manager [req-34414539-0c13-4bdc-9e47-3e084a728de9 req-12ba3eaa-1f02-4fb6-8ffa-5572e1acef58 service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received unexpected event network-vif-unplugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:31:33 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:31:33 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:31:34 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Instance destroyed successfully.
Aug 01 18:31:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.469s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] <== connect_volume: return (1471ms) {'type': 'block', 'scsi_wwn': '23966623265323939', 'path': '/dev/sdf'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966623265323939', 'path': '/dev/sdf'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.272s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:31:34 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:31:34 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d83ef5-d7b6-49e7-8440-639ee7ee657a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = IaRyAEMh\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 18:31:34 user nova-compute[72150]: node.name = iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697
Aug 01 18:31:34 user nova-compute[72150]: node.tpgt = -1
Aug 01 18:31:34 user nova-compute[72150]: node.startup = automatic
Aug 01 18:31:34 user nova-compute[72150]: node.leading_login = No
Aug 01 18:31:34 user nova-compute[72150]: iface.iscsi_ifacename = default
Aug 01 18:31:34 user nova-compute[72150]: iface.net_ifacename = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.ipaddress = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.prefix_len = 0
Aug 01 18:31:34 user nova-compute[72150]: iface.hwaddress = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.transport_name = tcp
Aug 01 18:31:34 user nova-compute[72150]: iface.initiatorname = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.state = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.vlan_id = 0
Aug 01 18:31:34 user nova-compute[72150]: iface.vlan_priority = 0
Aug 01 18:31:34 user nova-compute[72150]: iface.vlan_state = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.iface_num = 0
Aug 01 18:31:34 user nova-compute[72150]: iface.mtu = 0
Aug 01 18:31:34 user nova-compute[72150]: iface.port = 0
Aug 01 18:31:34 user nova-compute[72150]: iface.bootproto = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.subnet_mask = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.gateway = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.dhcp_alt_client_id = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.dhcp_dns = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.dhcp_learn_iqn = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.dhcp_vendor_id_state = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.dhcp_vendor_id = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.dhcp_slp_da = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.fragmentation = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.gratuitous_arp = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.incoming_forwarding = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.tos_state = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.tos = 0
Aug 01 18:31:34 user nova-compute[72150]: iface.ttl = 0
Aug 01 18:31:34 user nova-compute[72150]: iface.delayed_ack = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.tcp_nagle = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.tcp_wsf_state = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.tcp_wsf = 0
Aug 01 18:31:34 user nova-compute[72150]: iface.tcp_timer_scale = 0
Aug 01 18:31:34 user nova-compute[72150]: iface.tcp_timestamp = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.redirect = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.def_task_mgmt_timeout = 0
Aug 01 18:31:34 user nova-compute[72150]: iface.header_digest = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.data_digest = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.immediate_data = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.initial_r2t = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.data_seq_inorder = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.data_pdu_inorder = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.erl = 0
Aug 01 18:31:34 user nova-compute[72150]: iface.max_receive_data_len = 0
Aug 01 18:31:34 user nova-compute[72150]: iface.first_burst_len = 0
Aug 01 18:31:34 user nova-compute[72150]: iface.max_outstanding_r2t = 0
Aug 01 18:31:34 user nova-compute[72150]: iface.max_burst_len = 0
Aug 01 18:31:34 user nova-compute[72150]: iface.chap_auth = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.bidi_chap = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.strict_login_compliance = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.discovery_auth = <empty>
Aug 01 18:31:34 user nova-compute[72150]: iface.discovery_logout = <empty>
Aug 01 18:31:34 user nova-compute[72150]: node.discovery_address = <empty>
Aug 01 18:31:34 user nova-compute[72150]: node.discovery_port = 0
Aug 01 18:31:34 user nova-compute[72150]: node.discovery_type = static
Aug 01 18:31:34 user nova-compute[72150]: node.session.initial_cmdsn = 0
Aug 01 18:31:34 user nova-compute[72150]: node.session.initial_login_retry_max = 8
Aug 01 18:31:34 user nova-compute[72150]: node.session.xmit_thread_priority = -20
Aug 01 18:31:34 user nova-compute[72150]: node.session.cmds_max = 128
Aug 01 18:31:34 user nova-compute[72150]: node.session.queue_depth = 32
Aug 01 18:31:34 user nova-compute[72150]: node.session.nr_sessions = 1
Aug 01 18:31:34 user nova-compute[72150]: node.session.auth.authmethod = CHAP
Aug 01 18:31:34 user nova-compute[72150]: node.session.auth.username = IaRyAEMh
Aug 01 18:31:34 user nova-compute[72150]: node.session.auth.password = ***
Aug 01 18:31:34 user nova-compute[72150]: node.session.auth.username_in = <empty>
Aug 01 18:31:34 user nova-compute[72150]: node.session.auth.password_in = <empty>
Aug 01 18:31:34 user nova-compute[72150]: node.session.auth.chap_algs = MD5
Aug 01 18:31:34 user nova-compute[72150]: node.session.timeo.replacement_timeout = 120
Aug 01 18:31:34 user nova-compute[72150]: node.session.err_timeo.abort_timeout = 15
Aug 01 18:31:34 user nova-compute[72150]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 18:31:34 user nova-compute[72150]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 18:31:34 user nova-compute[72150]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 18:31:34 user nova-compute[72150]: node.session.iscsi.FastAbort = Yes
Aug 01 18:31:34 user nova-compute[72150]: node.session.iscsi.InitialR2T = No
Aug 01 18:31:34 user nova-compute[72150]: node.session.iscsi.ImmediateData = Yes
Aug 01 18:31:34 user nova-compute[72150]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 18:31:34 user nova-compute[72150]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 18:31:34 user nova-compute[72150]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 18:31:34 user nova-compute[72150]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 18:31:34 user nova-compute[72150]: node.session.iscsi.MaxConnections = 1
Aug 01 18:31:34 user nova-compute[72150]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 18:31:34 user nova-compute[72150]: node.session.iscsi.ERL = 0
Aug 01 18:31:34 user nova-compute[72150]: node.session.scan = manual
Aug 01 18:31:34 user nova-compute[72150]: node.session.reopen_max = 0
Aug 01 18:31:34 user nova-compute[72150]: node.conn[0].address = 172.16.0.220
Aug 01 18:31:34 user nova-compute[72150]: node.conn[0].port = 3260
Aug 01 18:31:34 user nova-compute[72150]: node.conn[0].startup = manual
Aug 01 18:31:34 user nova-compute[72150]: node.conn[0].tcp.window_size = 524288
Aug 01 18:31:34 user nova-compute[72150]: node.conn[0].tcp.type_of_service = 0
Aug 01 18:31:34 user nova-compute[72150]: node.conn[0].timeo.logout_timeout = 15
Aug 01 18:31:34 user nova-compute[72150]: node.conn[0].timeo.login_timeout = 15
Aug 01 18:31:34 user nova-compute[72150]: node.conn[0].timeo.auth_timeout = 45
Aug 01 18:31:34 user nova-compute[72150]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 18:31:34 user nova-compute[72150]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 18:31:34 user nova-compute[72150]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 18:31:34 user nova-compute[72150]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 18:31:34 user nova-compute[72150]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 18:31:34 user nova-compute[72150]: node.conn[0].iscsi.DataDigest = None
Aug 01 18:31:34 user nova-compute[72150]: node.conn[0].iscsi.IFMarker = No
Aug 01 18:31:34 user nova-compute[72150]: node.conn[0].iscsi.OFMarker = No
Aug 01 18:31:34 user nova-compute[72150]: # END RECORD
Aug 01 18:31:34 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1769556587',display_name='tempest-ServerActionsTestOtherB-server-1769556587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1769556587',id=18,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHk1JfNPFXl8HOej4l4GGAFwiUlyr68TuvMkyJFt7CHfDXuZjpGZ30rkbU/oouT3R2Q9X+Pk0+5iMSh/dzvrWC0rsJ078sX31sP2prrj5uYPobmNDT4n3BlWJvWW4raDpA==',key_name='tempest-keypair-792111278',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:27:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3d566eb776234eb4a834d0e3f6dd7792',ramdisk_id='',reservation_id='r-o20tu0o3',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-623575398',owner_user_name='tempest-ServerActionsTestOtherB-623575398-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:31:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68c9836c352b488b934723c56f892c10',uuid=a5f0eca7-d060-4226-b36e-a3cd15b15703,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1870690944-network", "vif_mac": "fa:16:3e:65:82:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Converting VIF {"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1870690944-network", "vif_mac": "fa:16:3e:65:82:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc,network=Network(36c41dfd-577c-4ceb-a1f7-69187368b386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0a2205a-4b') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:31:34 user nova-compute[72150]:   <uuid>a5f0eca7-d060-4226-b36e-a3cd15b15703</uuid>
Aug 01 18:31:34 user nova-compute[72150]:   <name>instance-00000012</name>
Aug 01 18:31:34 user nova-compute[72150]:   <memory>2097152</memory>
Aug 01 18:31:34 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:31:34 user nova-compute[72150]:   <metadata>
Aug 01 18:31:34 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:31:34 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:31:34 user nova-compute[72150]:       <nova:name>tempest-ServerActionsTestOtherB-server-1769556587</nova:name>
Aug 01 18:31:34 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:31:32</nova:creationTime>
Aug 01 18:31:34 user nova-compute[72150]:       <nova:flavor name="m1.small">
Aug 01 18:31:34 user nova-compute[72150]:         <nova:memory>2048</nova:memory>
Aug 01 18:31:34 user nova-compute[72150]:         <nova:disk>20</nova:disk>
Aug 01 18:31:34 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:31:34 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:31:34 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:31:34 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:31:34 user nova-compute[72150]:       <nova:owner>
Aug 01 18:31:34 user nova-compute[72150]:         <nova:user uuid="68c9836c352b488b934723c56f892c10">tempest-ServerActionsTestOtherB-623575398-project-member</nova:user>
Aug 01 18:31:34 user nova-compute[72150]:         <nova:project uuid="3d566eb776234eb4a834d0e3f6dd7792">tempest-ServerActionsTestOtherB-623575398</nova:project>
Aug 01 18:31:34 user nova-compute[72150]:       </nova:owner>
Aug 01 18:31:34 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:31:34 user nova-compute[72150]:       <nova:ports>
Aug 01 18:31:34 user nova-compute[72150]:         <nova:port uuid="e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc">
Aug 01 18:31:34 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 18:31:34 user nova-compute[72150]:         </nova:port>
Aug 01 18:31:34 user nova-compute[72150]:       </nova:ports>
Aug 01 18:31:34 user nova-compute[72150]:     </nova:instance>
Aug 01 18:31:34 user nova-compute[72150]:   </metadata>
Aug 01 18:31:34 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:31:34 user nova-compute[72150]:     <system>
Aug 01 18:31:34 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:31:34 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:31:34 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:31:34 user nova-compute[72150]:       <entry name="serial">a5f0eca7-d060-4226-b36e-a3cd15b15703</entry>
Aug 01 18:31:34 user nova-compute[72150]:       <entry name="uuid">a5f0eca7-d060-4226-b36e-a3cd15b15703</entry>
Aug 01 18:31:34 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:31:34 user nova-compute[72150]:     </system>
Aug 01 18:31:34 user nova-compute[72150]:   </sysinfo>
Aug 01 18:31:34 user nova-compute[72150]:   <os>
Aug 01 18:31:34 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:31:34 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:31:34 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:31:34 user nova-compute[72150]:   </os>
Aug 01 18:31:34 user nova-compute[72150]:   <features>
Aug 01 18:31:34 user nova-compute[72150]:     <acpi/>
Aug 01 18:31:34 user nova-compute[72150]:     <apic/>
Aug 01 18:31:34 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:31:34 user nova-compute[72150]:   </features>
Aug 01 18:31:34 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:31:34 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:31:34 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:31:34 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:31:34 user nova-compute[72150]:   </clock>
Aug 01 18:31:34 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:31:34 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:31:34 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:31:34 user nova-compute[72150]:   </cpu>
Aug 01 18:31:34 user nova-compute[72150]:   <devices>
Aug 01 18:31:34 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:31:34 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:31:34 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk"/>
Aug 01 18:31:34 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:31:34 user nova-compute[72150]:     </disk>
Aug 01 18:31:34 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:31:34 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:31:34 user nova-compute[72150]:       <source dev="/dev/sdf"/>
Aug 01 18:31:34 user nova-compute[72150]:       <target dev="vdb" bus="virtio"/>
Aug 01 18:31:34 user nova-compute[72150]:       <serial>db690b5a-dd50-4971-9f5b-486fad1b1834</serial>
Aug 01 18:31:34 user nova-compute[72150]:     </disk>
Aug 01 18:31:34 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:31:34 user nova-compute[72150]:       <mac address="fa:16:3e:65:82:a8"/>
Aug 01 18:31:34 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:31:34 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:31:34 user nova-compute[72150]:       <target dev="tape0a2205a-4b"/>
Aug 01 18:31:34 user nova-compute[72150]:     </interface>
Aug 01 18:31:34 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:31:34 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/console.log" append="off"/>
Aug 01 18:31:34 user nova-compute[72150]:     </serial>
Aug 01 18:31:34 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:31:34 user nova-compute[72150]:     <video>
Aug 01 18:31:34 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:31:34 user nova-compute[72150]:     </video>
Aug 01 18:31:34 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:31:34 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:31:34 user nova-compute[72150]:     </rng>
Aug 01 18:31:34 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:31:34 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:31:34 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:31:34 user nova-compute[72150]:     </memballoon>
Aug 01 18:31:34 user nova-compute[72150]:   </devices>
Aug 01 18:31:34 user nova-compute[72150]: </domain>
Aug 01 18:31:34 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1769556587',display_name='tempest-ServerActionsTestOtherB-server-1769556587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1769556587',id=18,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHk1JfNPFXl8HOej4l4GGAFwiUlyr68TuvMkyJFt7CHfDXuZjpGZ30rkbU/oouT3R2Q9X+Pk0+5iMSh/dzvrWC0rsJ078sX31sP2prrj5uYPobmNDT4n3BlWJvWW4raDpA==',key_name='tempest-keypair-792111278',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:27:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3d566eb776234eb4a834d0e3f6dd7792',ramdisk_id='',reservation_id='r-o20tu0o3',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-623575398',owner_user_name='tempest-ServerActionsTestOtherB-623575398-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:31:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68c9836c352b488b934723c56f892c10',uuid=a5f0eca7-d060-4226-b36e-a3cd15b15703,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1870690944-network", "vif_mac": "fa:16:3e:65:82:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Converting VIF {"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1870690944-network", "vif_mac": "fa:16:3e:65:82:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc,network=Network(36c41dfd-577c-4ceb-a1f7-69187368b386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0a2205a-4b') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_vif [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc,network=Network(36c41dfd-577c-4ceb-a1f7-69187368b386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0a2205a-4b') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0a2205a-4b, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape0a2205a-4b, col_values=(('external_ids', {'iface-id': 'e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:82:a8', 'vm-uuid': 'a5f0eca7-d060-4226-b36e-a3cd15b15703'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d3e731-d9ee-4f72-97d2-3a6b320ea6fb]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:34 user nova-compute[72150]: INFO os_vif [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc,network=Network(36c41dfd-577c-4ceb-a1f7-69187368b386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0a2205a-4b')
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef19af80-e3ef-416f-93ca-d9b60f7c7b01]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IaRyAEMh {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IaRyAEMh" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bad19e2-564c-49a2-9089-1d8be4f340fd]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IaRyAEMh'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9204f25-197c-4bef-9749-709740228c0c]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] No VIF found with MAC fa:16:3e:65:82:a8, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09581af-6698-4d0a-8832-d1599a5bac28]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:34 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:34 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:34 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:31:34 user nova-compute[72150]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:31:34 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:34 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:34 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:34 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:31:34 user nova-compute[72150]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:31:34 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.160s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] HCTL ('36', '0', '0', 0) found on session 29 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[782c9a2f-3cf0-4310-8ae7-206cfc8cf484]: (4, ('0 0 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Searching for a device in session 29 and hctl ('36', '0', '0', 0) yield: sde {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IaRyAEMh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.185s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] <== connect_volume: return (1457ms) {'type': 'block', 'scsi_wwn': '23564613238363635', 'path': '/dev/sde'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564613238363635', 'path': '/dev/sde'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:27:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1031087304',display_name='tempest-ServerStableDeviceRescueTest-server-1031087304',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1031087304',id=19,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXknm48O+sHdtxwG6tm4FYBXZP3XaIW2WM3AK91piLPeoMnQQ4qv/ck/RizkVbsO3RmdgJYcVKp+GZNypXSFhAn+S6lpUIGjz/mDUmenWQw+T1tA09bruOrFwdJDPcLiA==',key_name='tempest-keypair-409987953',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:27:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8759cb04dd744d7895a63bc5bd1d1c83',ramdisk_id='',reservation_id='r-t0lo8wvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1141204139',owner_user_name='tempest-ServerStableDeviceRescueTest-1141204139-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e75ce9ed1ddf4011bf578b72580eedad',uuid=ceee3912-ca68-4b15-8fe6-985d905e8128,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "address": "fa:16:3e:e0:04:f1", "network": {"id": "838d4cba-b00d-46ff-ad55-9d7dd511581a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-732384801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-732384801-network", "vif_mac": "fa:16:3e:e0:04:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8759cb04dd744d7895a63bc5bd1d1c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee07a0f4-22", "ovs_interfaceid": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Converting VIF {"id": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "address": "fa:16:3e:e0:04:f1", "network": {"id": "838d4cba-b00d-46ff-ad55-9d7dd511581a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-732384801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-732384801-network", "vif_mac": "fa:16:3e:e0:04:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8759cb04dd744d7895a63bc5bd1d1c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee07a0f4-22", "ovs_interfaceid": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:04:f1,bridge_name='br-int',has_traffic_filtering=True,id=ee07a0f4-222d-4863-92b2-f70a7afd75f1,network=Network(838d4cba-b00d-46ff-ad55-9d7dd511581a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee07a0f4-22') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.objects.instance [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lazy-loading 'pci_devices' on Instance uuid ceee3912-ca68-4b15-8fe6-985d905e8128 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:31:34 user nova-compute[72150]:   <uuid>ceee3912-ca68-4b15-8fe6-985d905e8128</uuid>
Aug 01 18:31:34 user nova-compute[72150]:   <name>instance-00000013</name>
Aug 01 18:31:34 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:31:34 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:31:34 user nova-compute[72150]:   <metadata>
Aug 01 18:31:34 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:31:34 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:31:34 user nova-compute[72150]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1031087304</nova:name>
Aug 01 18:31:34 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:31:32</nova:creationTime>
Aug 01 18:31:34 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:31:34 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:31:34 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:31:34 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:31:34 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:31:34 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:31:34 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:31:34 user nova-compute[72150]:       <nova:owner>
Aug 01 18:31:34 user nova-compute[72150]:         <nova:user uuid="e75ce9ed1ddf4011bf578b72580eedad">tempest-ServerStableDeviceRescueTest-1141204139-project-member</nova:user>
Aug 01 18:31:34 user nova-compute[72150]:         <nova:project uuid="8759cb04dd744d7895a63bc5bd1d1c83">tempest-ServerStableDeviceRescueTest-1141204139</nova:project>
Aug 01 18:31:34 user nova-compute[72150]:       </nova:owner>
Aug 01 18:31:34 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:31:34 user nova-compute[72150]:       <nova:ports>
Aug 01 18:31:34 user nova-compute[72150]:         <nova:port uuid="ee07a0f4-222d-4863-92b2-f70a7afd75f1">
Aug 01 18:31:34 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 18:31:34 user nova-compute[72150]:         </nova:port>
Aug 01 18:31:34 user nova-compute[72150]:       </nova:ports>
Aug 01 18:31:34 user nova-compute[72150]:     </nova:instance>
Aug 01 18:31:34 user nova-compute[72150]:   </metadata>
Aug 01 18:31:34 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:31:34 user nova-compute[72150]:     <system>
Aug 01 18:31:34 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:31:34 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:31:34 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:31:34 user nova-compute[72150]:       <entry name="serial">ceee3912-ca68-4b15-8fe6-985d905e8128</entry>
Aug 01 18:31:34 user nova-compute[72150]:       <entry name="uuid">ceee3912-ca68-4b15-8fe6-985d905e8128</entry>
Aug 01 18:31:34 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:31:34 user nova-compute[72150]:     </system>
Aug 01 18:31:34 user nova-compute[72150]:   </sysinfo>
Aug 01 18:31:34 user nova-compute[72150]:   <os>
Aug 01 18:31:34 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:31:34 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:31:34 user nova-compute[72150]:   </os>
Aug 01 18:31:34 user nova-compute[72150]:   <features>
Aug 01 18:31:34 user nova-compute[72150]:     <acpi/>
Aug 01 18:31:34 user nova-compute[72150]:     <apic/>
Aug 01 18:31:34 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:31:34 user nova-compute[72150]:   </features>
Aug 01 18:31:34 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:31:34 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:31:34 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:31:34 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:31:34 user nova-compute[72150]:   </clock>
Aug 01 18:31:34 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:31:34 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:31:34 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:31:34 user nova-compute[72150]:   </cpu>
Aug 01 18:31:34 user nova-compute[72150]:   <devices>
Aug 01 18:31:34 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:31:34 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:31:34 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk"/>
Aug 01 18:31:34 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:31:34 user nova-compute[72150]:     </disk>
Aug 01 18:31:34 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:31:34 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:31:34 user nova-compute[72150]:       <source dev="/dev/sde"/>
Aug 01 18:31:34 user nova-compute[72150]:       <target dev="vdb" bus="virtio"/>
Aug 01 18:31:34 user nova-compute[72150]:       <serial>4853a41d-803e-4f6f-b35f-0fb4cf2ba697</serial>
Aug 01 18:31:34 user nova-compute[72150]:     </disk>
Aug 01 18:31:34 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:31:34 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:31:34 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk.rescue"/>
Aug 01 18:31:34 user nova-compute[72150]:       <target dev="vdc" bus="virtio"/>
Aug 01 18:31:34 user nova-compute[72150]:       <boot order="1"/>
Aug 01 18:31:34 user nova-compute[72150]:     </disk>
Aug 01 18:31:34 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:31:34 user nova-compute[72150]:       <mac address="fa:16:3e:e0:04:f1"/>
Aug 01 18:31:34 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:31:34 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:31:34 user nova-compute[72150]:       <target dev="tapee07a0f4-22"/>
Aug 01 18:31:34 user nova-compute[72150]:     </interface>
Aug 01 18:31:34 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:31:34 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/console.log" append="off"/>
Aug 01 18:31:34 user nova-compute[72150]:     </serial>
Aug 01 18:31:34 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:31:34 user nova-compute[72150]:     <video>
Aug 01 18:31:34 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:31:34 user nova-compute[72150]:     </video>
Aug 01 18:31:34 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:31:34 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:31:34 user nova-compute[72150]:     </rng>
Aug 01 18:31:34 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:31:34 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:31:34 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:31:34 user nova-compute[72150]:     </memballoon>
Aug 01 18:31:34 user nova-compute[72150]:   </devices>
Aug 01 18:31:34 user nova-compute[72150]: </domain>
Aug 01 18:31:34 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:31:34 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Instance destroyed successfully.
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] No VIF found with MAC fa:16:3e:e0:04:f1, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.utils [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce080e8-1f57-46d7-a934-f44684dca394]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fdf381-f66c-4298-9252-0ee043be85e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[62992ccb-c587-4a22-add6-8624f45e794c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de73ea5-57fb-4dec-ad0a-c48c35b1f687]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:31:34 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e74989-a43b-492b-b6b0-43dd6ea9b33b]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG os_brick.utils [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Updating existing volume attachment record: 3463dcab-2ff5-4ba6-a6e0-df4327b1590b {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:34 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:31:35 user nova-compute[72150]: DEBUG nova.compute.manager [req-bc3bb7fc-f510-4438-ac41-270e06b69b40 req-f6e3cbb1-bde2-4da7-9dea-604fdd6fa91e service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received event network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bc3bb7fc-f510-4438-ac41-270e06b69b40 req-f6e3cbb1-bde2-4da7-9dea-604fdd6fa91e service nova] Acquiring lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bc3bb7fc-f510-4438-ac41-270e06b69b40 req-f6e3cbb1-bde2-4da7-9dea-604fdd6fa91e service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bc3bb7fc-f510-4438-ac41-270e06b69b40 req-f6e3cbb1-bde2-4da7-9dea-604fdd6fa91e service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:35 user nova-compute[72150]: DEBUG nova.compute.manager [req-bc3bb7fc-f510-4438-ac41-270e06b69b40 req-f6e3cbb1-bde2-4da7-9dea-604fdd6fa91e service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] No waiting events found dispatching network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:31:35 user nova-compute[72150]: WARNING nova.compute.manager [req-bc3bb7fc-f510-4438-ac41-270e06b69b40 req-f6e3cbb1-bde2-4da7-9dea-604fdd6fa91e service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received unexpected event network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:31:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:37 user nova-compute[72150]: DEBUG nova.compute.manager [req-8ee4167d-adf7-4a3e-855d-65d327d3fd01 req-360cd10a-0247-4773-b823-65075c587caa service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received event network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8ee4167d-adf7-4a3e-855d-65d327d3fd01 req-360cd10a-0247-4773-b823-65075c587caa service nova] Acquiring lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8ee4167d-adf7-4a3e-855d-65d327d3fd01 req-360cd10a-0247-4773-b823-65075c587caa service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8ee4167d-adf7-4a3e-855d-65d327d3fd01 req-360cd10a-0247-4773-b823-65075c587caa service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:37 user nova-compute[72150]: DEBUG nova.compute.manager [req-8ee4167d-adf7-4a3e-855d-65d327d3fd01 req-360cd10a-0247-4773-b823-65075c587caa service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] No waiting events found dispatching network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:31:37 user nova-compute[72150]: WARNING nova.compute.manager [req-8ee4167d-adf7-4a3e-855d-65d327d3fd01 req-360cd10a-0247-4773-b823-65075c587caa service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received unexpected event network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc for instance with vm_state active and task_state resize_finish.
Aug 01 18:31:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:38 user nova-compute[72150]: DEBUG nova.compute.manager [req-d1b6fc24-f65c-4159-9339-5abf182eab48 req-25bf0128-f946-4f82-a2a3-8151f93c35ae service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received event network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d1b6fc24-f65c-4159-9339-5abf182eab48 req-25bf0128-f946-4f82-a2a3-8151f93c35ae service nova] Acquiring lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d1b6fc24-f65c-4159-9339-5abf182eab48 req-25bf0128-f946-4f82-a2a3-8151f93c35ae service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d1b6fc24-f65c-4159-9339-5abf182eab48 req-25bf0128-f946-4f82-a2a3-8151f93c35ae service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:38 user nova-compute[72150]: DEBUG nova.compute.manager [req-d1b6fc24-f65c-4159-9339-5abf182eab48 req-25bf0128-f946-4f82-a2a3-8151f93c35ae service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] No waiting events found dispatching network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:31:38 user nova-compute[72150]: WARNING nova.compute.manager [req-d1b6fc24-f65c-4159-9339-5abf182eab48 req-25bf0128-f946-4f82-a2a3-8151f93c35ae service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received unexpected event network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:31:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:39 user nova-compute[72150]: DEBUG nova.compute.manager [req-09341c25-3d9b-40d2-99d4-9f57e2f0a2f4 req-2130a27f-08d9-4dad-9a0d-0a93429e7128 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received event network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-09341c25-3d9b-40d2-99d4-9f57e2f0a2f4 req-2130a27f-08d9-4dad-9a0d-0a93429e7128 service nova] Acquiring lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-09341c25-3d9b-40d2-99d4-9f57e2f0a2f4 req-2130a27f-08d9-4dad-9a0d-0a93429e7128 service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-09341c25-3d9b-40d2-99d4-9f57e2f0a2f4 req-2130a27f-08d9-4dad-9a0d-0a93429e7128 service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:39 user nova-compute[72150]: DEBUG nova.compute.manager [req-09341c25-3d9b-40d2-99d4-9f57e2f0a2f4 req-2130a27f-08d9-4dad-9a0d-0a93429e7128 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] No waiting events found dispatching network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:31:39 user nova-compute[72150]: WARNING nova.compute.manager [req-09341c25-3d9b-40d2-99d4-9f57e2f0a2f4 req-2130a27f-08d9-4dad-9a0d-0a93429e7128 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received unexpected event network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc for instance with vm_state active and task_state resize_finish.
Aug 01 18:31:39 user nova-compute[72150]: DEBUG nova.compute.manager [req-09341c25-3d9b-40d2-99d4-9f57e2f0a2f4 req-2130a27f-08d9-4dad-9a0d-0a93429e7128 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received event network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-09341c25-3d9b-40d2-99d4-9f57e2f0a2f4 req-2130a27f-08d9-4dad-9a0d-0a93429e7128 service nova] Acquiring lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-09341c25-3d9b-40d2-99d4-9f57e2f0a2f4 req-2130a27f-08d9-4dad-9a0d-0a93429e7128 service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-09341c25-3d9b-40d2-99d4-9f57e2f0a2f4 req-2130a27f-08d9-4dad-9a0d-0a93429e7128 service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:39 user nova-compute[72150]: DEBUG nova.compute.manager [req-09341c25-3d9b-40d2-99d4-9f57e2f0a2f4 req-2130a27f-08d9-4dad-9a0d-0a93429e7128 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] No waiting events found dispatching network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:31:39 user nova-compute[72150]: WARNING nova.compute.manager [req-09341c25-3d9b-40d2-99d4-9f57e2f0a2f4 req-2130a27f-08d9-4dad-9a0d-0a93429e7128 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received unexpected event network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 for instance with vm_state active and task_state rescuing.
Aug 01 18:31:39 user nova-compute[72150]: DEBUG nova.compute.manager [req-09341c25-3d9b-40d2-99d4-9f57e2f0a2f4 req-2130a27f-08d9-4dad-9a0d-0a93429e7128 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received event network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-09341c25-3d9b-40d2-99d4-9f57e2f0a2f4 req-2130a27f-08d9-4dad-9a0d-0a93429e7128 service nova] Acquiring lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-09341c25-3d9b-40d2-99d4-9f57e2f0a2f4 req-2130a27f-08d9-4dad-9a0d-0a93429e7128 service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-09341c25-3d9b-40d2-99d4-9f57e2f0a2f4 req-2130a27f-08d9-4dad-9a0d-0a93429e7128 service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:39 user nova-compute[72150]: DEBUG nova.compute.manager [req-09341c25-3d9b-40d2-99d4-9f57e2f0a2f4 req-2130a27f-08d9-4dad-9a0d-0a93429e7128 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] No waiting events found dispatching network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:31:39 user nova-compute[72150]: WARNING nova.compute.manager [req-09341c25-3d9b-40d2-99d4-9f57e2f0a2f4 req-2130a27f-08d9-4dad-9a0d-0a93429e7128 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received unexpected event network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 for instance with vm_state active and task_state rescuing.
Aug 01 18:31:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:40 user nova-compute[72150]: INFO nova.compute.manager [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Terminating instance
Aug 01 18:31:40 user nova-compute[72150]: DEBUG nova.compute.manager [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG nova.compute.manager [req-13e91438-381a-42c8-8441-9dcdbec62eb5 req-7c0a23a0-6c25-4d7b-9a11-06e250a7e40a service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received event network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-13e91438-381a-42c8-8441-9dcdbec62eb5 req-7c0a23a0-6c25-4d7b-9a11-06e250a7e40a service nova] Acquiring lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-13e91438-381a-42c8-8441-9dcdbec62eb5 req-7c0a23a0-6c25-4d7b-9a11-06e250a7e40a service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-13e91438-381a-42c8-8441-9dcdbec62eb5 req-7c0a23a0-6c25-4d7b-9a11-06e250a7e40a service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG nova.compute.manager [req-13e91438-381a-42c8-8441-9dcdbec62eb5 req-7c0a23a0-6c25-4d7b-9a11-06e250a7e40a service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] No waiting events found dispatching network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:31:40 user nova-compute[72150]: WARNING nova.compute.manager [req-13e91438-381a-42c8-8441-9dcdbec62eb5 req-7c0a23a0-6c25-4d7b-9a11-06e250a7e40a service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received unexpected event network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:31:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:40 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Instance destroyed successfully.
Aug 01 18:31:40 user nova-compute[72150]: DEBUG nova.objects.instance [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lazy-loading 'resources' on Instance uuid bcbfca8c-8bdb-47d2-addc-e1cec3166dc5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:25:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-305923291',display_name='tempest-VolumesAdminNegativeTest-server-305923291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-305923291',id=14,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhI0J2LgLlhmz64E9H3ZZx9WG9/v4mH1FMBdr6DCcGeiFSI+aP8/S9hKog9/dYzZA5h1KB1uzFWuxUcpa4s90okkwf4TI4ic4BjmqODxa8v8DAFodiCuBSAbN5gmpPjJQ==',key_name='tempest-keypair-664633611',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:25:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41181268f4754733811b1abdad7eeb21',ramdisk_id='',reservation_id='r-lbrpjdbq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-38137380',owner_user_name='tempest-VolumesAdminNegativeTest-38137380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:25:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8264f17490ec46638cf38187aab3ce4c',uuid=bcbfca8c-8bdb-47d2-addc-e1cec3166dc5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "242e141b-d5fa-4e86-82ae-26b993342476", "address": "fa:16:3e:26:8b:9c", "network": {"id": "633e7e89-16a6-4a46-8d94-0a1cc6891579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211447573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41181268f4754733811b1abdad7eeb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242e141b-d5", "ovs_interfaceid": "242e141b-d5fa-4e86-82ae-26b993342476", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Converting VIF {"id": "242e141b-d5fa-4e86-82ae-26b993342476", "address": "fa:16:3e:26:8b:9c", "network": {"id": "633e7e89-16a6-4a46-8d94-0a1cc6891579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211447573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41181268f4754733811b1abdad7eeb21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242e141b-d5", "ovs_interfaceid": "242e141b-d5fa-4e86-82ae-26b993342476", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:8b:9c,bridge_name='br-int',has_traffic_filtering=True,id=242e141b-d5fa-4e86-82ae-26b993342476,network=Network(633e7e89-16a6-4a46-8d94-0a1cc6891579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap242e141b-d5') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG os_vif [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:8b:9c,bridge_name='br-int',has_traffic_filtering=True,id=242e141b-d5fa-4e86-82ae-26b993342476,network=Network(633e7e89-16a6-4a46-8d94-0a1cc6891579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap242e141b-d5') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap242e141b-d5, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:31:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:31:40 user nova-compute[72150]: INFO os_vif [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:8b:9c,bridge_name='br-int',has_traffic_filtering=True,id=242e141b-d5fa-4e86-82ae-26b993342476,network=Network(633e7e89-16a6-4a46-8d94-0a1cc6891579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap242e141b-d5')
Aug 01 18:31:40 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Deleting instance files /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5_del
Aug 01 18:31:40 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Deletion of /opt/stack/data/nova/instances/bcbfca8c-8bdb-47d2-addc-e1cec3166dc5_del complete
Aug 01 18:31:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "eb113972-7a86-4cb7-9f8d-ca690693e27d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:41 user nova-compute[72150]: INFO nova.compute.manager [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.objects.instance [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lazy-loading 'flavor' on Instance uuid eb113972-7a86-4cb7-9f8d-ca690693e27d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914701.1502297, a5f0eca7-d060-4226-b36e-a3cd15b15703 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:31:41 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] VM Resumed (Lifecycle Event)
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-72819698-9c0f-4964-ba2c-bc3c4ada90f7 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:31:41 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Instance running successfully.
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-6c3ab29f-50a5-4615-8bc2-376e43af912c tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Failed to set time: agent not configured {{(pid=72150) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a23ffd2f-2883-4ce0-9e95-728a99ea0c48 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] finish_migration finished successfully. {{(pid=72150) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "eb113972-7a86-4cb7-9f8d-ca690693e27d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:41 user nova-compute[72150]: INFO nova.compute.manager [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Attaching volume aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 to /dev/vdb
Aug 01 18:31:41 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Removed pending event for 769690c8-53c5-4057-88a5-fbdbcb930e32 due to event {{(pid=72150) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914701.1570005, 769690c8-53c5-4057-88a5-fbdbcb930e32 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:31:41 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] VM Resumed (Lifecycle Event)
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914701.1574755, a5f0eca7-d060-4226-b36e-a3cd15b15703 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:31:41 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] VM Started (Lifecycle Event)
Aug 01 18:31:41 user nova-compute[72150]: DEBUG os_brick.utils [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaba025f-2db0-4a75-8839-ac0b61e69b35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba16823f-4794-4496-a651-26986b14d1ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914701.157882, 769690c8-53c5-4057-88a5-fbdbcb930e32 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:31:41 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] VM Started (Lifecycle Event)
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacda9cc-9e89-45c9-94dc-9dd4355b2d6b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fedc95-f7d9-4274-a80a-dd739a0ade13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:31:41 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a742cc7-ade1-494a-a574-9f6f59e096cb]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG os_brick.utils [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] <== get_connector_properties: return (247ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Updating existing volume attachment record: 9ce520b3-a1cb-4dcb-a6f4-f7d3061f7add {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Removed pending event for ceee3912-ca68-4b15-8fe6-985d905e8128 due to event {{(pid=72150) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914701.2076924, ceee3912-ca68-4b15-8fe6-985d905e8128 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:31:41 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] VM Resumed (Lifecycle Event)
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.compute.manager [req-bcd06028-93d8-4736-a2ae-5c36d9222f63 req-96076f5a-629d-4a0f-93eb-ae6bb60eecd7 service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Received event network-vif-unplugged-242e141b-d5fa-4e86-82ae-26b993342476 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bcd06028-93d8-4736-a2ae-5c36d9222f63 req-96076f5a-629d-4a0f-93eb-ae6bb60eecd7 service nova] Acquiring lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bcd06028-93d8-4736-a2ae-5c36d9222f63 req-96076f5a-629d-4a0f-93eb-ae6bb60eecd7 service nova] Lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bcd06028-93d8-4736-a2ae-5c36d9222f63 req-96076f5a-629d-4a0f-93eb-ae6bb60eecd7 service nova] Lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.compute.manager [req-bcd06028-93d8-4736-a2ae-5c36d9222f63 req-96076f5a-629d-4a0f-93eb-ae6bb60eecd7 service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] No waiting events found dispatching network-vif-unplugged-242e141b-d5fa-4e86-82ae-26b993342476 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.compute.manager [req-bcd06028-93d8-4736-a2ae-5c36d9222f63 req-96076f5a-629d-4a0f-93eb-ae6bb60eecd7 service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Received event network-vif-unplugged-242e141b-d5fa-4e86-82ae-26b993342476 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.compute.manager [req-bcd06028-93d8-4736-a2ae-5c36d9222f63 req-96076f5a-629d-4a0f-93eb-ae6bb60eecd7 service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Received event network-vif-plugged-242e141b-d5fa-4e86-82ae-26b993342476 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bcd06028-93d8-4736-a2ae-5c36d9222f63 req-96076f5a-629d-4a0f-93eb-ae6bb60eecd7 service nova] Acquiring lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bcd06028-93d8-4736-a2ae-5c36d9222f63 req-96076f5a-629d-4a0f-93eb-ae6bb60eecd7 service nova] Lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bcd06028-93d8-4736-a2ae-5c36d9222f63 req-96076f5a-629d-4a0f-93eb-ae6bb60eecd7 service nova] Lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.compute.manager [req-bcd06028-93d8-4736-a2ae-5c36d9222f63 req-96076f5a-629d-4a0f-93eb-ae6bb60eecd7 service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] No waiting events found dispatching network-vif-plugged-242e141b-d5fa-4e86-82ae-26b993342476 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:31:41 user nova-compute[72150]: WARNING nova.compute.manager [req-bcd06028-93d8-4736-a2ae-5c36d9222f63 req-96076f5a-629d-4a0f-93eb-ae6bb60eecd7 service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Received unexpected event network-vif-plugged-242e141b-d5fa-4e86-82ae-26b993342476 for instance with vm_state active and task_state deleting.
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914701.2090447, ceee3912-ca68-4b15-8fe6-985d905e8128 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:31:41 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] VM Started (Lifecycle Event)
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:42 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:31:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:42 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Took 1.20 seconds to deallocate network for instance.
Aug 01 18:31:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:42 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Error from libvirt while getting description of instance-0000000e: [Error Code 42] Domain not found: no domain with matching uuid 'bcbfca8c-8bdb-47d2-addc-e1cec3166dc5' (instance-0000000e): libvirt.libvirtError: Domain not found: no domain with matching uuid 'bcbfca8c-8bdb-47d2-addc-e1cec3166dc5' (instance-0000000e)
Aug 01 18:31:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:31:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e75a98-beb1-4688-a375-affc63b14252/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e75a98-beb1-4688-a375-affc63b14252/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e75a98-beb1-4688-a375-affc63b14252/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e75a98-beb1-4688-a375-affc63b14252/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:42 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:31:42 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:31:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.704s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:43 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Deleted allocations for instance bcbfca8c-8bdb-47d2-addc-e1cec3166dc5
Aug 01 18:31:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:31:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dc9bced4-6659-4a7a-8ef9-58b8382c3dd1 tempest-VolumesAdminNegativeTest-38137380 tempest-VolumesAdminNegativeTest-38137380-project-member] Lock "bcbfca8c-8bdb-47d2-addc-e1cec3166dc5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.239s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:43 user nova-compute[72150]: DEBUG nova.compute.manager [req-cb4c0cfd-6611-453b-8c16-210fe38a806c req-0c0f3996-0c25-4950-95cb-19c2d873f10b service nova] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Received event network-vif-deleted-242e141b-d5fa-4e86-82ae-26b993342476 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:31:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:31:45 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:31:45 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:31:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=7303MB free_disk=25.207935333251953GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:31:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Applying migration context for instance a5f0eca7-d060-4226-b36e-a3cd15b15703 as it has an incoming, in-progress migration 2182feaa-9b23-4385-8e0a-7709471ff371. Migration status is finished {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 18:31:45 user nova-compute[72150]: INFO nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Updating resource usage from migration 2182feaa-9b23-4385-8e0a-7709471ff371
Aug 01 18:31:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 769690c8-53c5-4057-88a5-fbdbcb930e32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:31:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ea68420b-8362-4df3-b710-cd1cf76adba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:31:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 08851ec4-6f71-4ec1-a092-42aab83ee87f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:31:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance bf2d1f14-2227-41d1-bd73-a05ab3149aba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:31:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ceee3912-ca68-4b15-8fe6-985d905e8128 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:31:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 42e75a98-beb1-4688-a375-affc63b14252 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:31:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 1de0ad54-0d7a-4287-9532-7b4982b1e2bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:31:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance eb113972-7a86-4cb7-9f8d-ca690693e27d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:31:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance beb6d063-d147-4033-ae73-55ff95a48efa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:31:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Migration 2182feaa-9b23-4385-8e0a-7709471ff371 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 18:31:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance a5f0eca7-d060-4226-b36e-a3cd15b15703 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:31:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 12a8b6e5-617d-466d-bb62-64b6b188f8f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:31:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:31:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:31:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:46 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:31:46 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:31:46 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:31:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.706s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:31:47 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Creating image(s)
Aug 01 18:31:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Did not create local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Ensure instance console log exists: /opt/stack/data/nova/instances/12a8b6e5-617d-466d-bb62-64b6b188f8f2/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Start _get_guest_xml network_info=[{"id": "2eee643a-cddb-40a2-bd09-a601fb3e773c", "address": "fa:16:3e:06:3b:ee", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee643a-cd", "ovs_interfaceid": "2eee643a-cddb-40a2-bd09-a601fb3e773c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-01T18:31:20Z,direct_url=<?>,disk_format='qcow2',id=d708b95f-4833-4ec7-a783-08e6cabb0ad2,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-746248459',owner='e7ca44f23b114893afcfe57c52f693b1',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-01T18:31:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3463dcab-2ff5-4ba6-a6e0-df4327b1590b', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WCDNuxlT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '12a8b6e5-617d-466d-bb62-64b6b188f8f2', 'attached_at': '', 'detached_at': '', 'volume_id': '0a037645-735b-4c94-87ea-4648fc8201e0', 'serial': '0a037645-735b-4c94-87ea-4648fc8201e0'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:31:47 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:31:47 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:31:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-01T18:31:20Z,direct_url=<?>,disk_format='qcow2',id=d708b95f-4833-4ec7-a783-08e6cabb0ad2,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-746248459',owner='e7ca44f23b114893afcfe57c52f693b1',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-01T18:31:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WCDNuxlT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:31:47 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:31:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:31:47 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:31:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:31:47 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f3c0b8-23d5-4202-8528-8795819c30f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:31:47 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6684d7-9751-4cb1-9d14-f6a31f332513]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0] added
Aug 01 18:31:47 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[462c409e-b10a-429a-bbab-eedec769c3af]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[853fcafd-dd7e-41b0-89fe-1c3d3379930c]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WCDNuxlT {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WCDNuxlT" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfa4552-9d05-44ae-891d-e00e91312456]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WCDNuxlT'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb956ca1-70b7-4e8d-b7b6-bb674ede699a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea2d8be-5629-4ced-8c72-04534de1df7c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:47 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:47 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:47 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:31:47 user nova-compute[72150]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:31:47 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:47 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:47 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:47 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:31:47 user nova-compute[72150]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:31:47 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2183725e-0db8-48af-ab51-5f581ad41dd7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0, portal: 172.16.0.220,3260]
Aug 01 18:31:47 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0, portal: 172.16.0.220,3260] successful.
Aug 01 18:31:47 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e9416b-c44d-41bb-8527-e01004c1e85b]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5d8adc-8341-4f37-a8ef-dc2310760b54]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:48 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:48 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:48 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:31:48 user nova-compute[72150]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:31:48 user nova-compute[72150]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)
Aug 01 18:31:48 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:31:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:48 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:48 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:48 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:31:48 user nova-compute[72150]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:31:48 user nova-compute[72150]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)
Aug 01 18:31:48 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:31:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:31:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:31:48 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] HCTL ('38', '-', '-', 0) found on session 31 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:31:48 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:31:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[55685b9a-63e2-4a32-b5e0-ddecdcd8bb4c]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:48 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:31:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WCDNuxlT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:31:48 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:31:48 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:31:48 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:31:48 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Didn't find any instances for network info cache update. {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 18:31:48 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:31:48 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:31:48 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23939373832383662', 'path': '/dev/sdg'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939373832383662', 'path': '/dev/sdg'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:31:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1468554315',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1468554315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1468554315',id=26,image_ref='d708b95f-4833-4ec7-a783-08e6cabb0ad2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMGg7Kxa7OMRUjZQxVpCqLSg9YDkUGHU4bHybYt4DML3EYP4lULgEFq9DndpYpf2p++D3dGVS6y4rE2tx0KYfBgvdZYbDEm8A05fXO3AQ/QOsxPUtSxJtfrFsrEFBjIBA==',key_name='tempest-keypair-66113531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7ca44f23b114893afcfe57c52f693b1',ramdisk_id='',reservation_id='r-v1pi2flv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-295340968',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-295340968-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-295340968',owner_user_name='tempest-TestVolumeBootPattern-295340968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:31:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92c7ef0ed6814f8880de76adb913a487',uuid=12a8b6e5-617d-466d-bb62-64b6b188f8f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eee643a-cddb-40a2-bd09-a601fb3e773c", "address": "fa:16:3e:06:3b:ee", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee643a-cd", "ovs_interfaceid": "2eee643a-cddb-40a2-bd09-a601fb3e773c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converting VIF {"id": "2eee643a-cddb-40a2-bd09-a601fb3e773c", "address": "fa:16:3e:06:3b:ee", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee643a-cd", "ovs_interfaceid": "2eee643a-cddb-40a2-bd09-a601fb3e773c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:3b:ee,bridge_name='br-int',has_traffic_filtering=True,id=2eee643a-cddb-40a2-bd09-a601fb3e773c,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eee643a-cd') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG nova.objects.instance [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lazy-loading 'pci_devices' on Instance uuid 12a8b6e5-617d-466d-bb62-64b6b188f8f2 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:31:49 user nova-compute[72150]:   <uuid>12a8b6e5-617d-466d-bb62-64b6b188f8f2</uuid>
Aug 01 18:31:49 user nova-compute[72150]:   <name>instance-0000001a</name>
Aug 01 18:31:49 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:31:49 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:31:49 user nova-compute[72150]:   <metadata>
Aug 01 18:31:49 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:31:49 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:31:49 user nova-compute[72150]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1468554315</nova:name>
Aug 01 18:31:49 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:31:47</nova:creationTime>
Aug 01 18:31:49 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:31:49 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:31:49 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:31:49 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:31:49 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:31:49 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:31:49 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:31:49 user nova-compute[72150]:       <nova:owner>
Aug 01 18:31:49 user nova-compute[72150]:         <nova:user uuid="92c7ef0ed6814f8880de76adb913a487">tempest-TestVolumeBootPattern-295340968-project-member</nova:user>
Aug 01 18:31:49 user nova-compute[72150]:         <nova:project uuid="e7ca44f23b114893afcfe57c52f693b1">tempest-TestVolumeBootPattern-295340968</nova:project>
Aug 01 18:31:49 user nova-compute[72150]:       </nova:owner>
Aug 01 18:31:49 user nova-compute[72150]:       <nova:root type="image" uuid="d708b95f-4833-4ec7-a783-08e6cabb0ad2"/>
Aug 01 18:31:49 user nova-compute[72150]:       <nova:ports>
Aug 01 18:31:49 user nova-compute[72150]:         <nova:port uuid="2eee643a-cddb-40a2-bd09-a601fb3e773c">
Aug 01 18:31:49 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 18:31:49 user nova-compute[72150]:         </nova:port>
Aug 01 18:31:49 user nova-compute[72150]:       </nova:ports>
Aug 01 18:31:49 user nova-compute[72150]:     </nova:instance>
Aug 01 18:31:49 user nova-compute[72150]:   </metadata>
Aug 01 18:31:49 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:31:49 user nova-compute[72150]:     <system>
Aug 01 18:31:49 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:31:49 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:31:49 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:31:49 user nova-compute[72150]:       <entry name="serial">12a8b6e5-617d-466d-bb62-64b6b188f8f2</entry>
Aug 01 18:31:49 user nova-compute[72150]:       <entry name="uuid">12a8b6e5-617d-466d-bb62-64b6b188f8f2</entry>
Aug 01 18:31:49 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:31:49 user nova-compute[72150]:     </system>
Aug 01 18:31:49 user nova-compute[72150]:   </sysinfo>
Aug 01 18:31:49 user nova-compute[72150]:   <os>
Aug 01 18:31:49 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:31:49 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:31:49 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:31:49 user nova-compute[72150]:   </os>
Aug 01 18:31:49 user nova-compute[72150]:   <features>
Aug 01 18:31:49 user nova-compute[72150]:     <acpi/>
Aug 01 18:31:49 user nova-compute[72150]:     <apic/>
Aug 01 18:31:49 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:31:49 user nova-compute[72150]:   </features>
Aug 01 18:31:49 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:31:49 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:31:49 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:31:49 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:31:49 user nova-compute[72150]:   </clock>
Aug 01 18:31:49 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:31:49 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:31:49 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:31:49 user nova-compute[72150]:   </cpu>
Aug 01 18:31:49 user nova-compute[72150]:   <devices>
Aug 01 18:31:49 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:31:49 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:31:49 user nova-compute[72150]:       <source dev="/dev/sdg"/>
Aug 01 18:31:49 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:31:49 user nova-compute[72150]:       <serial>0a037645-735b-4c94-87ea-4648fc8201e0</serial>
Aug 01 18:31:49 user nova-compute[72150]:     </disk>
Aug 01 18:31:49 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:31:49 user nova-compute[72150]:       <mac address="fa:16:3e:06:3b:ee"/>
Aug 01 18:31:49 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:31:49 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:31:49 user nova-compute[72150]:       <target dev="tap2eee643a-cd"/>
Aug 01 18:31:49 user nova-compute[72150]:     </interface>
Aug 01 18:31:49 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:31:49 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/12a8b6e5-617d-466d-bb62-64b6b188f8f2/console.log" append="off"/>
Aug 01 18:31:49 user nova-compute[72150]:     </serial>
Aug 01 18:31:49 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:31:49 user nova-compute[72150]:     <video>
Aug 01 18:31:49 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:31:49 user nova-compute[72150]:     </video>
Aug 01 18:31:49 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:31:49 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:31:49 user nova-compute[72150]:     </rng>
Aug 01 18:31:49 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:31:49 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:31:49 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:31:49 user nova-compute[72150]:     </memballoon>
Aug 01 18:31:49 user nova-compute[72150]:   </devices>
Aug 01 18:31:49 user nova-compute[72150]: </domain>
Aug 01 18:31:49 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:31:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1468554315',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1468554315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1468554315',id=26,image_ref='d708b95f-4833-4ec7-a783-08e6cabb0ad2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMGg7Kxa7OMRUjZQxVpCqLSg9YDkUGHU4bHybYt4DML3EYP4lULgEFq9DndpYpf2p++D3dGVS6y4rE2tx0KYfBgvdZYbDEm8A05fXO3AQ/QOsxPUtSxJtfrFsrEFBjIBA==',key_name='tempest-keypair-66113531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7ca44f23b114893afcfe57c52f693b1',ramdisk_id='',reservation_id='r-v1pi2flv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-295340968',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-295340968-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-295340968',owner_user_name='tempest-TestVolumeBootPattern-295340968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:31:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92c7ef0ed6814f8880de76adb913a487',uuid=12a8b6e5-617d-466d-bb62-64b6b188f8f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eee643a-cddb-40a2-bd09-a601fb3e773c", "address": "fa:16:3e:06:3b:ee", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee643a-cd", "ovs_interfaceid": "2eee643a-cddb-40a2-bd09-a601fb3e773c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converting VIF {"id": "2eee643a-cddb-40a2-bd09-a601fb3e773c", "address": "fa:16:3e:06:3b:ee", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee643a-cd", "ovs_interfaceid": "2eee643a-cddb-40a2-bd09-a601fb3e773c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:3b:ee,bridge_name='br-int',has_traffic_filtering=True,id=2eee643a-cddb-40a2-bd09-a601fb3e773c,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eee643a-cd') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG os_vif [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:3b:ee,bridge_name='br-int',has_traffic_filtering=True,id=2eee643a-cddb-40a2-bd09-a601fb3e773c,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eee643a-cd') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2eee643a-cd, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2eee643a-cd, col_values=(('external_ids', {'iface-id': '2eee643a-cddb-40a2-bd09-a601fb3e773c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:3b:ee', 'vm-uuid': '12a8b6e5-617d-466d-bb62-64b6b188f8f2'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:49 user nova-compute[72150]: INFO os_vif [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:3b:ee,bridge_name='br-int',has_traffic_filtering=True,id=2eee643a-cddb-40a2-bd09-a601fb3e773c,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eee643a-cd')
Aug 01 18:31:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:31:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] No VIF found with MAC fa:16:3e:06:3b:ee, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:31:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-0335a0cc-f0d4-4939-9787-39a11c3228ec req-a790c444-7f44-4930-be88-987c9fcd6bd9 service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Received event network-vif-plugged-2eee643a-cddb-40a2-bd09-a601fb3e773c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0335a0cc-f0d4-4939-9787-39a11c3228ec req-a790c444-7f44-4930-be88-987c9fcd6bd9 service nova] Acquiring lock "12a8b6e5-617d-466d-bb62-64b6b188f8f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0335a0cc-f0d4-4939-9787-39a11c3228ec req-a790c444-7f44-4930-be88-987c9fcd6bd9 service nova] Lock "12a8b6e5-617d-466d-bb62-64b6b188f8f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0335a0cc-f0d4-4939-9787-39a11c3228ec req-a790c444-7f44-4930-be88-987c9fcd6bd9 service nova] Lock "12a8b6e5-617d-466d-bb62-64b6b188f8f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-0335a0cc-f0d4-4939-9787-39a11c3228ec req-a790c444-7f44-4930-be88-987c9fcd6bd9 service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] No waiting events found dispatching network-vif-plugged-2eee643a-cddb-40a2-bd09-a601fb3e773c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:31:51 user nova-compute[72150]: WARNING nova.compute.manager [req-0335a0cc-f0d4-4939-9787-39a11c3228ec req-a790c444-7f44-4930-be88-987c9fcd6bd9 service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Received unexpected event network-vif-plugged-2eee643a-cddb-40a2-bd09-a601fb3e773c for instance with vm_state building and task_state spawning.
Aug 01 18:31:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wOqhJMLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:31:51 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:31:51 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:31:51 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[48057d32-825c-41fc-b2f3-d530ba281957]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:31:51 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcead81c-3545-445a-b828-fe2939450b9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5] added
Aug 01 18:31:51 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae4a6e4-a51e-40e1-b12f-048374664b26]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde95e65-eb5c-48bf-a0ff-5433de5de9e3]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wOqhJMLd {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wOqhJMLd" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc11e185-34ea-4db4-96aa-51936b19adb9]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wOqhJMLd'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b023f23-89c6-459f-9bed-f2f44716d022]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[34434d68-932a-4e3c-aa75-d638415b618d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:51 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:51 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:51 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:31:51 user nova-compute[72150]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:31:51 user nova-compute[72150]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)
Aug 01 18:31:51 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:51 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:51 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:51 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:31:51 user nova-compute[72150]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:31:51 user nova-compute[72150]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)
Aug 01 18:31:51 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[039a50fd-6b9f-440c-afa7-d10f67374a97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5, portal: 172.16.0.220,3260]
Aug 01 18:31:51 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5, portal: 172.16.0.220,3260] successful.
Aug 01 18:31:51 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a6a212-3025-453b-99d7-04c03630c564]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fa2b99-07d3-4059-a46f-baa57fd129f0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:51 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:51 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:51 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:31:51 user nova-compute[72150]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:31:51 user nova-compute[72150]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)
Aug 01 18:31:51 user nova-compute[72150]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)
Aug 01 18:31:51 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:31:51 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:31:51 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:31:51 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:31:51 user nova-compute[72150]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:31:51 user nova-compute[72150]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)
Aug 01 18:31:51 user nova-compute[72150]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)
Aug 01 18:31:51 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] HCTL ('39', '-', '-', 0) found on session 32 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d95b8b-cf79-46d8-8934-9c1e35905871]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Searching for a device in session 32 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:31:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wOqhJMLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:31:52 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914712.7028441, 12a8b6e5-617d-466d-bb62-64b6b188f8f2 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:31:52 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] VM Resumed (Lifecycle Event)
Aug 01 18:31:52 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:31:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:31:52 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Instance spawned successfully.
Aug 01 18:31:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:31:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:31:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:31:52 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:31:52 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:31:52 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:31:52 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914712.703482, 12a8b6e5-617d-466d-bb62-64b6b188f8f2 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:31:52 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] VM Started (Lifecycle Event)
Aug 01 18:31:52 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:31:52 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:31:52 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:31:52 user nova-compute[72150]: INFO nova.compute.manager [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Took 5.24 seconds to spawn the instance on the hypervisor.
Aug 01 18:31:52 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:31:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:31:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23163616439373833', 'path': '/dev/sdh'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:31:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163616439373833', 'path': '/dev/sdh'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:31:52 user nova-compute[72150]: DEBUG nova.objects.instance [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lazy-loading 'flavor' on Instance uuid eb113972-7a86-4cb7-9f8d-ca690693e27d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:31:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:31:52 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:31:52 user nova-compute[72150]:   <source dev="/dev/sdh"/>
Aug 01 18:31:52 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:31:52 user nova-compute[72150]:   <serial>aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5</serial>
Aug 01 18:31:52 user nova-compute[72150]: </disk>
Aug 01 18:31:52 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:31:52 user nova-compute[72150]: INFO nova.compute.manager [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Took 24.71 seconds to build instance.
Aug 01 18:31:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8fdd295e-0b4b-422f-b784-0c768b8df3b0 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "12a8b6e5-617d-466d-bb62-64b6b188f8f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.811s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:53 user nova-compute[72150]: DEBUG nova.compute.manager [req-ead0901e-2417-4c6a-be14-3bc859546da0 req-86324e36-561a-413d-ba9b-c12e9c6498f9 service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Received event network-vif-plugged-2eee643a-cddb-40a2-bd09-a601fb3e773c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ead0901e-2417-4c6a-be14-3bc859546da0 req-86324e36-561a-413d-ba9b-c12e9c6498f9 service nova] Acquiring lock "12a8b6e5-617d-466d-bb62-64b6b188f8f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ead0901e-2417-4c6a-be14-3bc859546da0 req-86324e36-561a-413d-ba9b-c12e9c6498f9 service nova] Lock "12a8b6e5-617d-466d-bb62-64b6b188f8f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ead0901e-2417-4c6a-be14-3bc859546da0 req-86324e36-561a-413d-ba9b-c12e9c6498f9 service nova] Lock "12a8b6e5-617d-466d-bb62-64b6b188f8f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:53 user nova-compute[72150]: DEBUG nova.compute.manager [req-ead0901e-2417-4c6a-be14-3bc859546da0 req-86324e36-561a-413d-ba9b-c12e9c6498f9 service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] No waiting events found dispatching network-vif-plugged-2eee643a-cddb-40a2-bd09-a601fb3e773c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:31:53 user nova-compute[72150]: WARNING nova.compute.manager [req-ead0901e-2417-4c6a-be14-3bc859546da0 req-86324e36-561a-413d-ba9b-c12e9c6498f9 service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Received unexpected event network-vif-plugged-2eee643a-cddb-40a2-bd09-a601fb3e773c for instance with vm_state active and task_state None.
Aug 01 18:31:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:31:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:31:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] No VIF found with MAC fa:16:3e:b3:96:a5, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:31:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-51974a1c-ed05-4526-9e7f-f180e6a10dbb tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.164s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:31:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:55 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914700.8385572, bcbfca8c-8bdb-47d2-addc-e1cec3166dc5 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:31:55 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] VM Stopped (Lifecycle Event)
Aug 01 18:31:55 user nova-compute[72150]: DEBUG nova.compute.manager [None req-a4f9feaa-67e2-4eb4-a13a-1825d1dd10d8 None None] [instance: bcbfca8c-8bdb-47d2-addc-e1cec3166dc5] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:31:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-0acf841b-e427-44da-b0be-708c1746d215 req-13b2bbd5-845d-43f4-84a5-023eae22dc07 service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Received event network-changed-a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-0acf841b-e427-44da-b0be-708c1746d215 req-13b2bbd5-845d-43f4-84a5-023eae22dc07 service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Refreshing instance network info cache due to event network-changed-a519018d-4c4e-4d06-ba14-c2d2054529ea. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:31:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0acf841b-e427-44da-b0be-708c1746d215 req-13b2bbd5-845d-43f4-84a5-023eae22dc07 service nova] Acquiring lock "refresh_cache-eb113972-7a86-4cb7-9f8d-ca690693e27d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:31:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0acf841b-e427-44da-b0be-708c1746d215 req-13b2bbd5-845d-43f4-84a5-023eae22dc07 service nova] Acquired lock "refresh_cache-eb113972-7a86-4cb7-9f8d-ca690693e27d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:31:56 user nova-compute[72150]: DEBUG nova.network.neutron [req-0acf841b-e427-44da-b0be-708c1746d215 req-13b2bbd5-845d-43f4-84a5-023eae22dc07 service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Refreshing network info cache for port a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:31:57 user nova-compute[72150]: DEBUG nova.network.neutron [req-0acf841b-e427-44da-b0be-708c1746d215 req-13b2bbd5-845d-43f4-84a5-023eae22dc07 service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Updated VIF entry in instance network info cache for port a519018d-4c4e-4d06-ba14-c2d2054529ea. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:31:57 user nova-compute[72150]: DEBUG nova.network.neutron [req-0acf841b-e427-44da-b0be-708c1746d215 req-13b2bbd5-845d-43f4-84a5-023eae22dc07 service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Updating instance_info_cache with network_info: [{"id": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "address": "fa:16:3e:b3:96:a5", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519018d-4c", "ovs_interfaceid": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:31:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0acf841b-e427-44da-b0be-708c1746d215 req-13b2bbd5-845d-43f4-84a5-023eae22dc07 service nova] Releasing lock "refresh_cache-eb113972-7a86-4cb7-9f8d-ca690693e27d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:31:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-49b5aba8-b025-4480-8c7a-d2572accd1da req-54701f49-0ab4-498d-88b3-51c589eaae5a service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Received event network-changed-a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-49b5aba8-b025-4480-8c7a-d2572accd1da req-54701f49-0ab4-498d-88b3-51c589eaae5a service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Refreshing instance network info cache due to event network-changed-a519018d-4c4e-4d06-ba14-c2d2054529ea. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:31:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-49b5aba8-b025-4480-8c7a-d2572accd1da req-54701f49-0ab4-498d-88b3-51c589eaae5a service nova] Acquiring lock "refresh_cache-eb113972-7a86-4cb7-9f8d-ca690693e27d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:31:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-49b5aba8-b025-4480-8c7a-d2572accd1da req-54701f49-0ab4-498d-88b3-51c589eaae5a service nova] Acquired lock "refresh_cache-eb113972-7a86-4cb7-9f8d-ca690693e27d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:31:58 user nova-compute[72150]: DEBUG nova.network.neutron [req-49b5aba8-b025-4480-8c7a-d2572accd1da req-54701f49-0ab4-498d-88b3-51c589eaae5a service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Refreshing network info cache for port a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:31:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:31:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-77d66f22-9bea-452a-b521-77f449de4349 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "eb113972-7a86-4cb7-9f8d-ca690693e27d" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:31:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-77d66f22-9bea-452a-b521-77f449de4349 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:31:59 user nova-compute[72150]: INFO nova.compute.manager [None req-77d66f22-9bea-452a-b521-77f449de4349 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Rebooting instance
Aug 01 18:31:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-77d66f22-9bea-452a-b521-77f449de4349 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "refresh_cache-eb113972-7a86-4cb7-9f8d-ca690693e27d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:31:59 user nova-compute[72150]: DEBUG nova.network.neutron [req-49b5aba8-b025-4480-8c7a-d2572accd1da req-54701f49-0ab4-498d-88b3-51c589eaae5a service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Updated VIF entry in instance network info cache for port a519018d-4c4e-4d06-ba14-c2d2054529ea. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:31:59 user nova-compute[72150]: DEBUG nova.network.neutron [req-49b5aba8-b025-4480-8c7a-d2572accd1da req-54701f49-0ab4-498d-88b3-51c589eaae5a service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Updating instance_info_cache with network_info: [{"id": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "address": "fa:16:3e:b3:96:a5", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519018d-4c", "ovs_interfaceid": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:31:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-49b5aba8-b025-4480-8c7a-d2572accd1da req-54701f49-0ab4-498d-88b3-51c589eaae5a service nova] Releasing lock "refresh_cache-eb113972-7a86-4cb7-9f8d-ca690693e27d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:31:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-77d66f22-9bea-452a-b521-77f449de4349 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquired lock "refresh_cache-eb113972-7a86-4cb7-9f8d-ca690693e27d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:31:59 user nova-compute[72150]: DEBUG nova.network.neutron [None req-77d66f22-9bea-452a-b521-77f449de4349 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:31:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-471a9c5f-aabb-4bdc-b094-cae9e396b7f2 req-b6359383-d438-4734-954e-8878d5b7e180 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Received event network-changed-486cf8af-74cf-4a5c-8e58-159e7fd1a36c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:31:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-471a9c5f-aabb-4bdc-b094-cae9e396b7f2 req-b6359383-d438-4734-954e-8878d5b7e180 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Refreshing instance network info cache due to event network-changed-486cf8af-74cf-4a5c-8e58-159e7fd1a36c. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:31:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-471a9c5f-aabb-4bdc-b094-cae9e396b7f2 req-b6359383-d438-4734-954e-8878d5b7e180 service nova] Acquiring lock "refresh_cache-beb6d063-d147-4033-ae73-55ff95a48efa" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:31:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-471a9c5f-aabb-4bdc-b094-cae9e396b7f2 req-b6359383-d438-4734-954e-8878d5b7e180 service nova] Acquired lock "refresh_cache-beb6d063-d147-4033-ae73-55ff95a48efa" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:31:59 user nova-compute[72150]: DEBUG nova.network.neutron [req-471a9c5f-aabb-4bdc-b094-cae9e396b7f2 req-b6359383-d438-4734-954e-8878d5b7e180 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Refreshing network info cache for port 486cf8af-74cf-4a5c-8e58-159e7fd1a36c {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "beb6d063-d147-4033-ae73-55ff95a48efa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "beb6d063-d147-4033-ae73-55ff95a48efa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG nova.objects.instance [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lazy-loading 'flavor' on Instance uuid beb6d063-d147-4033-ae73-55ff95a48efa {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:32:00 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Ignoring supplied device name: /dev/vdb
Aug 01 18:32:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "beb6d063-d147-4033-ae73-55ff95a48efa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG nova.network.neutron [None req-77d66f22-9bea-452a-b521-77f449de4349 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Updating instance_info_cache with network_info: [{"id": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "address": "fa:16:3e:b3:96:a5", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519018d-4c", "ovs_interfaceid": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-77d66f22-9bea-452a-b521-77f449de4349 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Releasing lock "refresh_cache-eb113972-7a86-4cb7-9f8d-ca690693e27d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG nova.compute.manager [None req-77d66f22-9bea-452a-b521-77f449de4349 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG nova.network.neutron [req-471a9c5f-aabb-4bdc-b094-cae9e396b7f2 req-b6359383-d438-4734-954e-8878d5b7e180 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Updated VIF entry in instance network info cache for port 486cf8af-74cf-4a5c-8e58-159e7fd1a36c. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG nova.network.neutron [req-471a9c5f-aabb-4bdc-b094-cae9e396b7f2 req-b6359383-d438-4734-954e-8878d5b7e180 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Updating instance_info_cache with network_info: [{"id": "486cf8af-74cf-4a5c-8e58-159e7fd1a36c", "address": "fa:16:3e:2d:d2:ae", "network": {"id": "87bd2699-a52f-4b66-9d6c-fbf9fa54792d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1887490690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efbd504761845f88d59b78115119d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486cf8af-74", "ovs_interfaceid": "486cf8af-74cf-4a5c-8e58-159e7fd1a36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "beb6d063-d147-4033-ae73-55ff95a48efa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "beb6d063-d147-4033-ae73-55ff95a48efa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:00 user nova-compute[72150]: INFO nova.compute.manager [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Attaching volume 5a640ae7-14ab-4853-9c86-1cf8f6a22a8d to /dev/vdb
Aug 01 18:32:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-471a9c5f-aabb-4bdc-b094-cae9e396b7f2 req-b6359383-d438-4734-954e-8878d5b7e180 service nova] Releasing lock "refresh_cache-beb6d063-d147-4033-ae73-55ff95a48efa" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG os_brick.utils [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a49d03-81a0-47a3-8eeb-0696b29a863b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c09034-917e-4a6f-aeb2-79efe741b405]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[07134ed3-7713-46dc-b41f-80b5eff3e18b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c290f2f9-6176-493b-89e5-64c4406b6d64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:32:00 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:32:00 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc7dab3-5d1e-4d6a-be59-51f1ccbe0def]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG os_brick.utils [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:32:00 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Updating existing volume attachment record: 36452ba8-7f60-439b-bc62-7e7b07dc821c {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:32:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:03 user nova-compute[72150]: DEBUG nova.compute.manager [req-546b3f75-4a07-4563-a4c6-ab101c4e37a1 req-df7ced28-848d-41f9-9990-099b85bbc2e8 service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Received event network-vif-unplugged-a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:32:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-546b3f75-4a07-4563-a4c6-ab101c4e37a1 req-df7ced28-848d-41f9-9990-099b85bbc2e8 service nova] Acquiring lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-546b3f75-4a07-4563-a4c6-ab101c4e37a1 req-df7ced28-848d-41f9-9990-099b85bbc2e8 service nova] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-546b3f75-4a07-4563-a4c6-ab101c4e37a1 req-df7ced28-848d-41f9-9990-099b85bbc2e8 service nova] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:03 user nova-compute[72150]: DEBUG nova.compute.manager [req-546b3f75-4a07-4563-a4c6-ab101c4e37a1 req-df7ced28-848d-41f9-9990-099b85bbc2e8 service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] No waiting events found dispatching network-vif-unplugged-a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:32:03 user nova-compute[72150]: WARNING nova.compute.manager [req-546b3f75-4a07-4563-a4c6-ab101c4e37a1 req-df7ced28-848d-41f9-9990-099b85bbc2e8 service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Received unexpected event network-vif-unplugged-a519018d-4c4e-4d06-ba14-c2d2054529ea for instance with vm_state active and task_state reboot_started.
Aug 01 18:32:03 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-77d66f22-9bea-452a-b521-77f449de4349 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Instance shutdown successfully.
Aug 01 18:32:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:05 user nova-compute[72150]: DEBUG nova.compute.manager [req-1de0f4fa-d2a9-4617-b98c-dd02f93e0f7b req-cd7bff32-06f8-47fa-b272-6ab32074f562 service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Received event network-vif-plugged-a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:32:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1de0f4fa-d2a9-4617-b98c-dd02f93e0f7b req-cd7bff32-06f8-47fa-b272-6ab32074f562 service nova] Acquiring lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1de0f4fa-d2a9-4617-b98c-dd02f93e0f7b req-cd7bff32-06f8-47fa-b272-6ab32074f562 service nova] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1de0f4fa-d2a9-4617-b98c-dd02f93e0f7b req-cd7bff32-06f8-47fa-b272-6ab32074f562 service nova] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:05 user nova-compute[72150]: DEBUG nova.compute.manager [req-1de0f4fa-d2a9-4617-b98c-dd02f93e0f7b req-cd7bff32-06f8-47fa-b272-6ab32074f562 service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] No waiting events found dispatching network-vif-plugged-a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:32:05 user nova-compute[72150]: WARNING nova.compute.manager [req-1de0f4fa-d2a9-4617-b98c-dd02f93e0f7b req-cd7bff32-06f8-47fa-b272-6ab32074f562 service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Received unexpected event network-vif-plugged-a519018d-4c4e-4d06-ba14-c2d2054529ea for instance with vm_state active and task_state reboot_started.
Aug 01 18:32:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:07 user nova-compute[72150]: DEBUG nova.compute.manager [req-86e5aaeb-98e8-415d-9923-52715afb8268 req-9179ffd8-9798-431a-87cc-1e56bf84813e service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Received event network-vif-plugged-a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:32:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-86e5aaeb-98e8-415d-9923-52715afb8268 req-9179ffd8-9798-431a-87cc-1e56bf84813e service nova] Acquiring lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-86e5aaeb-98e8-415d-9923-52715afb8268 req-9179ffd8-9798-431a-87cc-1e56bf84813e service nova] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-86e5aaeb-98e8-415d-9923-52715afb8268 req-9179ffd8-9798-431a-87cc-1e56bf84813e service nova] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:07 user nova-compute[72150]: DEBUG nova.compute.manager [req-86e5aaeb-98e8-415d-9923-52715afb8268 req-9179ffd8-9798-431a-87cc-1e56bf84813e service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] No waiting events found dispatching network-vif-plugged-a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:32:07 user nova-compute[72150]: WARNING nova.compute.manager [req-86e5aaeb-98e8-415d-9923-52715afb8268 req-9179ffd8-9798-431a-87cc-1e56bf84813e service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Received unexpected event network-vif-plugged-a519018d-4c4e-4d06-ba14-c2d2054529ea for instance with vm_state active and task_state reboot_started.
Aug 01 18:32:07 user nova-compute[72150]: DEBUG nova.compute.manager [req-86e5aaeb-98e8-415d-9923-52715afb8268 req-9179ffd8-9798-431a-87cc-1e56bf84813e service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Received event network-vif-plugged-a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:32:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-86e5aaeb-98e8-415d-9923-52715afb8268 req-9179ffd8-9798-431a-87cc-1e56bf84813e service nova] Acquiring lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-86e5aaeb-98e8-415d-9923-52715afb8268 req-9179ffd8-9798-431a-87cc-1e56bf84813e service nova] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-86e5aaeb-98e8-415d-9923-52715afb8268 req-9179ffd8-9798-431a-87cc-1e56bf84813e service nova] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:07 user nova-compute[72150]: DEBUG nova.compute.manager [req-86e5aaeb-98e8-415d-9923-52715afb8268 req-9179ffd8-9798-431a-87cc-1e56bf84813e service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] No waiting events found dispatching network-vif-plugged-a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:32:07 user nova-compute[72150]: WARNING nova.compute.manager [req-86e5aaeb-98e8-415d-9923-52715afb8268 req-9179ffd8-9798-431a-87cc-1e56bf84813e service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Received unexpected event network-vif-plugged-a519018d-4c4e-4d06-ba14-c2d2054529ea for instance with vm_state active and task_state reboot_started.
Aug 01 18:32:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Removed pending event for eb113972-7a86-4cb7-9f8d-ca690693e27d due to event {{(pid=72150) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 18:32:07 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914727.3392534, eb113972-7a86-4cb7-9f8d-ca690693e27d => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:32:07 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] VM Resumed (Lifecycle Event)
Aug 01 18:32:07 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Instance running successfully.
Aug 01 18:32:07 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-77d66f22-9bea-452a-b521-77f449de4349 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Instance soft rebooted successfully.
Aug 01 18:32:07 user nova-compute[72150]: DEBUG nova.compute.manager [None req-77d66f22-9bea-452a-b521-77f449de4349 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:32:07 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:32:07 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:32:07 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 01 18:32:07 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914727.3422012, eb113972-7a86-4cb7-9f8d-ca690693e27d => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:32:07 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] VM Started (Lifecycle Event)
Aug 01 18:32:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-77d66f22-9bea-452a-b521-77f449de4349 tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.120s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:07 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:32:07 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DVgXSaFz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:32:09 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:32:09 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:32:09 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:32:09 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:32:09 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:32:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd733f89-da5a-4936-b583-ce437c6d7a29]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:32:09 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c41c6b-7918-4adb-9efc-ee1de7855d30]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d] added
Aug 01 18:32:09 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[04635c2b-5c24-4016-b4e6-d251a7981cfe]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d577a9-24b9-4333-b795-90c0530a8d96]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DVgXSaFz {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DVgXSaFz" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2662353f-a16e-4b1c-97ac-93359a3b4e3d]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DVgXSaFz'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea29eda-cf08-4308-b314-dc6610fcdeef]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[13448b6c-e5ad-4790-ab41-a9ee3a40b190]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:32:09 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:32:09 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:32:09 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:32:09 user nova-compute[72150]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:32:09 user nova-compute[72150]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)
Aug 01 18:32:09 user nova-compute[72150]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)
Aug 01 18:32:09 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:32:09 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:32:09 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:32:09 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:32:09 user nova-compute[72150]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:32:09 user nova-compute[72150]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)
Aug 01 18:32:09 user nova-compute[72150]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)
Aug 01 18:32:09 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:32:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddace8f6-bf0c-45e7-b62e-691e731d3226]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d, portal: 172.16.0.220,3260]
Aug 01 18:32:10 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d, portal: 172.16.0.220,3260] successful.
Aug 01 18:32:10 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:32:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1566de0b-e91b-4911-8a0b-767baf0cc2ef]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:32:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e42980c-f6e5-4a6f-a79a-64c255d6bfba]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:32:10 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:32:10 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:32:10 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:32:10 user nova-compute[72150]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:32:10 user nova-compute[72150]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)
Aug 01 18:32:10 user nova-compute[72150]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)
Aug 01 18:32:10 user nova-compute[72150]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d (non-flash)
Aug 01 18:32:10 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:32:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:32:10 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:32:10 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:32:10 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:32:10 user nova-compute[72150]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:32:10 user nova-compute[72150]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)
Aug 01 18:32:10 user nova-compute[72150]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)
Aug 01 18:32:10 user nova-compute[72150]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d (non-flash)
Aug 01 18:32:10 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:32:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:32:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:32:10 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] HCTL ('40', '-', '-', 0) found on session 33 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:32:10 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:32:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[040b8c69-e63e-4257-b169-14bd8f4c7c56]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:10 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Searching for a device in session 33 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:32:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DVgXSaFz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:32:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:32:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23965353465343363', 'path': '/dev/sdi'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:32:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965353465343363', 'path': '/dev/sdi'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:32:11 user nova-compute[72150]: DEBUG nova.objects.instance [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lazy-loading 'flavor' on Instance uuid beb6d063-d147-4033-ae73-55ff95a48efa {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:32:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:32:11 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:32:11 user nova-compute[72150]:   <source dev="/dev/sdi"/>
Aug 01 18:32:11 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:32:11 user nova-compute[72150]:   <serial>5a640ae7-14ab-4853-9c86-1cf8f6a22a8d</serial>
Aug 01 18:32:11 user nova-compute[72150]: </disk>
Aug 01 18:32:11 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:32:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:32:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:32:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] No VIF found with MAC fa:16:3e:2d:d2:ae, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:32:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6a2e7b61-a1d1-4414-ba79-fb45a3d4e67a tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "beb6d063-d147-4033-ae73-55ff95a48efa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.261s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:26 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:32:26 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72150) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 18:32:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:31 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:32:33 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:32:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:34 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:32:34 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:32:34 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Cleaning up deleted instances {{(pid=72150) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 18:32:34 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] There are 0 instances to clean {{(pid=72150) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 18:32:35 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:32:35 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:32:36 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:32:36 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:32:36 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:32:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:36 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:32:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:32:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:32:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:37 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:38 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:32:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e75a98-beb1-4688-a375-affc63b14252/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e75a98-beb1-4688-a375-affc63b14252/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e75a98-beb1-4688-a375-affc63b14252/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e75a98-beb1-4688-a375-affc63b14252/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:38 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:32:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:32:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:32:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:32:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "beb6d063-d147-4033-ae73-55ff95a48efa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "beb6d063-d147-4033-ae73-55ff95a48efa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:40 user nova-compute[72150]: INFO nova.compute.manager [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Detaching volume 5a640ae7-14ab-4853-9c86-1cf8f6a22a8d
Aug 01 18:32:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "beb6d063-d147-4033-ae73-55ff95a48efa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:40 user nova-compute[72150]: INFO nova.virt.block_device [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Attempting to driver detach volume 5a640ae7-14ab-4853-9c86-1cf8f6a22a8d from mountpoint /dev/vdb
Aug 01 18:32:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Attempting to detach device vdb from instance beb6d063-d147-4033-ae73-55ff95a48efa from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:32:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:32:40 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:32:40 user nova-compute[72150]:   <source dev="/dev/sdi"/>
Aug 01 18:32:40 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:32:40 user nova-compute[72150]:   <serial>5a640ae7-14ab-4853-9c86-1cf8f6a22a8d</serial>
Aug 01 18:32:40 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:32:40 user nova-compute[72150]: </disk>
Aug 01 18:32:40 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:32:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:32:40 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Successfully detached device vdb from instance beb6d063-d147-4033-ae73-55ff95a48efa from the persistent domain config.
Aug 01 18:32:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance beb6d063-d147-4033-ae73-55ff95a48efa from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:32:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:32:40 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:32:40 user nova-compute[72150]:   <source dev="/dev/sdi"/>
Aug 01 18:32:40 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:32:40 user nova-compute[72150]:   <serial>5a640ae7-14ab-4853-9c86-1cf8f6a22a8d</serial>
Aug 01 18:32:40 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:32:40 user nova-compute[72150]: </disk>
Aug 01 18:32:40 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690914760.8905723, beb6d063-d147-4033-ae73-55ff95a48efa => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance beb6d063-d147-4033-ae73-55ff95a48efa {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:32:41 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Successfully detached device vdb from instance beb6d063-d147-4033-ae73-55ff95a48efa from the live domain config.
Aug 01 18:32:41 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:32:41 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=6911MB free_disk=25.219554901123047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DVgXSaFz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:32:41 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:32:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f04841-1c38-4599-99c7-e6d0210141f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7785f043-9be1-4aca-a56b-3230eca9835b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:32:41 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:32:41 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:32:41 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:32:41 user nova-compute[72150]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:32:41 user nova-compute[72150]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)
Aug 01 18:32:41 user nova-compute[72150]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)
Aug 01 18:32:41 user nova-compute[72150]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d (non-flash)
Aug 01 18:32:41 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:32:41 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:32:41 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:32:41 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:32:41 user nova-compute[72150]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:32:41 user nova-compute[72150]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)
Aug 01 18:32:41 user nova-compute[72150]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)
Aug 01 18:32:41 user nova-compute[72150]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d (non-flash)
Aug 01 18:32:41 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c208790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d'): ({'sdi'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Removing single pathed devices sdi {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[760d5e39-fbcb-422c-b96e-a93eee975b9e]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Applying migration context for instance a5f0eca7-d060-4226-b36e-a3cd15b15703 as it has an incoming, in-progress migration 2182feaa-9b23-4385-8e0a-7709471ff371. Migration status is finished {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 18:32:41 user nova-compute[72150]: INFO nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Updating resource usage from migration 2182feaa-9b23-4385-8e0a-7709471ff371
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e39b6a9-3ddb-467b-adb7-568abbc4a589]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Flushing IO for device /dev/sdi {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7499a5e1-3fc5-476c-b752-7b7eb803c571]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 769690c8-53c5-4057-88a5-fbdbcb930e32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ea68420b-8362-4df3-b710-cd1cf76adba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 08851ec4-6f71-4ec1-a092-42aab83ee87f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance bf2d1f14-2227-41d1-bd73-a05ab3149aba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ceee3912-ca68-4b15-8fe6-985d905e8128 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 42e75a98-beb1-4688-a375-affc63b14252 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 1de0ad54-0d7a-4287-9532-7b4982b1e2bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance eb113972-7a86-4cb7-9f8d-ca690693e27d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance beb6d063-d147-4033-ae73-55ff95a48efa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Migration 2182feaa-9b23-4385-8e0a-7709471ff371 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance a5f0eca7-d060-4226-b36e-a3cd15b15703 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 12a8b6e5-617d-466d-bb62-64b6b188f8f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.043s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbbb9ca-b165-4a82-b0a9-158b26cc7439]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] SCSI volumes sdi have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9dc539-f717-4620-a38e-499ac60075ec]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2494667b-8656-4537-8ce6-9bdbfc57e139]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d, portal: 172.16.0.220,3260]
Aug 01 18:32:41 user nova-compute[72150]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d, portal: 172.16.0.220,3260] successful.
Aug 01 18:32:41 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bcffe4-68c8-4b2c-9d91-6ce1bbb6cc4a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] <== disconnect_volume: return (336ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:32:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.545s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG nova.objects.instance [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lazy-loading 'flavor' on Instance uuid beb6d063-d147-4033-ae73-55ff95a48efa {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0db63682-d5b5-4b80-9a7a-b4ee279ca28d tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "beb6d063-d147-4033-ae73-55ff95a48efa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.037s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "beb6d063-d147-4033-ae73-55ff95a48efa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.938s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "beb6d063-d147-4033-ae73-55ff95a48efa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "beb6d063-d147-4033-ae73-55ff95a48efa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "beb6d063-d147-4033-ae73-55ff95a48efa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:42 user nova-compute[72150]: INFO nova.compute.manager [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Terminating instance
Aug 01 18:32:42 user nova-compute[72150]: DEBUG nova.compute.manager [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG nova.compute.manager [req-1eb881ae-02c5-4ba3-8733-3e79af8f03ac req-44f36801-d394-4dcf-a7bb-9a7c55b44359 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Received event network-vif-unplugged-486cf8af-74cf-4a5c-8e58-159e7fd1a36c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1eb881ae-02c5-4ba3-8733-3e79af8f03ac req-44f36801-d394-4dcf-a7bb-9a7c55b44359 service nova] Acquiring lock "beb6d063-d147-4033-ae73-55ff95a48efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1eb881ae-02c5-4ba3-8733-3e79af8f03ac req-44f36801-d394-4dcf-a7bb-9a7c55b44359 service nova] Lock "beb6d063-d147-4033-ae73-55ff95a48efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1eb881ae-02c5-4ba3-8733-3e79af8f03ac req-44f36801-d394-4dcf-a7bb-9a7c55b44359 service nova] Lock "beb6d063-d147-4033-ae73-55ff95a48efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG nova.compute.manager [req-1eb881ae-02c5-4ba3-8733-3e79af8f03ac req-44f36801-d394-4dcf-a7bb-9a7c55b44359 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] No waiting events found dispatching network-vif-unplugged-486cf8af-74cf-4a5c-8e58-159e7fd1a36c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG nova.compute.manager [req-1eb881ae-02c5-4ba3-8733-3e79af8f03ac req-44f36801-d394-4dcf-a7bb-9a7c55b44359 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Received event network-vif-unplugged-486cf8af-74cf-4a5c-8e58-159e7fd1a36c for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Skipping network cache update for instance because it is being deleted. {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-769690c8-53c5-4057-88a5-fbdbcb930e32" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-769690c8-53c5-4057-88a5-fbdbcb930e32" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:32:42 user nova-compute[72150]: DEBUG nova.objects.instance [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lazy-loading 'info_cache' on Instance uuid 769690c8-53c5-4057-88a5-fbdbcb930e32 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:32:43 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Instance destroyed successfully.
Aug 01 18:32:43 user nova-compute[72150]: DEBUG nova.objects.instance [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lazy-loading 'resources' on Instance uuid beb6d063-d147-4033-ae73-55ff95a48efa {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1926720016',display_name='tempest-VolumesSnapshotTestJSON-instance-1926720016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1926720016',id=25,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFMMqXiT5VdBSIZ1X1VTO/nfV3xaz7Bt5y+1xCsEnyIwpxaVXzdxPIC2fAuTSaIxRzGP9nSznSOmDdYN+6wIfBjoXZgON82tXvp/RmqJ/SGT7VMj2NVh8t8VOjnFFOuUw==',key_name='tempest-keypair-233711911',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:30:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5efbd504761845f88d59b78115119d62',ramdisk_id='',reservation_id='r-am7y01fr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-710086109',owner_user_name='tempest-VolumesSnapshotTestJSON-710086109-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:30:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c975577646d746d192f038a3608d1f76',uuid=beb6d063-d147-4033-ae73-55ff95a48efa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "486cf8af-74cf-4a5c-8e58-159e7fd1a36c", "address": "fa:16:3e:2d:d2:ae", "network": {"id": "87bd2699-a52f-4b66-9d6c-fbf9fa54792d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1887490690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efbd504761845f88d59b78115119d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486cf8af-74", "ovs_interfaceid": "486cf8af-74cf-4a5c-8e58-159e7fd1a36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Converting VIF {"id": "486cf8af-74cf-4a5c-8e58-159e7fd1a36c", "address": "fa:16:3e:2d:d2:ae", "network": {"id": "87bd2699-a52f-4b66-9d6c-fbf9fa54792d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1887490690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efbd504761845f88d59b78115119d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486cf8af-74", "ovs_interfaceid": "486cf8af-74cf-4a5c-8e58-159e7fd1a36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=486cf8af-74cf-4a5c-8e58-159e7fd1a36c,network=Network(87bd2699-a52f-4b66-9d6c-fbf9fa54792d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap486cf8af-74') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG os_vif [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=486cf8af-74cf-4a5c-8e58-159e7fd1a36c,network=Network(87bd2699-a52f-4b66-9d6c-fbf9fa54792d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap486cf8af-74') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap486cf8af-74, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:43 user nova-compute[72150]: INFO os_vif [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=486cf8af-74cf-4a5c-8e58-159e7fd1a36c,network=Network(87bd2699-a52f-4b66-9d6c-fbf9fa54792d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap486cf8af-74')
Aug 01 18:32:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DVgXSaFz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:32:43 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:32:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a640ae7-14ab-4853-9c86-1cf8f6a22a8d', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8842363f-bcf1-4d93-be3f-8bbe4c27fdc5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e948ca6f-2186-4d54-be26-a632b34595db]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:32:43 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:32:43 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:32:43 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:32:43 user nova-compute[72150]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:32:43 user nova-compute[72150]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)
Aug 01 18:32:43 user nova-compute[72150]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)
Aug 01 18:32:43 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:32:43 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:32:43 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:32:43 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:32:43 user nova-compute[72150]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:32:43 user nova-compute[72150]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)
Aug 01 18:32:43 user nova-compute[72150]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)
Aug 01 18:32:43 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec240430>, {}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Disconnecting from: [] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.058s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] <== disconnect_volume: return (61ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:32:43 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Deleting instance files /opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa_del
Aug 01 18:32:43 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Deletion of /opt/stack/data/nova/instances/beb6d063-d147-4033-ae73-55ff95a48efa_del complete
Aug 01 18:32:43 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Updating instance_info_cache with network_info: [{"id": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "address": "fa:16:3e:8e:d7:75", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2596e33-c1", "ovs_interfaceid": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-769690c8-53c5-4057-88a5-fbdbcb930e32" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:32:43 user nova-compute[72150]: INFO nova.compute.manager [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 01 18:32:43 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:32:43 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:32:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-6f9ec0d0-c236-4f03-8d65-685ba80ff7ab req-23b434a5-7b9b-4670-963f-0421d1428e44 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Received event network-vif-plugged-486cf8af-74cf-4a5c-8e58-159e7fd1a36c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:32:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6f9ec0d0-c236-4f03-8d65-685ba80ff7ab req-23b434a5-7b9b-4670-963f-0421d1428e44 service nova] Acquiring lock "beb6d063-d147-4033-ae73-55ff95a48efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6f9ec0d0-c236-4f03-8d65-685ba80ff7ab req-23b434a5-7b9b-4670-963f-0421d1428e44 service nova] Lock "beb6d063-d147-4033-ae73-55ff95a48efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6f9ec0d0-c236-4f03-8d65-685ba80ff7ab req-23b434a5-7b9b-4670-963f-0421d1428e44 service nova] Lock "beb6d063-d147-4033-ae73-55ff95a48efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-6f9ec0d0-c236-4f03-8d65-685ba80ff7ab req-23b434a5-7b9b-4670-963f-0421d1428e44 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] No waiting events found dispatching network-vif-plugged-486cf8af-74cf-4a5c-8e58-159e7fd1a36c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:32:44 user nova-compute[72150]: WARNING nova.compute.manager [req-6f9ec0d0-c236-4f03-8d65-685ba80ff7ab req-23b434a5-7b9b-4670-963f-0421d1428e44 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Received unexpected event network-vif-plugged-486cf8af-74cf-4a5c-8e58-159e7fd1a36c for instance with vm_state active and task_state deleting.
Aug 01 18:32:44 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:32:44 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Took 1.53 seconds to deallocate network for instance.
Aug 01 18:32:44 user nova-compute[72150]: WARNING nova.volume.cinder [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Attachment 36452ba8-7f60-439b-bc62-7e7b07dc821c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 36452ba8-7f60-439b-bc62-7e7b07dc821c. (HTTP 404) (Request-ID: req-d41cbf6e-d83e-477d-92d9-9b1b41b94f18)
Aug 01 18:32:44 user nova-compute[72150]: INFO nova.compute.manager [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Took 0.02 seconds to detach 1 volumes for instance.
Aug 01 18:32:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-1d7bc7a9-1ab9-401d-bbe7-05d610052ac6 req-2c42db08-e719-469e-9f5e-98f08fce2103 service nova] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Received event network-vif-deleted-486cf8af-74cf-4a5c-8e58-159e7fd1a36c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:32:45 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:32:45 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:32:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:45 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Deleted allocations for instance beb6d063-d147-4033-ae73-55ff95a48efa
Aug 01 18:32:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-266b8a72-9875-4b81-bcf6-4a02d6aa8808 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "beb6d063-d147-4033-ae73-55ff95a48efa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.093s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "441a61de-ad9d-412d-95f3-882cef273e88" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "441a61de-ad9d-412d-95f3-882cef273e88" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:47 user nova-compute[72150]: INFO nova.compute.manager [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Unshelving
Aug 01 18:32:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:47 user nova-compute[72150]: DEBUG nova.objects.instance [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'pci_requests' on Instance uuid 441a61de-ad9d-412d-95f3-882cef273e88 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:32:47 user nova-compute[72150]: DEBUG nova.objects.instance [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'numa_topology' on Instance uuid 441a61de-ad9d-412d-95f3-882cef273e88 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:32:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:32:47 user nova-compute[72150]: INFO nova.compute.claims [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Claim successful on node user
Aug 01 18:32:47 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:32:47 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:32:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:47 user nova-compute[72150]: INFO nova.network.neutron [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Updating port 9c02fc93-434e-4e02-8855-14348e691115 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 18:32:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "refresh_cache-441a61de-ad9d-412d-95f3-882cef273e88" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:32:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquired lock "refresh_cache-441a61de-ad9d-412d-95f3-882cef273e88" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:32:48 user nova-compute[72150]: DEBUG nova.network.neutron [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:32:48 user nova-compute[72150]: DEBUG nova.compute.manager [req-1792c894-92a7-4640-a19c-1c2ef64ed87d req-e5ea865d-6bc9-44d1-8356-23a20f644d9b service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Received event network-changed-9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:32:48 user nova-compute[72150]: DEBUG nova.compute.manager [req-1792c894-92a7-4640-a19c-1c2ef64ed87d req-e5ea865d-6bc9-44d1-8356-23a20f644d9b service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Refreshing instance network info cache due to event network-changed-9c02fc93-434e-4e02-8855-14348e691115. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:32:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1792c894-92a7-4640-a19c-1c2ef64ed87d req-e5ea865d-6bc9-44d1-8356-23a20f644d9b service nova] Acquiring lock "refresh_cache-441a61de-ad9d-412d-95f3-882cef273e88" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:32:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:49 user nova-compute[72150]: DEBUG nova.network.neutron [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Updating instance_info_cache with network_info: [{"id": "9c02fc93-434e-4e02-8855-14348e691115", "address": "fa:16:3e:ba:5c:56", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c02fc93-43", "ovs_interfaceid": "9c02fc93-434e-4e02-8855-14348e691115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:32:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Releasing lock "refresh_cache-441a61de-ad9d-412d-95f3-882cef273e88" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:32:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:32:49 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Creating image(s)
Aug 01 18:32:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "/opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "/opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "/opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:49 user nova-compute[72150]: DEBUG nova.objects.instance [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'trusted_certs' on Instance uuid 441a61de-ad9d-412d-95f3-882cef273e88 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:32:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1792c894-92a7-4640-a19c-1c2ef64ed87d req-e5ea865d-6bc9-44d1-8356-23a20f644d9b service nova] Acquired lock "refresh_cache-441a61de-ad9d-412d-95f3-882cef273e88" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:32:49 user nova-compute[72150]: DEBUG nova.network.neutron [req-1792c894-92a7-4640-a19c-1c2ef64ed87d req-e5ea865d-6bc9-44d1-8356-23a20f644d9b service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Refreshing network info cache for port 9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:32:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "ff3095af49283453dfdc33c726eb23271b1b8f04" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "ff3095af49283453dfdc33c726eb23271b1b8f04" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff3095af49283453dfdc33c726eb23271b1b8f04.part --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:32:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff3095af49283453dfdc33c726eb23271b1b8f04.part --force-share --output=json" returned: 0 in 0.143s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:50 user nova-compute[72150]: DEBUG nova.virt.images [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] a6a8d0c9-37b2-45d3-aed3-b93d23058d78 was qcow2, converting to raw {{(pid=72150) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 18:32:50 user nova-compute[72150]: DEBUG nova.privsep.utils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72150) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 18:32:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ff3095af49283453dfdc33c726eb23271b1b8f04.part /opt/stack/data/nova/instances/_base/ff3095af49283453dfdc33c726eb23271b1b8f04.converted {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:50 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:32:50 user nova-compute[72150]: INFO nova.compute.claims [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Claim successful on node user
Aug 01 18:32:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ff3095af49283453dfdc33c726eb23271b1b8f04.part /opt/stack/data/nova/instances/_base/ff3095af49283453dfdc33c726eb23271b1b8f04.converted" returned: 0 in 0.390s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff3095af49283453dfdc33c726eb23271b1b8f04.converted --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:50 user nova-compute[72150]: DEBUG nova.network.neutron [req-1792c894-92a7-4640-a19c-1c2ef64ed87d req-e5ea865d-6bc9-44d1-8356-23a20f644d9b service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Updated VIF entry in instance network info cache for port 9c02fc93-434e-4e02-8855-14348e691115. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:32:50 user nova-compute[72150]: DEBUG nova.network.neutron [req-1792c894-92a7-4640-a19c-1c2ef64ed87d req-e5ea865d-6bc9-44d1-8356-23a20f644d9b service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Updating instance_info_cache with network_info: [{"id": "9c02fc93-434e-4e02-8855-14348e691115", "address": "fa:16:3e:ba:5c:56", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c02fc93-43", "ovs_interfaceid": "9c02fc93-434e-4e02-8855-14348e691115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:32:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1792c894-92a7-4640-a19c-1c2ef64ed87d req-e5ea865d-6bc9-44d1-8356-23a20f644d9b service nova] Releasing lock "refresh_cache-441a61de-ad9d-412d-95f3-882cef273e88" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:32:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff3095af49283453dfdc33c726eb23271b1b8f04.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "ff3095af49283453dfdc33c726eb23271b1b8f04" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.639s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff3095af49283453dfdc33c726eb23271b1b8f04 --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff3095af49283453dfdc33c726eb23271b1b8f04 --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "ff3095af49283453dfdc33c726eb23271b1b8f04" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "ff3095af49283453dfdc33c726eb23271b1b8f04" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff3095af49283453dfdc33c726eb23271b1b8f04 --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff3095af49283453dfdc33c726eb23271b1b8f04 --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ff3095af49283453dfdc33c726eb23271b1b8f04,backing_fmt=raw /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ff3095af49283453dfdc33c726eb23271b1b8f04,backing_fmt=raw /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk 1073741824" returned: 0 in 0.057s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "ff3095af49283453dfdc33c726eb23271b1b8f04" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff3095af49283453dfdc33c726eb23271b1b8f04 --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.862s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:32:51 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff3095af49283453dfdc33c726eb23271b1b8f04 --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG nova.objects.instance [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'migration_context' on Instance uuid 441a61de-ad9d-412d-95f3-882cef273e88 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:32:51 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Rebasing disk image.
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG nova.policy [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f11bcc2f9cc048beb928fc0d3c30403e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bad8c4e2a74caf8d35ad98e7888266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:32:51 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Creating image(s)
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "/opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "/opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "/opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.171s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c -F raw /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.166s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.148s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk 1073741824" returned: 0 in 0.051s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.143s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:52 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:32:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:32:52 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Successfully created port: 0558e7ef-e6d8-48fa-a27a-910bd9535e71 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:32:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:52 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Cannot resize image /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:32:52 user nova-compute[72150]: DEBUG nova.objects.instance [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lazy-loading 'migration_context' on Instance uuid b10328c7-3328-4c3c-8ebe-3dd282ece0c9 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:32:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:32:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Ensure instance console log exists: /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:32:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Successfully updated port: 0558e7ef-e6d8-48fa-a27a-910bd9535e71 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "refresh_cache-b10328c7-3328-4c3c-8ebe-3dd282ece0c9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquired lock "refresh_cache-b10328c7-3328-4c3c-8ebe-3dd282ece0c9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.compute.manager [req-bb526dd4-f727-419c-b666-04ef324b6660 req-c7586ab3-ed5b-4c16-84e3-7e2dd9e9b4e1 service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Received event network-changed-0558e7ef-e6d8-48fa-a27a-910bd9535e71 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.compute.manager [req-bb526dd4-f727-419c-b666-04ef324b6660 req-c7586ab3-ed5b-4c16-84e3-7e2dd9e9b4e1 service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Refreshing instance network info cache due to event network-changed-0558e7ef-e6d8-48fa-a27a-910bd9535e71. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bb526dd4-f727-419c-b666-04ef324b6660 req-c7586ab3-ed5b-4c16-84e3-7e2dd9e9b4e1 service nova] Acquiring lock "refresh_cache-b10328c7-3328-4c3c-8ebe-3dd282ece0c9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c -F raw /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk" returned: 0 in 2.159s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Ensure instance console log exists: /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Start _get_guest_xml network_info=[{"id": "9c02fc93-434e-4e02-8855-14348e691115", "address": "fa:16:3e:ba:5c:56", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c02fc93-43", "ovs_interfaceid": "9c02fc93-434e-4e02-8855-14348e691115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ca6bc692179ea9eec8e5f9a1d4ee62b4',container_format='bare',created_at=2023-08-01T18:30:54Z,direct_url=<?>,disk_format='qcow2',id=a6a8d0c9-37b2-45d3-aed3-b93d23058d78,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1473327332-shelved',owner='493923414b464384bb3a1ce3e6f7a2f0',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-01T18:30:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:32:53 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:32:53 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ca6bc692179ea9eec8e5f9a1d4ee62b4',container_format='bare',created_at=2023-08-01T18:30:54Z,direct_url=<?>,disk_format='qcow2',id=a6a8d0c9-37b2-45d3-aed3-b93d23058d78,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1473327332-shelved',owner='493923414b464384bb3a1ce3e6f7a2f0',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-01T18:30:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.objects.instance [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'vcpu_model' on Instance uuid 441a61de-ad9d-412d-95f3-882cef273e88 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T18:28:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1473327332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1473327332',id=21,image_ref='a6a8d0c9-37b2-45d3-aed3-b93d23058d78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1274630906',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:29:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='493923414b464384bb3a1ce3e6f7a2f0',ramdisk_id='',reservation_id='r-hphvdvst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849821930',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849821930-project-member',shelved_at='2023-08-01T18:30:57.776832',shelved_host='user',shelved_image_id='a6a8d0c9-37b2-45d3-aed3-b93d23058d78'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:32:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5804d69f9f18482f9fe0e0d4d73c4e92',uuid=441a61de-ad9d-412d-95f3-882cef273e88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9c02fc93-434e-4e02-8855-14348e691115", "address": "fa:16:3e:ba:5c:56", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c02fc93-43", "ovs_interfaceid": "9c02fc93-434e-4e02-8855-14348e691115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converting VIF {"id": "9c02fc93-434e-4e02-8855-14348e691115", "address": "fa:16:3e:ba:5c:56", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c02fc93-43", "ovs_interfaceid": "9c02fc93-434e-4e02-8855-14348e691115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:56,bridge_name='br-int',has_traffic_filtering=True,id=9c02fc93-434e-4e02-8855-14348e691115,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c02fc93-43') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.objects.instance [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'pci_devices' on Instance uuid 441a61de-ad9d-412d-95f3-882cef273e88 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:32:53 user nova-compute[72150]:   <uuid>441a61de-ad9d-412d-95f3-882cef273e88</uuid>
Aug 01 18:32:53 user nova-compute[72150]:   <name>instance-00000015</name>
Aug 01 18:32:53 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:32:53 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:32:53 user nova-compute[72150]:   <metadata>
Aug 01 18:32:53 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:32:53 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:32:53 user nova-compute[72150]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1473327332</nova:name>
Aug 01 18:32:53 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:32:53</nova:creationTime>
Aug 01 18:32:53 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:32:53 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:32:53 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:32:53 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:32:53 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:32:53 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:32:53 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:32:53 user nova-compute[72150]:       <nova:owner>
Aug 01 18:32:53 user nova-compute[72150]:         <nova:user uuid="5804d69f9f18482f9fe0e0d4d73c4e92">tempest-AttachVolumeShelveTestJSON-1849821930-project-member</nova:user>
Aug 01 18:32:53 user nova-compute[72150]:         <nova:project uuid="493923414b464384bb3a1ce3e6f7a2f0">tempest-AttachVolumeShelveTestJSON-1849821930</nova:project>
Aug 01 18:32:53 user nova-compute[72150]:       </nova:owner>
Aug 01 18:32:53 user nova-compute[72150]:       <nova:root type="image" uuid="a6a8d0c9-37b2-45d3-aed3-b93d23058d78"/>
Aug 01 18:32:53 user nova-compute[72150]:       <nova:ports>
Aug 01 18:32:53 user nova-compute[72150]:         <nova:port uuid="9c02fc93-434e-4e02-8855-14348e691115">
Aug 01 18:32:53 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 18:32:53 user nova-compute[72150]:         </nova:port>
Aug 01 18:32:53 user nova-compute[72150]:       </nova:ports>
Aug 01 18:32:53 user nova-compute[72150]:     </nova:instance>
Aug 01 18:32:53 user nova-compute[72150]:   </metadata>
Aug 01 18:32:53 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:32:53 user nova-compute[72150]:     <system>
Aug 01 18:32:53 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:32:53 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:32:53 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:32:53 user nova-compute[72150]:       <entry name="serial">441a61de-ad9d-412d-95f3-882cef273e88</entry>
Aug 01 18:32:53 user nova-compute[72150]:       <entry name="uuid">441a61de-ad9d-412d-95f3-882cef273e88</entry>
Aug 01 18:32:53 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:32:53 user nova-compute[72150]:     </system>
Aug 01 18:32:53 user nova-compute[72150]:   </sysinfo>
Aug 01 18:32:53 user nova-compute[72150]:   <os>
Aug 01 18:32:53 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:32:53 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:32:53 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:32:53 user nova-compute[72150]:   </os>
Aug 01 18:32:53 user nova-compute[72150]:   <features>
Aug 01 18:32:53 user nova-compute[72150]:     <acpi/>
Aug 01 18:32:53 user nova-compute[72150]:     <apic/>
Aug 01 18:32:53 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:32:53 user nova-compute[72150]:   </features>
Aug 01 18:32:53 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:32:53 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:32:53 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:32:53 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:32:53 user nova-compute[72150]:   </clock>
Aug 01 18:32:53 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:32:53 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:32:53 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:32:53 user nova-compute[72150]:   </cpu>
Aug 01 18:32:53 user nova-compute[72150]:   <devices>
Aug 01 18:32:53 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:32:53 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:32:53 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk"/>
Aug 01 18:32:53 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:32:53 user nova-compute[72150]:     </disk>
Aug 01 18:32:53 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:32:53 user nova-compute[72150]:       <mac address="fa:16:3e:ba:5c:56"/>
Aug 01 18:32:53 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:32:53 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:32:53 user nova-compute[72150]:       <target dev="tap9c02fc93-43"/>
Aug 01 18:32:53 user nova-compute[72150]:     </interface>
Aug 01 18:32:53 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:32:53 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/console.log" append="off"/>
Aug 01 18:32:53 user nova-compute[72150]:     </serial>
Aug 01 18:32:53 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:32:53 user nova-compute[72150]:     <video>
Aug 01 18:32:53 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:32:53 user nova-compute[72150]:     </video>
Aug 01 18:32:53 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:32:53 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:32:53 user nova-compute[72150]:     </rng>
Aug 01 18:32:53 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:32:53 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:32:53 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:32:53 user nova-compute[72150]:     </memballoon>
Aug 01 18:32:53 user nova-compute[72150]:   </devices>
Aug 01 18:32:53 user nova-compute[72150]: </domain>
Aug 01 18:32:53 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T18:28:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1473327332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1473327332',id=21,image_ref='a6a8d0c9-37b2-45d3-aed3-b93d23058d78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1274630906',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:29:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='493923414b464384bb3a1ce3e6f7a2f0',ramdisk_id='',reservation_id='r-hphvdvst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849821930',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849821930-project-member',shelved_at='2023-08-01T18:30:57.776832',shelved_host='user',shelved_image_id='a6a8d0c9-37b2-45d3-aed3-b93d23058d78'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:32:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5804d69f9f18482f9fe0e0d4d73c4e92',uuid=441a61de-ad9d-412d-95f3-882cef273e88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9c02fc93-434e-4e02-8855-14348e691115", "address": "fa:16:3e:ba:5c:56", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c02fc93-43", "ovs_interfaceid": "9c02fc93-434e-4e02-8855-14348e691115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converting VIF {"id": "9c02fc93-434e-4e02-8855-14348e691115", "address": "fa:16:3e:ba:5c:56", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c02fc93-43", "ovs_interfaceid": "9c02fc93-434e-4e02-8855-14348e691115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:56,bridge_name='br-int',has_traffic_filtering=True,id=9c02fc93-434e-4e02-8855-14348e691115,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c02fc93-43') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG os_vif [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:56,bridge_name='br-int',has_traffic_filtering=True,id=9c02fc93-434e-4e02-8855-14348e691115,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c02fc93-43') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Updating instance_info_cache with network_info: [{"id": "0558e7ef-e6d8-48fa-a27a-910bd9535e71", "address": "fa:16:3e:f6:d1:22", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0558e7ef-e6", "ovs_interfaceid": "0558e7ef-e6d8-48fa-a27a-910bd9535e71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c02fc93-43, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c02fc93-43, col_values=(('external_ids', {'iface-id': '9c02fc93-434e-4e02-8855-14348e691115', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:5c:56', 'vm-uuid': '441a61de-ad9d-412d-95f3-882cef273e88'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Releasing lock "refresh_cache-b10328c7-3328-4c3c-8ebe-3dd282ece0c9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Instance network_info: |[{"id": "0558e7ef-e6d8-48fa-a27a-910bd9535e71", "address": "fa:16:3e:f6:d1:22", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0558e7ef-e6", "ovs_interfaceid": "0558e7ef-e6d8-48fa-a27a-910bd9535e71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bb526dd4-f727-419c-b666-04ef324b6660 req-c7586ab3-ed5b-4c16-84e3-7e2dd9e9b4e1 service nova] Acquired lock "refresh_cache-b10328c7-3328-4c3c-8ebe-3dd282ece0c9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.network.neutron [req-bb526dd4-f727-419c-b666-04ef324b6660 req-c7586ab3-ed5b-4c16-84e3-7e2dd9e9b4e1 service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Refreshing network info cache for port 0558e7ef-e6d8-48fa-a27a-910bd9535e71 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Start _get_guest_xml network_info=[{"id": "0558e7ef-e6d8-48fa-a27a-910bd9535e71", "address": "fa:16:3e:f6:d1:22", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0558e7ef-e6", "ovs_interfaceid": "0558e7ef-e6d8-48fa-a27a-910bd9535e71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:53 user nova-compute[72150]: INFO os_vif [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:56,bridge_name='br-int',has_traffic_filtering=True,id=9c02fc93-434e-4e02-8855-14348e691115,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c02fc93-43')
Aug 01 18:32:53 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:32:53 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:32:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:32:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1581745707',display_name='tempest-AttachVolumeNegativeTest-server-1581745707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1581745707',id=27,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7gmptPh60Dx3ME8Qo8sFkf44Fg+2FHWtxkTYxwet9R8ZyQuD8jL3IFmhxppu58jWwHPNnmeT4alKtnTBqxDCCXQTFfPVCm0Nl8GkqVOqFHYo9jz+bn15zxFGoUYSNJMQ==',key_name='tempest-keypair-767620536',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66bad8c4e2a74caf8d35ad98e7888266',ramdisk_id='',reservation_id='r-k4afbu2h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-504132593',owner_user_name='tempest-AttachVolumeNegativeTest-504132593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:32:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f11bcc2f9cc048beb928fc0d3c30403e',uuid=b10328c7-3328-4c3c-8ebe-3dd282ece0c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0558e7ef-e6d8-48fa-a27a-910bd9535e71", "address": "fa:16:3e:f6:d1:22", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0558e7ef-e6", "ovs_interfaceid": "0558e7ef-e6d8-48fa-a27a-910bd9535e71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converting VIF {"id": "0558e7ef-e6d8-48fa-a27a-910bd9535e71", "address": "fa:16:3e:f6:d1:22", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0558e7ef-e6", "ovs_interfaceid": "0558e7ef-e6d8-48fa-a27a-910bd9535e71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d1:22,bridge_name='br-int',has_traffic_filtering=True,id=0558e7ef-e6d8-48fa-a27a-910bd9535e71,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0558e7ef-e6') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG nova.objects.instance [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lazy-loading 'pci_devices' on Instance uuid b10328c7-3328-4c3c-8ebe-3dd282ece0c9 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:32:54 user nova-compute[72150]:   <uuid>b10328c7-3328-4c3c-8ebe-3dd282ece0c9</uuid>
Aug 01 18:32:54 user nova-compute[72150]:   <name>instance-0000001b</name>
Aug 01 18:32:54 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:32:54 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:32:54 user nova-compute[72150]:   <metadata>
Aug 01 18:32:54 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:32:54 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:32:54 user nova-compute[72150]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1581745707</nova:name>
Aug 01 18:32:54 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:32:53</nova:creationTime>
Aug 01 18:32:54 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:32:54 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:32:54 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:32:54 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:32:54 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:32:54 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:32:54 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:32:54 user nova-compute[72150]:       <nova:owner>
Aug 01 18:32:54 user nova-compute[72150]:         <nova:user uuid="f11bcc2f9cc048beb928fc0d3c30403e">tempest-AttachVolumeNegativeTest-504132593-project-member</nova:user>
Aug 01 18:32:54 user nova-compute[72150]:         <nova:project uuid="66bad8c4e2a74caf8d35ad98e7888266">tempest-AttachVolumeNegativeTest-504132593</nova:project>
Aug 01 18:32:54 user nova-compute[72150]:       </nova:owner>
Aug 01 18:32:54 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:32:54 user nova-compute[72150]:       <nova:ports>
Aug 01 18:32:54 user nova-compute[72150]:         <nova:port uuid="0558e7ef-e6d8-48fa-a27a-910bd9535e71">
Aug 01 18:32:54 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 18:32:54 user nova-compute[72150]:         </nova:port>
Aug 01 18:32:54 user nova-compute[72150]:       </nova:ports>
Aug 01 18:32:54 user nova-compute[72150]:     </nova:instance>
Aug 01 18:32:54 user nova-compute[72150]:   </metadata>
Aug 01 18:32:54 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:32:54 user nova-compute[72150]:     <system>
Aug 01 18:32:54 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:32:54 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:32:54 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:32:54 user nova-compute[72150]:       <entry name="serial">b10328c7-3328-4c3c-8ebe-3dd282ece0c9</entry>
Aug 01 18:32:54 user nova-compute[72150]:       <entry name="uuid">b10328c7-3328-4c3c-8ebe-3dd282ece0c9</entry>
Aug 01 18:32:54 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:32:54 user nova-compute[72150]:     </system>
Aug 01 18:32:54 user nova-compute[72150]:   </sysinfo>
Aug 01 18:32:54 user nova-compute[72150]:   <os>
Aug 01 18:32:54 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:32:54 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:32:54 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:32:54 user nova-compute[72150]:   </os>
Aug 01 18:32:54 user nova-compute[72150]:   <features>
Aug 01 18:32:54 user nova-compute[72150]:     <acpi/>
Aug 01 18:32:54 user nova-compute[72150]:     <apic/>
Aug 01 18:32:54 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:32:54 user nova-compute[72150]:   </features>
Aug 01 18:32:54 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:32:54 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:32:54 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:32:54 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:32:54 user nova-compute[72150]:   </clock>
Aug 01 18:32:54 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:32:54 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:32:54 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:32:54 user nova-compute[72150]:   </cpu>
Aug 01 18:32:54 user nova-compute[72150]:   <devices>
Aug 01 18:32:54 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:32:54 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:32:54 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk"/>
Aug 01 18:32:54 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:32:54 user nova-compute[72150]:     </disk>
Aug 01 18:32:54 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:32:54 user nova-compute[72150]:       <mac address="fa:16:3e:f6:d1:22"/>
Aug 01 18:32:54 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:32:54 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:32:54 user nova-compute[72150]:       <target dev="tap0558e7ef-e6"/>
Aug 01 18:32:54 user nova-compute[72150]:     </interface>
Aug 01 18:32:54 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:32:54 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/console.log" append="off"/>
Aug 01 18:32:54 user nova-compute[72150]:     </serial>
Aug 01 18:32:54 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:32:54 user nova-compute[72150]:     <video>
Aug 01 18:32:54 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:32:54 user nova-compute[72150]:     </video>
Aug 01 18:32:54 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:32:54 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:32:54 user nova-compute[72150]:     </rng>
Aug 01 18:32:54 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:32:54 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:32:54 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:32:54 user nova-compute[72150]:     </memballoon>
Aug 01 18:32:54 user nova-compute[72150]:   </devices>
Aug 01 18:32:54 user nova-compute[72150]: </domain>
Aug 01 18:32:54 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:32:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1581745707',display_name='tempest-AttachVolumeNegativeTest-server-1581745707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1581745707',id=27,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7gmptPh60Dx3ME8Qo8sFkf44Fg+2FHWtxkTYxwet9R8ZyQuD8jL3IFmhxppu58jWwHPNnmeT4alKtnTBqxDCCXQTFfPVCm0Nl8GkqVOqFHYo9jz+bn15zxFGoUYSNJMQ==',key_name='tempest-keypair-767620536',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66bad8c4e2a74caf8d35ad98e7888266',ramdisk_id='',reservation_id='r-k4afbu2h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-504132593',owner_user_name='tempest-AttachVolumeNegativeTest-504132593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:32:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f11bcc2f9cc048beb928fc0d3c30403e',uuid=b10328c7-3328-4c3c-8ebe-3dd282ece0c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0558e7ef-e6d8-48fa-a27a-910bd9535e71", "address": "fa:16:3e:f6:d1:22", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0558e7ef-e6", "ovs_interfaceid": "0558e7ef-e6d8-48fa-a27a-910bd9535e71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converting VIF {"id": "0558e7ef-e6d8-48fa-a27a-910bd9535e71", "address": "fa:16:3e:f6:d1:22", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0558e7ef-e6", "ovs_interfaceid": "0558e7ef-e6d8-48fa-a27a-910bd9535e71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d1:22,bridge_name='br-int',has_traffic_filtering=True,id=0558e7ef-e6d8-48fa-a27a-910bd9535e71,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0558e7ef-e6') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG os_vif [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d1:22,bridge_name='br-int',has_traffic_filtering=True,id=0558e7ef-e6d8-48fa-a27a-910bd9535e71,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0558e7ef-e6') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0558e7ef-e6, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0558e7ef-e6, col_values=(('external_ids', {'iface-id': '0558e7ef-e6d8-48fa-a27a-910bd9535e71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:d1:22', 'vm-uuid': 'b10328c7-3328-4c3c-8ebe-3dd282ece0c9'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] No VIF found with MAC fa:16:3e:ba:5c:56, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:54 user nova-compute[72150]: INFO os_vif [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d1:22,bridge_name='br-int',has_traffic_filtering=True,id=0558e7ef-e6d8-48fa-a27a-910bd9535e71,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0558e7ef-e6')
Aug 01 18:32:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] No VIF found with MAC fa:16:3e:f6:d1:22, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG nova.network.neutron [req-bb526dd4-f727-419c-b666-04ef324b6660 req-c7586ab3-ed5b-4c16-84e3-7e2dd9e9b4e1 service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Updated VIF entry in instance network info cache for port 0558e7ef-e6d8-48fa-a27a-910bd9535e71. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG nova.network.neutron [req-bb526dd4-f727-419c-b666-04ef324b6660 req-c7586ab3-ed5b-4c16-84e3-7e2dd9e9b4e1 service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Updating instance_info_cache with network_info: [{"id": "0558e7ef-e6d8-48fa-a27a-910bd9535e71", "address": "fa:16:3e:f6:d1:22", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0558e7ef-e6", "ovs_interfaceid": "0558e7ef-e6d8-48fa-a27a-910bd9535e71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:32:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bb526dd4-f727-419c-b666-04ef324b6660 req-c7586ab3-ed5b-4c16-84e3-7e2dd9e9b4e1 service nova] Releasing lock "refresh_cache-b10328c7-3328-4c3c-8ebe-3dd282ece0c9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:32:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-d679bd23-2ff1-4434-9aa7-ccecf0b659fe req-06f6add4-9eee-4018-acb6-9f72e0223802 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Received event network-vif-plugged-9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:32:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d679bd23-2ff1-4434-9aa7-ccecf0b659fe req-06f6add4-9eee-4018-acb6-9f72e0223802 service nova] Acquiring lock "441a61de-ad9d-412d-95f3-882cef273e88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d679bd23-2ff1-4434-9aa7-ccecf0b659fe req-06f6add4-9eee-4018-acb6-9f72e0223802 service nova] Lock "441a61de-ad9d-412d-95f3-882cef273e88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d679bd23-2ff1-4434-9aa7-ccecf0b659fe req-06f6add4-9eee-4018-acb6-9f72e0223802 service nova] Lock "441a61de-ad9d-412d-95f3-882cef273e88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-d679bd23-2ff1-4434-9aa7-ccecf0b659fe req-06f6add4-9eee-4018-acb6-9f72e0223802 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] No waiting events found dispatching network-vif-plugged-9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:32:56 user nova-compute[72150]: WARNING nova.compute.manager [req-d679bd23-2ff1-4434-9aa7-ccecf0b659fe req-06f6add4-9eee-4018-acb6-9f72e0223802 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Received unexpected event network-vif-plugged-9c02fc93-434e-4e02-8855-14348e691115 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 18:32:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:58 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914763.0724823, beb6d063-d147-4033-ae73-55ff95a48efa => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:32:58 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] VM Stopped (Lifecycle Event)
Aug 01 18:32:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-aaeae7cf-5546-4740-b8ff-2302342bcd39 None None] [instance: beb6d063-d147-4033-ae73-55ff95a48efa] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:32:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-497fa41b-d218-4ace-a915-949b8d0f12f8 req-e3f83ad2-b4ec-40d1-bdb6-0ca0e1b0137d service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Received event network-vif-plugged-9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:32:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-497fa41b-d218-4ace-a915-949b8d0f12f8 req-e3f83ad2-b4ec-40d1-bdb6-0ca0e1b0137d service nova] Acquiring lock "441a61de-ad9d-412d-95f3-882cef273e88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-497fa41b-d218-4ace-a915-949b8d0f12f8 req-e3f83ad2-b4ec-40d1-bdb6-0ca0e1b0137d service nova] Lock "441a61de-ad9d-412d-95f3-882cef273e88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-497fa41b-d218-4ace-a915-949b8d0f12f8 req-e3f83ad2-b4ec-40d1-bdb6-0ca0e1b0137d service nova] Lock "441a61de-ad9d-412d-95f3-882cef273e88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-497fa41b-d218-4ace-a915-949b8d0f12f8 req-e3f83ad2-b4ec-40d1-bdb6-0ca0e1b0137d service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] No waiting events found dispatching network-vif-plugged-9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:32:58 user nova-compute[72150]: WARNING nova.compute.manager [req-497fa41b-d218-4ace-a915-949b8d0f12f8 req-e3f83ad2-b4ec-40d1-bdb6-0ca0e1b0137d service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Received unexpected event network-vif-plugged-9c02fc93-434e-4e02-8855-14348e691115 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 18:32:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-497fa41b-d218-4ace-a915-949b8d0f12f8 req-e3f83ad2-b4ec-40d1-bdb6-0ca0e1b0137d service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Received event network-vif-plugged-0558e7ef-e6d8-48fa-a27a-910bd9535e71 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:32:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-497fa41b-d218-4ace-a915-949b8d0f12f8 req-e3f83ad2-b4ec-40d1-bdb6-0ca0e1b0137d service nova] Acquiring lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-497fa41b-d218-4ace-a915-949b8d0f12f8 req-e3f83ad2-b4ec-40d1-bdb6-0ca0e1b0137d service nova] Lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-497fa41b-d218-4ace-a915-949b8d0f12f8 req-e3f83ad2-b4ec-40d1-bdb6-0ca0e1b0137d service nova] Lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-497fa41b-d218-4ace-a915-949b8d0f12f8 req-e3f83ad2-b4ec-40d1-bdb6-0ca0e1b0137d service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] No waiting events found dispatching network-vif-plugged-0558e7ef-e6d8-48fa-a27a-910bd9535e71 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:32:58 user nova-compute[72150]: WARNING nova.compute.manager [req-497fa41b-d218-4ace-a915-949b8d0f12f8 req-e3f83ad2-b4ec-40d1-bdb6-0ca0e1b0137d service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Received unexpected event network-vif-plugged-0558e7ef-e6d8-48fa-a27a-910bd9535e71 for instance with vm_state building and task_state spawning.
Aug 01 18:32:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-497fa41b-d218-4ace-a915-949b8d0f12f8 req-e3f83ad2-b4ec-40d1-bdb6-0ca0e1b0137d service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Received event network-vif-plugged-0558e7ef-e6d8-48fa-a27a-910bd9535e71 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:32:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-497fa41b-d218-4ace-a915-949b8d0f12f8 req-e3f83ad2-b4ec-40d1-bdb6-0ca0e1b0137d service nova] Acquiring lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:32:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-497fa41b-d218-4ace-a915-949b8d0f12f8 req-e3f83ad2-b4ec-40d1-bdb6-0ca0e1b0137d service nova] Lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:32:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-497fa41b-d218-4ace-a915-949b8d0f12f8 req-e3f83ad2-b4ec-40d1-bdb6-0ca0e1b0137d service nova] Lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-497fa41b-d218-4ace-a915-949b8d0f12f8 req-e3f83ad2-b4ec-40d1-bdb6-0ca0e1b0137d service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] No waiting events found dispatching network-vif-plugged-0558e7ef-e6d8-48fa-a27a-910bd9535e71 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:32:58 user nova-compute[72150]: WARNING nova.compute.manager [req-497fa41b-d218-4ace-a915-949b8d0f12f8 req-e3f83ad2-b4ec-40d1-bdb6-0ca0e1b0137d service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Received unexpected event network-vif-plugged-0558e7ef-e6d8-48fa-a27a-910bd9535e71 for instance with vm_state building and task_state spawning.
Aug 01 18:32:58 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914778.9645998, b10328c7-3328-4c3c-8ebe-3dd282ece0c9 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:32:58 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] VM Resumed (Lifecycle Event)
Aug 01 18:32:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:32:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:32:58 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Instance spawned successfully.
Aug 01 18:32:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:32:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:32:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:32:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:32:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:32:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:32:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:32:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:32:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:32:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:32:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:32:59 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Instance spawned successfully.
Aug 01 18:32:59 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:32:59 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914778.9679039, b10328c7-3328-4c3c-8ebe-3dd282ece0c9 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:32:59 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] VM Started (Lifecycle Event)
Aug 01 18:32:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:32:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:32:59 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:32:59 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914778.9937403, 441a61de-ad9d-412d-95f3-882cef273e88 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:32:59 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] VM Resumed (Lifecycle Event)
Aug 01 18:32:59 user nova-compute[72150]: INFO nova.compute.manager [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Took 7.50 seconds to spawn the instance on the hypervisor.
Aug 01 18:32:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:32:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:32:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:32:59 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:32:59 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914778.9959373, 441a61de-ad9d-412d-95f3-882cef273e88 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:32:59 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] VM Started (Lifecycle Event)
Aug 01 18:32:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:32:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:32:59 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:32:59 user nova-compute[72150]: INFO nova.compute.manager [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Took 8.74 seconds to build instance.
Aug 01 18:32:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d752c4ae-5102-4b13-87c7-a00f4ca96586 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.891s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:32:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:32:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:32:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c8a681ec-e25a-4977-b061-b3225e2a6528 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "441a61de-ad9d-412d-95f3-882cef273e88" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.225s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:00 user nova-compute[72150]: DEBUG nova.network.neutron [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Port e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc binding to destination host user is already ACTIVE {{(pid=72150) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 18:33:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "refresh_cache-a5f0eca7-d060-4226-b36e-a3cd15b15703" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:33:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquired lock "refresh_cache-a5f0eca7-d060-4226-b36e-a3cd15b15703" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:33:00 user nova-compute[72150]: DEBUG nova.network.neutron [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:33:00 user nova-compute[72150]: DEBUG nova.network.neutron [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Updating instance_info_cache with network_info: [{"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:33:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Releasing lock "refresh_cache-a5f0eca7-d060-4226-b36e-a3cd15b15703" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:33:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Creating tmpfile /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/tmp05lshsn3 to verify with other compute node that the instance is on the same shared storage. {{(pid=72150) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 01 18:33:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG nova.compute.manager [req-5f21a60e-cd29-4dc3-9d07-0fb1cfc6a4d1 req-9e45180b-7d5c-4c16-9c4b-1f3971dcdc85 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received event network-vif-unplugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5f21a60e-cd29-4dc3-9d07-0fb1cfc6a4d1 req-9e45180b-7d5c-4c16-9c4b-1f3971dcdc85 service nova] Acquiring lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5f21a60e-cd29-4dc3-9d07-0fb1cfc6a4d1 req-9e45180b-7d5c-4c16-9c4b-1f3971dcdc85 service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5f21a60e-cd29-4dc3-9d07-0fb1cfc6a4d1 req-9e45180b-7d5c-4c16-9c4b-1f3971dcdc85 service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG nova.compute.manager [req-5f21a60e-cd29-4dc3-9d07-0fb1cfc6a4d1 req-9e45180b-7d5c-4c16-9c4b-1f3971dcdc85 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] No waiting events found dispatching network-vif-unplugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:33:01 user nova-compute[72150]: WARNING nova.compute.manager [req-5f21a60e-cd29-4dc3-9d07-0fb1cfc6a4d1 req-9e45180b-7d5c-4c16-9c4b-1f3971dcdc85 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received unexpected event network-vif-unplugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc for instance with vm_state resized and task_state resize_reverting.
Aug 01 18:33:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:01 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Instance destroyed successfully.
Aug 01 18:33:01 user nova-compute[72150]: DEBUG nova.objects.instance [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lazy-loading 'resources' on Instance uuid a5f0eca7-d060-4226-b36e-a3cd15b15703 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1769556587',display_name='tempest-ServerActionsTestOtherB-server-1769556587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1769556587',id=18,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHk1JfNPFXl8HOej4l4GGAFwiUlyr68TuvMkyJFt7CHfDXuZjpGZ30rkbU/oouT3R2Q9X+Pk0+5iMSh/dzvrWC0rsJ078sX31sP2prrj5uYPobmNDT4n3BlWJvWW4raDpA==',key_name='tempest-keypair-792111278',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:31:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d566eb776234eb4a834d0e3f6dd7792',ramdisk_id='',reservation_id='r-o20tu0o3',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-623575398',owner_user_name='tempest-ServerActionsTestOtherB-623575398-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:31:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68c9836c352b488b934723c56f892c10',uuid=a5f0eca7-d060-4226-b36e-a3cd15b15703,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Converting VIF {"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc,network=Network(36c41dfd-577c-4ceb-a1f7-69187368b386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0a2205a-4b') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG os_vif [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc,network=Network(36c41dfd-577c-4ceb-a1f7-69187368b386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0a2205a-4b') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0a2205a-4b, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:01 user nova-compute[72150]: INFO os_vif [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc,network=Network(36c41dfd-577c-4ceb-a1f7-69187368b386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0a2205a-4b')
Aug 01 18:33:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDySdpws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:33:01 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:33:01 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[20478349-cdf6-42af-98ba-07c6d3a11738]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c60117-4b4f-47d4-a5da-2ddcf27da648]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:33:01 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:33:01 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:33:01 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:33:01 user nova-compute[72150]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:33:01 user nova-compute[72150]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)
Aug 01 18:33:01 user nova-compute[72150]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)
Aug 01 18:33:01 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:33:01 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:33:01 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:33:01 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:33:01 user nova-compute[72150]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:33:01 user nova-compute[72150]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)
Aug 01 18:33:01 user nova-compute[72150]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)
Aug 01 18:33:01 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec556290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834'): ({'sdf'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Removing single pathed devices sdf {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6ca01a-2771-4b09-9ac1-813d744f923d]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f8eff7-3b1a-4f7d-ba06-34e65e354fae]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Flushing IO for device /dev/sdf {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c97fb5-86c4-4dfe-92e6-914cb4fa1ba4]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8975353e-d290-4287-8b98-cf9481d2f17e]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] SCSI volumes sdf have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5afe6f3-e62e-43b2-82b0-e062641a463e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:02 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --logout" returned: 0 in 0.105s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:02 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13d7b1a-2aac-4c91-8b4f-ceacd1b6c102]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:02 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260]
Aug 01 18:33:02 user nova-compute[72150]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260] successful.
Aug 01 18:33:02 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:02 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:02 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:02 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa16ce53-d1fd-44f2-84c5-11106ed8364b]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:02 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:02 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:33:02 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] <== disconnect_volume: return (394ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:33:02 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:33:03 user nova-compute[72150]: DEBUG nova.compute.manager [req-9244d2f9-800c-469d-93e7-8031720e9c73 req-1d9d66ed-4755-47d0-b5b3-8e4044833099 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received event network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9244d2f9-800c-469d-93e7-8031720e9c73 req-1d9d66ed-4755-47d0-b5b3-8e4044833099 service nova] Acquiring lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9244d2f9-800c-469d-93e7-8031720e9c73 req-1d9d66ed-4755-47d0-b5b3-8e4044833099 service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9244d2f9-800c-469d-93e7-8031720e9c73 req-1d9d66ed-4755-47d0-b5b3-8e4044833099 service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:03 user nova-compute[72150]: DEBUG nova.compute.manager [req-9244d2f9-800c-469d-93e7-8031720e9c73 req-1d9d66ed-4755-47d0-b5b3-8e4044833099 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] No waiting events found dispatching network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:33:03 user nova-compute[72150]: WARNING nova.compute.manager [req-9244d2f9-800c-469d-93e7-8031720e9c73 req-1d9d66ed-4755-47d0-b5b3-8e4044833099 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received unexpected event network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc for instance with vm_state resized and task_state resize_reverting.
Aug 01 18:33:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:03 user nova-compute[72150]: DEBUG nova.objects.instance [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lazy-loading 'migration_context' on Instance uuid a5f0eca7-d060-4226-b36e-a3cd15b15703 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:33:03 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:33:03 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:33:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.492s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:04 user nova-compute[72150]: INFO nova.compute.manager [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Swapping old allocation on dict_keys(['f205788b-0048-4b9c-8d9d-b0437c5c3479']) held by migration 2182feaa-9b23-4385-8e0a-7709471ff371 for instance
Aug 01 18:33:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:04 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Overwriting current allocation {'allocations': {'f205788b-0048-4b9c-8d9d-b0437c5c3479': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 33}}, 'project_id': '3d566eb776234eb4a834d0e3f6dd7792', 'user_id': '68c9836c352b488b934723c56f892c10', 'consumer_generation': 1} on consumer a5f0eca7-d060-4226-b36e-a3cd15b15703 {{(pid=72150) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 01 18:33:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "refresh_cache-a5f0eca7-d060-4226-b36e-a3cd15b15703" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:33:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquired lock "refresh_cache-a5f0eca7-d060-4226-b36e-a3cd15b15703" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:33:04 user nova-compute[72150]: DEBUG nova.network.neutron [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:33:04 user nova-compute[72150]: DEBUG nova.network.neutron [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Updating instance_info_cache with network_info: [{"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:33:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Releasing lock "refresh_cache-a5f0eca7-d060-4226-b36e-a3cd15b15703" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:33:04 user nova-compute[72150]: DEBUG os_brick.utils [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:33:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a290a3-b34b-4924-8dc5-b42c06e23586]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dc49f1-2570-473c-b8c7-94db7bddae5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c860c9-bb8d-40d4-a92d-f21fbd40b68b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff694871-006e-4f84-ab23-fa557b6675d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:33:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:33:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:33:05 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:33:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4abd8f7-8d76-4110-ad63-83f3c6b39b03]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:33:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:33:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:33:05 user nova-compute[72150]: DEBUG os_brick.utils [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:33:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:07 user nova-compute[72150]: INFO nova.compute.manager [None req-611d4f0d-ff53-4d12-be66-da8dbf9b98f3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Unrescuing
Aug 01 18:33:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-611d4f0d-ff53-4d12-be66-da8dbf9b98f3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "refresh_cache-42e75a98-beb1-4688-a375-affc63b14252" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:33:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-611d4f0d-ff53-4d12-be66-da8dbf9b98f3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquired lock "refresh_cache-42e75a98-beb1-4688-a375-affc63b14252" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:33:07 user nova-compute[72150]: DEBUG nova.network.neutron [None req-611d4f0d-ff53-4d12-be66-da8dbf9b98f3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:33:08 user nova-compute[72150]: DEBUG nova.network.neutron [None req-611d4f0d-ff53-4d12-be66-da8dbf9b98f3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Updating instance_info_cache with network_info: [{"id": "10529340-a252-4604-accb-19f26670f125", "address": "fa:16:3e:56:f4:53", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10529340-a2", "ovs_interfaceid": "10529340-a252-4604-accb-19f26670f125", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:33:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-611d4f0d-ff53-4d12-be66-da8dbf9b98f3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Releasing lock "refresh_cache-42e75a98-beb1-4688-a375-affc63b14252" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:33:08 user nova-compute[72150]: DEBUG nova.objects.instance [None req-611d4f0d-ff53-4d12-be66-da8dbf9b98f3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'flavor' on Instance uuid 42e75a98-beb1-4688-a375-affc63b14252 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:33:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:08 user nova-compute[72150]: DEBUG nova.compute.manager [req-d29c1987-399c-41b7-a154-1ea27b4eb89b req-03274038-79cd-4e8c-8b35-7167cf218f68 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received event network-vif-unplugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d29c1987-399c-41b7-a154-1ea27b4eb89b req-03274038-79cd-4e8c-8b35-7167cf218f68 service nova] Acquiring lock "42e75a98-beb1-4688-a375-affc63b14252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d29c1987-399c-41b7-a154-1ea27b4eb89b req-03274038-79cd-4e8c-8b35-7167cf218f68 service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d29c1987-399c-41b7-a154-1ea27b4eb89b req-03274038-79cd-4e8c-8b35-7167cf218f68 service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:08 user nova-compute[72150]: DEBUG nova.compute.manager [req-d29c1987-399c-41b7-a154-1ea27b4eb89b req-03274038-79cd-4e8c-8b35-7167cf218f68 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] No waiting events found dispatching network-vif-unplugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:33:08 user nova-compute[72150]: WARNING nova.compute.manager [req-d29c1987-399c-41b7-a154-1ea27b4eb89b req-03274038-79cd-4e8c-8b35-7167cf218f68 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received unexpected event network-vif-unplugged-10529340-a252-4604-accb-19f26670f125 for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:33:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:09 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Instance destroyed successfully.
Aug 01 18:33:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] Acquiring lock "42e75a98-beb1-4688-a375-affc63b14252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] No waiting events found dispatching network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:33:10 user nova-compute[72150]: WARNING nova.compute.manager [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received unexpected event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:33:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] Acquiring lock "42e75a98-beb1-4688-a375-affc63b14252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] No waiting events found dispatching network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:33:10 user nova-compute[72150]: WARNING nova.compute.manager [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received unexpected event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:33:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] Acquiring lock "42e75a98-beb1-4688-a375-affc63b14252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] No waiting events found dispatching network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:33:10 user nova-compute[72150]: WARNING nova.compute.manager [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received unexpected event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:33:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received event network-vif-unplugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] Acquiring lock "42e75a98-beb1-4688-a375-affc63b14252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] No waiting events found dispatching network-vif-unplugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:33:10 user nova-compute[72150]: WARNING nova.compute.manager [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received unexpected event network-vif-unplugged-10529340-a252-4604-accb-19f26670f125 for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:33:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] Acquiring lock "42e75a98-beb1-4688-a375-affc63b14252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] No waiting events found dispatching network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:33:10 user nova-compute[72150]: WARNING nova.compute.manager [req-93fa98f8-b404-4e5c-9219-65f137fc501e req-4de945e4-b498-4814-ae8e-4d12122955ec service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received unexpected event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:33:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Removed pending event for 42e75a98-beb1-4688-a375-affc63b14252 due to event {{(pid=72150) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 18:33:12 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914792.7959151, 42e75a98-beb1-4688-a375-affc63b14252 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:33:12 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] VM Resumed (Lifecycle Event)
Aug 01 18:33:12 user nova-compute[72150]: DEBUG nova.compute.manager [None req-611d4f0d-ff53-4d12-be66-da8dbf9b98f3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:33:12 user nova-compute[72150]: DEBUG nova.compute.manager [req-859ad3ab-aa43-4205-81ff-c7731b1bc74c req-4435fbf4-0a82-4d7f-b919-91a76022c606 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-859ad3ab-aa43-4205-81ff-c7731b1bc74c req-4435fbf4-0a82-4d7f-b919-91a76022c606 service nova] Acquiring lock "42e75a98-beb1-4688-a375-affc63b14252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-859ad3ab-aa43-4205-81ff-c7731b1bc74c req-4435fbf4-0a82-4d7f-b919-91a76022c606 service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-859ad3ab-aa43-4205-81ff-c7731b1bc74c req-4435fbf4-0a82-4d7f-b919-91a76022c606 service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:12 user nova-compute[72150]: DEBUG nova.compute.manager [req-859ad3ab-aa43-4205-81ff-c7731b1bc74c req-4435fbf4-0a82-4d7f-b919-91a76022c606 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] No waiting events found dispatching network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:33:12 user nova-compute[72150]: WARNING nova.compute.manager [req-859ad3ab-aa43-4205-81ff-c7731b1bc74c req-4435fbf4-0a82-4d7f-b919-91a76022c606 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received unexpected event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:33:12 user nova-compute[72150]: DEBUG nova.compute.manager [req-859ad3ab-aa43-4205-81ff-c7731b1bc74c req-4435fbf4-0a82-4d7f-b919-91a76022c606 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-859ad3ab-aa43-4205-81ff-c7731b1bc74c req-4435fbf4-0a82-4d7f-b919-91a76022c606 service nova] Acquiring lock "42e75a98-beb1-4688-a375-affc63b14252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-859ad3ab-aa43-4205-81ff-c7731b1bc74c req-4435fbf4-0a82-4d7f-b919-91a76022c606 service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-859ad3ab-aa43-4205-81ff-c7731b1bc74c req-4435fbf4-0a82-4d7f-b919-91a76022c606 service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:12 user nova-compute[72150]: DEBUG nova.compute.manager [req-859ad3ab-aa43-4205-81ff-c7731b1bc74c req-4435fbf4-0a82-4d7f-b919-91a76022c606 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] No waiting events found dispatching network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:33:12 user nova-compute[72150]: WARNING nova.compute.manager [req-859ad3ab-aa43-4205-81ff-c7731b1bc74c req-4435fbf4-0a82-4d7f-b919-91a76022c606 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received unexpected event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:33:12 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:33:12 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:33:12 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 18:33:12 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914792.7998233, 42e75a98-beb1-4688-a375-affc63b14252 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:33:12 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] VM Started (Lifecycle Event)
Aug 01 18:33:12 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:33:12 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Starting finish_revert_migration {{(pid=72150) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Start _get_guest_xml network_info=[{"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c87f216f-785c-4829-a589-35bf61089ac2', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDySdpws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a5f0eca7-d060-4226-b36e-a3cd15b15703', 'attached_at': '2023-08-01T18:33:13.000000', 'detached_at': '', 'volume_id': 'db690b5a-dd50-4971-9f5b-486fad1b1834', 'serial': 'db690b5a-dd50-4971-9f5b-486fad1b1834'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:33:13 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:33:13 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:33:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG nova.objects.instance [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lazy-loading 'vcpu_model' on Instance uuid a5f0eca7-d060-4226-b36e-a3cd15b15703 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDySdpws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:33:13 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:33:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:33:13 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:33:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:33:13 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:33:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9afa3e-59e9-4589-bcc3-61e9a083e2cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:33:13 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e2bb16-1be2-4973-bd6f-a2132b07041c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834] added
Aug 01 18:33:13 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d43ccc-5c55-47da-ba8f-947a6e64212e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f3f528-2ba3-44f5-8b80-ccdf594fe784]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gDySdpws {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gDySdpws" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c2eb05-070c-4bec-b301-f5355948fa83]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gDySdpws'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fab1bcd-cf92-4397-a733-07591e649284]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[af16cf96-f87b-48d2-bf6b-72b1e2cab242]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:33:13 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:33:13 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:33:13 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:33:13 user nova-compute[72150]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)
Aug 01 18:33:13 user nova-compute[72150]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)
Aug 01 18:33:13 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:33:13 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:33:13 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:33:13 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:33:13 user nova-compute[72150]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)
Aug 01 18:33:13 user nova-compute[72150]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)
Aug 01 18:33:13 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:33:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --login" returned: 0 in 0.136s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce304251-320a-4861-b0bb-8c233260ae08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260]
Aug 01 18:33:14 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260] successful.
Aug 01 18:33:14 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6423c7-4dc2-480c-b645-e58318f81864]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc4715d-61ed-4c9d-be21-3e68eb21bffc]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:33:14 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:33:14 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:33:14 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:33:14 user nova-compute[72150]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)
Aug 01 18:33:14 user nova-compute[72150]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)
Aug 01 18:33:14 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:33:14 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:33:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:33:14 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:33:14 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:33:14 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:33:14 user nova-compute[72150]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)
Aug 01 18:33:14 user nova-compute[72150]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)
Aug 01 18:33:14 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:33:14 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:33:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:33:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:33:14 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:33:14 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:33:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c248c3-4c4d-4181-a50b-8dc55d6a7094]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:14 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: None {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:33:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:15 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:33:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDySdpws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:33:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:33:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23966623265323939', 'path': '/dev/sdf'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:33:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966623265323939', 'path': '/dev/sdf'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:33:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1769556587',display_name='tempest-ServerActionsTestOtherB-server-1769556587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1769556587',id=18,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHk1JfNPFXl8HOej4l4GGAFwiUlyr68TuvMkyJFt7CHfDXuZjpGZ30rkbU/oouT3R2Q9X+Pk0+5iMSh/dzvrWC0rsJ078sX31sP2prrj5uYPobmNDT4n3BlWJvWW4raDpA==',key_name='tempest-keypair-792111278',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:31:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3d566eb776234eb4a834d0e3f6dd7792',ramdisk_id='',reservation_id='r-o20tu0o3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-623575398',owner_user_name='tempest-ServerActionsTestOtherB-623575398-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68c9836c352b488b934723c56f892c10',uuid=a5f0eca7-d060-4226-b36e-a3cd15b15703,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:33:15 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Converting VIF {"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:33:15 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc,network=Network(36c41dfd-577c-4ceb-a1f7-69187368b386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0a2205a-4b') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:33:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:33:15 user nova-compute[72150]:   <uuid>a5f0eca7-d060-4226-b36e-a3cd15b15703</uuid>
Aug 01 18:33:15 user nova-compute[72150]:   <name>instance-00000012</name>
Aug 01 18:33:15 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:33:15 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:33:15 user nova-compute[72150]:   <metadata>
Aug 01 18:33:15 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:33:15 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:33:15 user nova-compute[72150]:       <nova:name>tempest-ServerActionsTestOtherB-server-1769556587</nova:name>
Aug 01 18:33:15 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:33:13</nova:creationTime>
Aug 01 18:33:15 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:33:15 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:33:15 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:33:15 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:33:15 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:33:15 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:33:15 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:33:15 user nova-compute[72150]:       <nova:owner>
Aug 01 18:33:15 user nova-compute[72150]:         <nova:user uuid="68c9836c352b488b934723c56f892c10">tempest-ServerActionsTestOtherB-623575398-project-member</nova:user>
Aug 01 18:33:15 user nova-compute[72150]:         <nova:project uuid="3d566eb776234eb4a834d0e3f6dd7792">tempest-ServerActionsTestOtherB-623575398</nova:project>
Aug 01 18:33:15 user nova-compute[72150]:       </nova:owner>
Aug 01 18:33:15 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:33:15 user nova-compute[72150]:       <nova:ports>
Aug 01 18:33:15 user nova-compute[72150]:         <nova:port uuid="e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc">
Aug 01 18:33:15 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 18:33:15 user nova-compute[72150]:         </nova:port>
Aug 01 18:33:15 user nova-compute[72150]:       </nova:ports>
Aug 01 18:33:15 user nova-compute[72150]:     </nova:instance>
Aug 01 18:33:15 user nova-compute[72150]:   </metadata>
Aug 01 18:33:15 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:33:15 user nova-compute[72150]:     <system>
Aug 01 18:33:15 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:33:15 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:33:15 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:33:15 user nova-compute[72150]:       <entry name="serial">a5f0eca7-d060-4226-b36e-a3cd15b15703</entry>
Aug 01 18:33:15 user nova-compute[72150]:       <entry name="uuid">a5f0eca7-d060-4226-b36e-a3cd15b15703</entry>
Aug 01 18:33:15 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:33:15 user nova-compute[72150]:     </system>
Aug 01 18:33:15 user nova-compute[72150]:   </sysinfo>
Aug 01 18:33:15 user nova-compute[72150]:   <os>
Aug 01 18:33:15 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:33:15 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:33:15 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:33:15 user nova-compute[72150]:   </os>
Aug 01 18:33:15 user nova-compute[72150]:   <features>
Aug 01 18:33:15 user nova-compute[72150]:     <acpi/>
Aug 01 18:33:15 user nova-compute[72150]:     <apic/>
Aug 01 18:33:15 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:33:15 user nova-compute[72150]:   </features>
Aug 01 18:33:15 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:33:15 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:33:15 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:33:15 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:33:15 user nova-compute[72150]:   </clock>
Aug 01 18:33:15 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:33:15 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:33:15 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:33:15 user nova-compute[72150]:   </cpu>
Aug 01 18:33:15 user nova-compute[72150]:   <devices>
Aug 01 18:33:15 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:33:15 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:33:15 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk"/>
Aug 01 18:33:15 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:33:15 user nova-compute[72150]:     </disk>
Aug 01 18:33:15 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:33:15 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:33:15 user nova-compute[72150]:       <source dev="/dev/sdf"/>
Aug 01 18:33:15 user nova-compute[72150]:       <target dev="vdb" bus="virtio"/>
Aug 01 18:33:15 user nova-compute[72150]:       <serial>db690b5a-dd50-4971-9f5b-486fad1b1834</serial>
Aug 01 18:33:15 user nova-compute[72150]:     </disk>
Aug 01 18:33:15 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:33:15 user nova-compute[72150]:       <mac address="fa:16:3e:65:82:a8"/>
Aug 01 18:33:15 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:33:15 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:33:15 user nova-compute[72150]:       <target dev="tape0a2205a-4b"/>
Aug 01 18:33:15 user nova-compute[72150]:     </interface>
Aug 01 18:33:15 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:33:15 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/console.log" append="off"/>
Aug 01 18:33:15 user nova-compute[72150]:     </serial>
Aug 01 18:33:15 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:33:15 user nova-compute[72150]:     <video>
Aug 01 18:33:15 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:33:15 user nova-compute[72150]:     </video>
Aug 01 18:33:15 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:33:15 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:33:15 user nova-compute[72150]:     </rng>
Aug 01 18:33:15 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:33:15 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:33:15 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:33:15 user nova-compute[72150]:     </memballoon>
Aug 01 18:33:15 user nova-compute[72150]:   </devices>
Aug 01 18:33:15 user nova-compute[72150]: </domain>
Aug 01 18:33:15 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:33:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1769556587',display_name='tempest-ServerActionsTestOtherB-server-1769556587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1769556587',id=18,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHk1JfNPFXl8HOej4l4GGAFwiUlyr68TuvMkyJFt7CHfDXuZjpGZ30rkbU/oouT3R2Q9X+Pk0+5iMSh/dzvrWC0rsJ078sX31sP2prrj5uYPobmNDT4n3BlWJvWW4raDpA==',key_name='tempest-keypair-792111278',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:31:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3d566eb776234eb4a834d0e3f6dd7792',ramdisk_id='',reservation_id='r-o20tu0o3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-623575398',owner_user_name='tempest-ServerActionsTestOtherB-623575398-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68c9836c352b488b934723c56f892c10',uuid=a5f0eca7-d060-4226-b36e-a3cd15b15703,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:33:15 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Converting VIF {"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:33:15 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc,network=Network(36c41dfd-577c-4ceb-a1f7-69187368b386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0a2205a-4b') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:33:15 user nova-compute[72150]: DEBUG os_vif [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc,network=Network(36c41dfd-577c-4ceb-a1f7-69187368b386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0a2205a-4b') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:33:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:33:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:33:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0a2205a-4b, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:33:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape0a2205a-4b, col_values=(('external_ids', {'iface-id': 'e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:82:a8', 'vm-uuid': 'a5f0eca7-d060-4226-b36e-a3cd15b15703'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:33:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:33:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:15 user nova-compute[72150]: INFO os_vif [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc,network=Network(36c41dfd-577c-4ceb-a1f7-69187368b386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0a2205a-4b')
Aug 01 18:33:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:16 user nova-compute[72150]: DEBUG nova.compute.manager [req-879b6170-90eb-4602-b2dc-d0d555409911 req-9472a9fa-a46c-47a9-894f-f070812c0129 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received event network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-879b6170-90eb-4602-b2dc-d0d555409911 req-9472a9fa-a46c-47a9-894f-f070812c0129 service nova] Acquiring lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-879b6170-90eb-4602-b2dc-d0d555409911 req-9472a9fa-a46c-47a9-894f-f070812c0129 service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-879b6170-90eb-4602-b2dc-d0d555409911 req-9472a9fa-a46c-47a9-894f-f070812c0129 service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:16 user nova-compute[72150]: DEBUG nova.compute.manager [req-879b6170-90eb-4602-b2dc-d0d555409911 req-9472a9fa-a46c-47a9-894f-f070812c0129 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] No waiting events found dispatching network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:33:16 user nova-compute[72150]: WARNING nova.compute.manager [req-879b6170-90eb-4602-b2dc-d0d555409911 req-9472a9fa-a46c-47a9-894f-f070812c0129 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received unexpected event network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc for instance with vm_state resized and task_state resize_reverting.
Aug 01 18:33:16 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914781.6847792, a5f0eca7-d060-4226-b36e-a3cd15b15703 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:33:16 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] VM Stopped (Lifecycle Event)
Aug 01 18:33:16 user nova-compute[72150]: DEBUG nova.compute.manager [None req-a0d7328a-d394-4bb5-b25f-75965abb890b None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:33:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:18 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914798.573676, a5f0eca7-d060-4226-b36e-a3cd15b15703 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:33:18 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] VM Resumed (Lifecycle Event)
Aug 01 18:33:18 user nova-compute[72150]: DEBUG nova.compute.manager [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:33:18 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Instance running successfully.
Aug 01 18:33:18 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] finish_revert_migration finished successfully. {{(pid=72150) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 01 18:33:18 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:33:18 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:33:18 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 01 18:33:18 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914798.5750604, a5f0eca7-d060-4226-b36e-a3cd15b15703 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:33:18 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] VM Started (Lifecycle Event)
Aug 01 18:33:18 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:33:18 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:33:18 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 01 18:33:18 user nova-compute[72150]: DEBUG nova.compute.manager [req-baffd14c-9a7b-4284-93db-a14c7cbc3a00 req-2ffcdc92-fe3f-4819-b302-45af4560d7b7 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received event network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-baffd14c-9a7b-4284-93db-a14c7cbc3a00 req-2ffcdc92-fe3f-4819-b302-45af4560d7b7 service nova] Acquiring lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-baffd14c-9a7b-4284-93db-a14c7cbc3a00 req-2ffcdc92-fe3f-4819-b302-45af4560d7b7 service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-baffd14c-9a7b-4284-93db-a14c7cbc3a00 req-2ffcdc92-fe3f-4819-b302-45af4560d7b7 service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:18 user nova-compute[72150]: DEBUG nova.compute.manager [req-baffd14c-9a7b-4284-93db-a14c7cbc3a00 req-2ffcdc92-fe3f-4819-b302-45af4560d7b7 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] No waiting events found dispatching network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:33:18 user nova-compute[72150]: WARNING nova.compute.manager [req-baffd14c-9a7b-4284-93db-a14c7cbc3a00 req-2ffcdc92-fe3f-4819-b302-45af4560d7b7 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received unexpected event network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc for instance with vm_state resized and task_state resize_reverting.
Aug 01 18:33:18 user nova-compute[72150]: INFO nova.compute.manager [None req-dda3600e-39db-4dd1-9867-bd933013ac6a tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Updating instance to original state: 'active'
Aug 01 18:33:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:19 user nova-compute[72150]: DEBUG nova.compute.manager [req-2f9f6db1-9634-4749-a620-b3e1c7beb0ce req-234f6ad1-b11b-45ef-88b3-a3902993afaf service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Received event network-changed-2eee643a-cddb-40a2-bd09-a601fb3e773c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:19 user nova-compute[72150]: DEBUG nova.compute.manager [req-2f9f6db1-9634-4749-a620-b3e1c7beb0ce req-234f6ad1-b11b-45ef-88b3-a3902993afaf service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Refreshing instance network info cache due to event network-changed-2eee643a-cddb-40a2-bd09-a601fb3e773c. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:33:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2f9f6db1-9634-4749-a620-b3e1c7beb0ce req-234f6ad1-b11b-45ef-88b3-a3902993afaf service nova] Acquiring lock "refresh_cache-12a8b6e5-617d-466d-bb62-64b6b188f8f2" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:33:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2f9f6db1-9634-4749-a620-b3e1c7beb0ce req-234f6ad1-b11b-45ef-88b3-a3902993afaf service nova] Acquired lock "refresh_cache-12a8b6e5-617d-466d-bb62-64b6b188f8f2" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:33:19 user nova-compute[72150]: DEBUG nova.network.neutron [req-2f9f6db1-9634-4749-a620-b3e1c7beb0ce req-234f6ad1-b11b-45ef-88b3-a3902993afaf service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Refreshing network info cache for port 2eee643a-cddb-40a2-bd09-a601fb3e773c {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:33:19 user nova-compute[72150]: INFO nova.compute.manager [None req-3166bbe7-39f2-4089-bd5f-40c755f957be tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Unrescuing
Aug 01 18:33:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3166bbe7-39f2-4089-bd5f-40c755f957be tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquiring lock "refresh_cache-ceee3912-ca68-4b15-8fe6-985d905e8128" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:33:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3166bbe7-39f2-4089-bd5f-40c755f957be tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquired lock "refresh_cache-ceee3912-ca68-4b15-8fe6-985d905e8128" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:33:19 user nova-compute[72150]: DEBUG nova.network.neutron [None req-3166bbe7-39f2-4089-bd5f-40c755f957be tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:33:20 user nova-compute[72150]: DEBUG nova.network.neutron [req-2f9f6db1-9634-4749-a620-b3e1c7beb0ce req-234f6ad1-b11b-45ef-88b3-a3902993afaf service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Updated VIF entry in instance network info cache for port 2eee643a-cddb-40a2-bd09-a601fb3e773c. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:33:20 user nova-compute[72150]: DEBUG nova.network.neutron [req-2f9f6db1-9634-4749-a620-b3e1c7beb0ce req-234f6ad1-b11b-45ef-88b3-a3902993afaf service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Updating instance_info_cache with network_info: [{"id": "2eee643a-cddb-40a2-bd09-a601fb3e773c", "address": "fa:16:3e:06:3b:ee", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee643a-cd", "ovs_interfaceid": "2eee643a-cddb-40a2-bd09-a601fb3e773c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:33:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2f9f6db1-9634-4749-a620-b3e1c7beb0ce req-234f6ad1-b11b-45ef-88b3-a3902993afaf service nova] Releasing lock "refresh_cache-12a8b6e5-617d-466d-bb62-64b6b188f8f2" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:33:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "12a8b6e5-617d-466d-bb62-64b6b188f8f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "12a8b6e5-617d-466d-bb62-64b6b188f8f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "12a8b6e5-617d-466d-bb62-64b6b188f8f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "12a8b6e5-617d-466d-bb62-64b6b188f8f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "12a8b6e5-617d-466d-bb62-64b6b188f8f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:20 user nova-compute[72150]: INFO nova.compute.manager [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Terminating instance
Aug 01 18:33:20 user nova-compute[72150]: DEBUG nova.compute.manager [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:33:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:20 user nova-compute[72150]: DEBUG nova.network.neutron [None req-3166bbe7-39f2-4089-bd5f-40c755f957be tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Updating instance_info_cache with network_info: [{"id": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "address": "fa:16:3e:e0:04:f1", "network": {"id": "838d4cba-b00d-46ff-ad55-9d7dd511581a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-732384801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8759cb04dd744d7895a63bc5bd1d1c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee07a0f4-22", "ovs_interfaceid": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:33:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3166bbe7-39f2-4089-bd5f-40c755f957be tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Releasing lock "refresh_cache-ceee3912-ca68-4b15-8fe6-985d905e8128" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:33:20 user nova-compute[72150]: DEBUG nova.objects.instance [None req-3166bbe7-39f2-4089-bd5f-40c755f957be tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lazy-loading 'flavor' on Instance uuid ceee3912-ca68-4b15-8fe6-985d905e8128 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:33:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG nova.compute.manager [req-17398e3b-20fc-4155-a0bb-fb87b47dfa69 req-5ecd9103-3efe-4d01-9c39-81b78ad57df6 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received event network-vif-unplugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-17398e3b-20fc-4155-a0bb-fb87b47dfa69 req-5ecd9103-3efe-4d01-9c39-81b78ad57df6 service nova] Acquiring lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-17398e3b-20fc-4155-a0bb-fb87b47dfa69 req-5ecd9103-3efe-4d01-9c39-81b78ad57df6 service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-17398e3b-20fc-4155-a0bb-fb87b47dfa69 req-5ecd9103-3efe-4d01-9c39-81b78ad57df6 service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG nova.compute.manager [req-17398e3b-20fc-4155-a0bb-fb87b47dfa69 req-5ecd9103-3efe-4d01-9c39-81b78ad57df6 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] No waiting events found dispatching network-vif-unplugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:33:21 user nova-compute[72150]: WARNING nova.compute.manager [req-17398e3b-20fc-4155-a0bb-fb87b47dfa69 req-5ecd9103-3efe-4d01-9c39-81b78ad57df6 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received unexpected event network-vif-unplugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:33:21 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Instance destroyed successfully.
Aug 01 18:33:21 user nova-compute[72150]: DEBUG nova.objects.instance [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lazy-loading 'resources' on Instance uuid 12a8b6e5-617d-466d-bb62-64b6b188f8f2 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:31:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1468554315',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1468554315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1468554315',id=26,image_ref='d708b95f-4833-4ec7-a783-08e6cabb0ad2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMGg7Kxa7OMRUjZQxVpCqLSg9YDkUGHU4bHybYt4DML3EYP4lULgEFq9DndpYpf2p++D3dGVS6y4rE2tx0KYfBgvdZYbDEm8A05fXO3AQ/QOsxPUtSxJtfrFsrEFBjIBA==',key_name='tempest-keypair-66113531',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:31:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7ca44f23b114893afcfe57c52f693b1',ramdisk_id='',reservation_id='r-v1pi2flv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-295340968',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-295340968-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-295340968',owner_user_name='tempest-TestVolumeBootPattern-295340968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:31:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92c7ef0ed6814f8880de76adb913a487',uuid=12a8b6e5-617d-466d-bb62-64b6b188f8f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eee643a-cddb-40a2-bd09-a601fb3e773c", "address": "fa:16:3e:06:3b:ee", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee643a-cd", "ovs_interfaceid": "2eee643a-cddb-40a2-bd09-a601fb3e773c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converting VIF {"id": "2eee643a-cddb-40a2-bd09-a601fb3e773c", "address": "fa:16:3e:06:3b:ee", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee643a-cd", "ovs_interfaceid": "2eee643a-cddb-40a2-bd09-a601fb3e773c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:3b:ee,bridge_name='br-int',has_traffic_filtering=True,id=2eee643a-cddb-40a2-bd09-a601fb3e773c,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eee643a-cd') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG os_vif [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:3b:ee,bridge_name='br-int',has_traffic_filtering=True,id=2eee643a-cddb-40a2-bd09-a601fb3e773c,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eee643a-cd') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2eee643a-cd, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:21 user nova-compute[72150]: INFO os_vif [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:3b:ee,bridge_name='br-int',has_traffic_filtering=True,id=2eee643a-cddb-40a2-bd09-a601fb3e773c,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eee643a-cd')
Aug 01 18:33:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WCDNuxlT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:33:21 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:33:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1575aecf-7df3-4e89-9b80-78136230414c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8fb8cc-67f6-4379-9cfe-84a82f1f988a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:33:21 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:33:21 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:33:21 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:33:21 user nova-compute[72150]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)
Aug 01 18:33:21 user nova-compute[72150]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)
Aug 01 18:33:21 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:33:21 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:33:21 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:33:21 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:33:21 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:33:21 user nova-compute[72150]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 (non-flash)
Aug 01 18:33:21 user nova-compute[72150]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)
Aug 01 18:33:21 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:33:21 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f471c0895a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0'): ({'sdg'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Removing single pathed devices sdg {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f46607-e818-4d31-8fa1-631f45dd0d3b]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.038s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9a2954-76c0-4abc-a8e5-907f4bdd02a4]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Flushing IO for device /dev/sdg {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df6673d-ce1f-49b8-87bb-96f0a6063fa1]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f272e54-ab0d-49d1-a3ff-67cc9c471657]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] SCSI volumes sdg have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb2b9629c-9978286bd1435c7b', '/dev/disk/by-id/scsi-23939373832383662', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b2b9629c') {{(pid=82940) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f07780-5d6c-43af-bd48-8ae3bfc34ac0]: (4, None) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[872f653b-8c48-45bd-a692-083fc1ad9ad2]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:21 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Instance destroyed successfully.
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.118s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67d7b48-791f-4faa-9c03-15d42adf4bae]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0, portal: 172.16.0.220,3260]
Aug 01 18:33:21 user nova-compute[72150]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0, portal: 172.16.0.220,3260] successful.
Aug 01 18:33:21 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a037645-735b-4c94-87ea-4648fc8201e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02913f0-b5d4-4387-805a-0a1716586588]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.440s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] <== disconnect_volume: return (441ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:33:21 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Deleting instance files /opt/stack/data/nova/instances/12a8b6e5-617d-466d-bb62-64b6b188f8f2_del
Aug 01 18:33:21 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Deletion of /opt/stack/data/nova/instances/12a8b6e5-617d-466d-bb62-64b6b188f8f2_del complete
Aug 01 18:33:21 user nova-compute[72150]: DEBUG nova.compute.manager [req-b6ac0ed1-17b9-4300-8fb2-443b8b88064d req-51ed113c-e4f4-4f37-9204-ca07f167e925 service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Received event network-vif-unplugged-2eee643a-cddb-40a2-bd09-a601fb3e773c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b6ac0ed1-17b9-4300-8fb2-443b8b88064d req-51ed113c-e4f4-4f37-9204-ca07f167e925 service nova] Acquiring lock "12a8b6e5-617d-466d-bb62-64b6b188f8f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b6ac0ed1-17b9-4300-8fb2-443b8b88064d req-51ed113c-e4f4-4f37-9204-ca07f167e925 service nova] Lock "12a8b6e5-617d-466d-bb62-64b6b188f8f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b6ac0ed1-17b9-4300-8fb2-443b8b88064d req-51ed113c-e4f4-4f37-9204-ca07f167e925 service nova] Lock "12a8b6e5-617d-466d-bb62-64b6b188f8f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG nova.compute.manager [req-b6ac0ed1-17b9-4300-8fb2-443b8b88064d req-51ed113c-e4f4-4f37-9204-ca07f167e925 service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] No waiting events found dispatching network-vif-unplugged-2eee643a-cddb-40a2-bd09-a601fb3e773c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG nova.compute.manager [req-b6ac0ed1-17b9-4300-8fb2-443b8b88064d req-51ed113c-e4f4-4f37-9204-ca07f167e925 service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Received event network-vif-unplugged-2eee643a-cddb-40a2-bd09-a601fb3e773c for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG nova.compute.manager [req-b6ac0ed1-17b9-4300-8fb2-443b8b88064d req-51ed113c-e4f4-4f37-9204-ca07f167e925 service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Received event network-vif-plugged-2eee643a-cddb-40a2-bd09-a601fb3e773c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b6ac0ed1-17b9-4300-8fb2-443b8b88064d req-51ed113c-e4f4-4f37-9204-ca07f167e925 service nova] Acquiring lock "12a8b6e5-617d-466d-bb62-64b6b188f8f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b6ac0ed1-17b9-4300-8fb2-443b8b88064d req-51ed113c-e4f4-4f37-9204-ca07f167e925 service nova] Lock "12a8b6e5-617d-466d-bb62-64b6b188f8f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b6ac0ed1-17b9-4300-8fb2-443b8b88064d req-51ed113c-e4f4-4f37-9204-ca07f167e925 service nova] Lock "12a8b6e5-617d-466d-bb62-64b6b188f8f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG nova.compute.manager [req-b6ac0ed1-17b9-4300-8fb2-443b8b88064d req-51ed113c-e4f4-4f37-9204-ca07f167e925 service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] No waiting events found dispatching network-vif-plugged-2eee643a-cddb-40a2-bd09-a601fb3e773c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:33:21 user nova-compute[72150]: WARNING nova.compute.manager [req-b6ac0ed1-17b9-4300-8fb2-443b8b88064d req-51ed113c-e4f4-4f37-9204-ca07f167e925 service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Received unexpected event network-vif-plugged-2eee643a-cddb-40a2-bd09-a601fb3e773c for instance with vm_state active and task_state deleting.
Aug 01 18:33:21 user nova-compute[72150]: DEBUG nova.compute.manager [req-ff216dac-bda3-4331-9eac-b270575b0aa6 req-d4cb0fe8-30c7-409c-9e7b-4b1d2b6c6a3c service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received event network-changed-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG nova.compute.manager [req-ff216dac-bda3-4331-9eac-b270575b0aa6 req-d4cb0fe8-30c7-409c-9e7b-4b1d2b6c6a3c service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Refreshing instance network info cache due to event network-changed-ee07a0f4-222d-4863-92b2-f70a7afd75f1. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ff216dac-bda3-4331-9eac-b270575b0aa6 req-d4cb0fe8-30c7-409c-9e7b-4b1d2b6c6a3c service nova] Acquiring lock "refresh_cache-ceee3912-ca68-4b15-8fe6-985d905e8128" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ff216dac-bda3-4331-9eac-b270575b0aa6 req-d4cb0fe8-30c7-409c-9e7b-4b1d2b6c6a3c service nova] Acquired lock "refresh_cache-ceee3912-ca68-4b15-8fe6-985d905e8128" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG nova.network.neutron [req-ff216dac-bda3-4331-9eac-b270575b0aa6 req-d4cb0fe8-30c7-409c-9e7b-4b1d2b6c6a3c service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Refreshing network info cache for port ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:33:21 user nova-compute[72150]: INFO nova.compute.manager [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Took 1.41 seconds to destroy the instance on the hypervisor.
Aug 01 18:33:21 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:33:21 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:33:22 user nova-compute[72150]: DEBUG nova.network.neutron [req-ff216dac-bda3-4331-9eac-b270575b0aa6 req-d4cb0fe8-30c7-409c-9e7b-4b1d2b6c6a3c service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Updated VIF entry in instance network info cache for port ee07a0f4-222d-4863-92b2-f70a7afd75f1. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:33:22 user nova-compute[72150]: DEBUG nova.network.neutron [req-ff216dac-bda3-4331-9eac-b270575b0aa6 req-d4cb0fe8-30c7-409c-9e7b-4b1d2b6c6a3c service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Updating instance_info_cache with network_info: [{"id": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "address": "fa:16:3e:e0:04:f1", "network": {"id": "838d4cba-b00d-46ff-ad55-9d7dd511581a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-732384801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8759cb04dd744d7895a63bc5bd1d1c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee07a0f4-22", "ovs_interfaceid": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:33:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ff216dac-bda3-4331-9eac-b270575b0aa6 req-d4cb0fe8-30c7-409c-9e7b-4b1d2b6c6a3c service nova] Releasing lock "refresh_cache-ceee3912-ca68-4b15-8fe6-985d905e8128" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:33:22 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:33:22 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Took 1.17 seconds to deallocate network for instance.
Aug 01 18:33:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:23 user nova-compute[72150]: DEBUG nova.compute.manager [req-cce12033-09a0-45fd-ad6d-1ddbd0619e57 req-744fbe06-9390-48ad-9324-d928d3e04c48 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received event network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-cce12033-09a0-45fd-ad6d-1ddbd0619e57 req-744fbe06-9390-48ad-9324-d928d3e04c48 service nova] Acquiring lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-cce12033-09a0-45fd-ad6d-1ddbd0619e57 req-744fbe06-9390-48ad-9324-d928d3e04c48 service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-cce12033-09a0-45fd-ad6d-1ddbd0619e57 req-744fbe06-9390-48ad-9324-d928d3e04c48 service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:23 user nova-compute[72150]: DEBUG nova.compute.manager [req-cce12033-09a0-45fd-ad6d-1ddbd0619e57 req-744fbe06-9390-48ad-9324-d928d3e04c48 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] No waiting events found dispatching network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:33:23 user nova-compute[72150]: WARNING nova.compute.manager [req-cce12033-09a0-45fd-ad6d-1ddbd0619e57 req-744fbe06-9390-48ad-9324-d928d3e04c48 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received unexpected event network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:33:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:23 user nova-compute[72150]: DEBUG nova.compute.manager [req-f084aa2b-fbb2-493b-b5cc-3734182f6da6 req-72cbeb8e-cb48-4dbf-96c6-413a6849a24a service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received event network-changed-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:23 user nova-compute[72150]: DEBUG nova.compute.manager [req-f084aa2b-fbb2-493b-b5cc-3734182f6da6 req-72cbeb8e-cb48-4dbf-96c6-413a6849a24a service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Refreshing instance network info cache due to event network-changed-ee07a0f4-222d-4863-92b2-f70a7afd75f1. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:33:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f084aa2b-fbb2-493b-b5cc-3734182f6da6 req-72cbeb8e-cb48-4dbf-96c6-413a6849a24a service nova] Acquiring lock "refresh_cache-ceee3912-ca68-4b15-8fe6-985d905e8128" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:33:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f084aa2b-fbb2-493b-b5cc-3734182f6da6 req-72cbeb8e-cb48-4dbf-96c6-413a6849a24a service nova] Acquired lock "refresh_cache-ceee3912-ca68-4b15-8fe6-985d905e8128" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:33:23 user nova-compute[72150]: DEBUG nova.network.neutron [req-f084aa2b-fbb2-493b-b5cc-3734182f6da6 req-72cbeb8e-cb48-4dbf-96c6-413a6849a24a service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Refreshing network info cache for port ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:33:23 user nova-compute[72150]: INFO nova.compute.manager [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Took 0.92 seconds to detach 1 volumes for instance.
Aug 01 18:33:23 user nova-compute[72150]: DEBUG nova.compute.manager [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Deleting volume: 0a037645-735b-4c94-87ea-4648fc8201e0 {{(pid=72150) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 18:33:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:24 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Refreshing inventories for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 18:33:24 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Updating ProviderTree inventory for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 18:33:24 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Updating inventory in ProviderTree for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 18:33:24 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Refreshing aggregate associations for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479, aggregates: None {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 18:33:24 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Refreshing trait associations for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 18:33:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:24 user nova-compute[72150]: DEBUG nova.network.neutron [req-f084aa2b-fbb2-493b-b5cc-3734182f6da6 req-72cbeb8e-cb48-4dbf-96c6-413a6849a24a service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Updated VIF entry in instance network info cache for port ee07a0f4-222d-4863-92b2-f70a7afd75f1. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:33:24 user nova-compute[72150]: DEBUG nova.network.neutron [req-f084aa2b-fbb2-493b-b5cc-3734182f6da6 req-72cbeb8e-cb48-4dbf-96c6-413a6849a24a service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Updating instance_info_cache with network_info: [{"id": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "address": "fa:16:3e:e0:04:f1", "network": {"id": "838d4cba-b00d-46ff-ad55-9d7dd511581a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-732384801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8759cb04dd744d7895a63bc5bd1d1c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee07a0f4-22", "ovs_interfaceid": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:33:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f084aa2b-fbb2-493b-b5cc-3734182f6da6 req-72cbeb8e-cb48-4dbf-96c6-413a6849a24a service nova] Releasing lock "refresh_cache-ceee3912-ca68-4b15-8fe6-985d905e8128" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:33:24 user nova-compute[72150]: DEBUG nova.compute.manager [req-f084aa2b-fbb2-493b-b5cc-3734182f6da6 req-72cbeb8e-cb48-4dbf-96c6-413a6849a24a service nova] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Received event network-vif-deleted-2eee643a-cddb-40a2-bd09-a601fb3e773c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:24 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:33:24 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:33:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.736s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:24 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Deleted allocations for instance 12a8b6e5-617d-466d-bb62-64b6b188f8f2
Aug 01 18:33:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3bb264fd-89c9-4a51-9d6f-1282f98f0159 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "12a8b6e5-617d-466d-bb62-64b6b188f8f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.538s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:25 user nova-compute[72150]: DEBUG nova.compute.manager [req-2800f900-6623-417f-9c1a-5d85f52f0422 req-69cbd95c-b3ea-446f-a5b6-3149dfe1ce3b service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received event network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2800f900-6623-417f-9c1a-5d85f52f0422 req-69cbd95c-b3ea-446f-a5b6-3149dfe1ce3b service nova] Acquiring lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2800f900-6623-417f-9c1a-5d85f52f0422 req-69cbd95c-b3ea-446f-a5b6-3149dfe1ce3b service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2800f900-6623-417f-9c1a-5d85f52f0422 req-69cbd95c-b3ea-446f-a5b6-3149dfe1ce3b service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:25 user nova-compute[72150]: DEBUG nova.compute.manager [req-2800f900-6623-417f-9c1a-5d85f52f0422 req-69cbd95c-b3ea-446f-a5b6-3149dfe1ce3b service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] No waiting events found dispatching network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:33:25 user nova-compute[72150]: WARNING nova.compute.manager [req-2800f900-6623-417f-9c1a-5d85f52f0422 req-69cbd95c-b3ea-446f-a5b6-3149dfe1ce3b service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received unexpected event network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:33:25 user nova-compute[72150]: DEBUG nova.compute.manager [req-2800f900-6623-417f-9c1a-5d85f52f0422 req-69cbd95c-b3ea-446f-a5b6-3149dfe1ce3b service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received event network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2800f900-6623-417f-9c1a-5d85f52f0422 req-69cbd95c-b3ea-446f-a5b6-3149dfe1ce3b service nova] Acquiring lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2800f900-6623-417f-9c1a-5d85f52f0422 req-69cbd95c-b3ea-446f-a5b6-3149dfe1ce3b service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2800f900-6623-417f-9c1a-5d85f52f0422 req-69cbd95c-b3ea-446f-a5b6-3149dfe1ce3b service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:25 user nova-compute[72150]: DEBUG nova.compute.manager [req-2800f900-6623-417f-9c1a-5d85f52f0422 req-69cbd95c-b3ea-446f-a5b6-3149dfe1ce3b service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] No waiting events found dispatching network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:33:25 user nova-compute[72150]: WARNING nova.compute.manager [req-2800f900-6623-417f-9c1a-5d85f52f0422 req-69cbd95c-b3ea-446f-a5b6-3149dfe1ce3b service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received unexpected event network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:33:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Removed pending event for ceee3912-ca68-4b15-8fe6-985d905e8128 due to event {{(pid=72150) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 18:33:25 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914805.2147622, ceee3912-ca68-4b15-8fe6-985d905e8128 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:33:25 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] VM Resumed (Lifecycle Event)
Aug 01 18:33:25 user nova-compute[72150]: DEBUG nova.compute.manager [None req-3166bbe7-39f2-4089-bd5f-40c755f957be tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:33:25 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:33:25 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:33:25 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 18:33:25 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914805.2169313, ceee3912-ca68-4b15-8fe6-985d905e8128 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:33:25 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] VM Started (Lifecycle Event)
Aug 01 18:33:25 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:33:25 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:33:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "65b04144-3b1f-4975-8524-2c9f9660672a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "65b04144-3b1f-4975-8524-2c9f9660672a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:33:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:29 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:33:29 user nova-compute[72150]: INFO nova.compute.claims [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Claim successful on node user
Aug 01 18:33:30 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:33:30 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:33:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:30 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:33:30 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:33:30 user nova-compute[72150]: DEBUG nova.network.neutron [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:33:30 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:33:30 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:33:30 user nova-compute[72150]: DEBUG nova.policy [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '375cd4acff1646f4a5418fb012118600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b70fdffe9e414aa766f7c8f7a20d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:33:30 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:33:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:33:30 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Creating image(s)
Aug 01 18:33:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "/opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "/opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "/opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.155s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.162s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk 1073741824" returned: 0 in 0.055s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.153s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:31 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Checking if we can resize image /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:33:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:31 user nova-compute[72150]: DEBUG nova.network.neutron [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Successfully created port: 7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:33:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:31 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Cannot resize image /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:33:31 user nova-compute[72150]: DEBUG nova.objects.instance [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'migration_context' on Instance uuid 65b04144-3b1f-4975-8524-2c9f9660672a {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:33:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:33:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Ensure instance console log exists: /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:33:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.network.neutron [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Successfully updated port: 7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "refresh_cache-65b04144-3b1f-4975-8524-2c9f9660672a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquired lock "refresh_cache-65b04144-3b1f-4975-8524-2c9f9660672a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.network.neutron [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.compute.manager [req-c6786f48-5db0-4ffc-92ac-ba8fb3bf603e req-c2871539-dd37-49c5-be8f-00c117b647e2 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received event network-changed-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.compute.manager [req-c6786f48-5db0-4ffc-92ac-ba8fb3bf603e req-c2871539-dd37-49c5-be8f-00c117b647e2 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Refreshing instance network info cache due to event network-changed-7f1bb810-d0cc-4f82-98c4-48abef3008b2. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c6786f48-5db0-4ffc-92ac-ba8fb3bf603e req-c2871539-dd37-49c5-be8f-00c117b647e2 service nova] Acquiring lock "refresh_cache-65b04144-3b1f-4975-8524-2c9f9660672a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.network.neutron [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.network.neutron [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Updating instance_info_cache with network_info: [{"id": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "address": "fa:16:3e:fd:8c:16", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1bb810-d0", "ovs_interfaceid": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Releasing lock "refresh_cache-65b04144-3b1f-4975-8524-2c9f9660672a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Instance network_info: |[{"id": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "address": "fa:16:3e:fd:8c:16", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1bb810-d0", "ovs_interfaceid": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c6786f48-5db0-4ffc-92ac-ba8fb3bf603e req-c2871539-dd37-49c5-be8f-00c117b647e2 service nova] Acquired lock "refresh_cache-65b04144-3b1f-4975-8524-2c9f9660672a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.network.neutron [req-c6786f48-5db0-4ffc-92ac-ba8fb3bf603e req-c2871539-dd37-49c5-be8f-00c117b647e2 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Refreshing network info cache for port 7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Start _get_guest_xml network_info=[{"id": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "address": "fa:16:3e:fd:8c:16", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1bb810-d0", "ovs_interfaceid": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:33:32 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:33:32 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:33:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1438581595',display_name='tempest-ServerRescueNegativeTestJSON-server-1438581595',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1438581595',id=28,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3bQqS2j4kZRk333FJ16crVHeGKsnlSqh38puJr9piXdSV+XYf+feSl84MueVV3t5BtCP0cq69HG1ekvpdvbT4swu2ub0xC3rQ4sqVxWLfImu3Ng8/Yes0u2g+aQjMwbw==',key_name='tempest-keypair-1393509934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0b70fdffe9e414aa766f7c8f7a20d50',ramdisk_id='',reservation_id='r-f8e04fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2003578958',owner_user_name='tempest-ServerRescueNegativeTestJSON-2003578958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:33:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375cd4acff1646f4a5418fb012118600',uuid=65b04144-3b1f-4975-8524-2c9f9660672a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "address": "fa:16:3e:fd:8c:16", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1bb810-d0", "ovs_interfaceid": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converting VIF {"id": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "address": "fa:16:3e:fd:8c:16", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1bb810-d0", "ovs_interfaceid": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:8c:16,bridge_name='br-int',has_traffic_filtering=True,id=7f1bb810-d0cc-4f82-98c4-48abef3008b2,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1bb810-d0') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.objects.instance [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'pci_devices' on Instance uuid 65b04144-3b1f-4975-8524-2c9f9660672a {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:33:32 user nova-compute[72150]:   <uuid>65b04144-3b1f-4975-8524-2c9f9660672a</uuid>
Aug 01 18:33:32 user nova-compute[72150]:   <name>instance-0000001c</name>
Aug 01 18:33:32 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:33:32 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:33:32 user nova-compute[72150]:   <metadata>
Aug 01 18:33:32 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:33:32 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:33:32 user nova-compute[72150]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1438581595</nova:name>
Aug 01 18:33:32 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:33:32</nova:creationTime>
Aug 01 18:33:32 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:33:32 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:33:32 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:33:32 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:33:32 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:33:32 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:33:32 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:33:32 user nova-compute[72150]:       <nova:owner>
Aug 01 18:33:32 user nova-compute[72150]:         <nova:user uuid="375cd4acff1646f4a5418fb012118600">tempest-ServerRescueNegativeTestJSON-2003578958-project-member</nova:user>
Aug 01 18:33:32 user nova-compute[72150]:         <nova:project uuid="e0b70fdffe9e414aa766f7c8f7a20d50">tempest-ServerRescueNegativeTestJSON-2003578958</nova:project>
Aug 01 18:33:32 user nova-compute[72150]:       </nova:owner>
Aug 01 18:33:32 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:33:32 user nova-compute[72150]:       <nova:ports>
Aug 01 18:33:32 user nova-compute[72150]:         <nova:port uuid="7f1bb810-d0cc-4f82-98c4-48abef3008b2">
Aug 01 18:33:32 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 18:33:32 user nova-compute[72150]:         </nova:port>
Aug 01 18:33:32 user nova-compute[72150]:       </nova:ports>
Aug 01 18:33:32 user nova-compute[72150]:     </nova:instance>
Aug 01 18:33:32 user nova-compute[72150]:   </metadata>
Aug 01 18:33:32 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:33:32 user nova-compute[72150]:     <system>
Aug 01 18:33:32 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:33:32 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:33:32 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:33:32 user nova-compute[72150]:       <entry name="serial">65b04144-3b1f-4975-8524-2c9f9660672a</entry>
Aug 01 18:33:32 user nova-compute[72150]:       <entry name="uuid">65b04144-3b1f-4975-8524-2c9f9660672a</entry>
Aug 01 18:33:32 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:33:32 user nova-compute[72150]:     </system>
Aug 01 18:33:32 user nova-compute[72150]:   </sysinfo>
Aug 01 18:33:32 user nova-compute[72150]:   <os>
Aug 01 18:33:32 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:33:32 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:33:32 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:33:32 user nova-compute[72150]:   </os>
Aug 01 18:33:32 user nova-compute[72150]:   <features>
Aug 01 18:33:32 user nova-compute[72150]:     <acpi/>
Aug 01 18:33:32 user nova-compute[72150]:     <apic/>
Aug 01 18:33:32 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:33:32 user nova-compute[72150]:   </features>
Aug 01 18:33:32 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:33:32 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:33:32 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:33:32 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:33:32 user nova-compute[72150]:   </clock>
Aug 01 18:33:32 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:33:32 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:33:32 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:33:32 user nova-compute[72150]:   </cpu>
Aug 01 18:33:32 user nova-compute[72150]:   <devices>
Aug 01 18:33:32 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:33:32 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:33:32 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk"/>
Aug 01 18:33:32 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:33:32 user nova-compute[72150]:     </disk>
Aug 01 18:33:32 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:33:32 user nova-compute[72150]:       <mac address="fa:16:3e:fd:8c:16"/>
Aug 01 18:33:32 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:33:32 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:33:32 user nova-compute[72150]:       <target dev="tap7f1bb810-d0"/>
Aug 01 18:33:32 user nova-compute[72150]:     </interface>
Aug 01 18:33:32 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:33:32 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/console.log" append="off"/>
Aug 01 18:33:32 user nova-compute[72150]:     </serial>
Aug 01 18:33:32 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:33:32 user nova-compute[72150]:     <video>
Aug 01 18:33:32 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:33:32 user nova-compute[72150]:     </video>
Aug 01 18:33:32 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:33:32 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:33:32 user nova-compute[72150]:     </rng>
Aug 01 18:33:32 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:33:32 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:33:32 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:33:32 user nova-compute[72150]:     </memballoon>
Aug 01 18:33:32 user nova-compute[72150]:   </devices>
Aug 01 18:33:32 user nova-compute[72150]: </domain>
Aug 01 18:33:32 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:33:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1438581595',display_name='tempest-ServerRescueNegativeTestJSON-server-1438581595',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1438581595',id=28,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3bQqS2j4kZRk333FJ16crVHeGKsnlSqh38puJr9piXdSV+XYf+feSl84MueVV3t5BtCP0cq69HG1ekvpdvbT4swu2ub0xC3rQ4sqVxWLfImu3Ng8/Yes0u2g+aQjMwbw==',key_name='tempest-keypair-1393509934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0b70fdffe9e414aa766f7c8f7a20d50',ramdisk_id='',reservation_id='r-f8e04fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2003578958',owner_user_name='tempest-ServerRescueNegativeTestJSON-2003578958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:33:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375cd4acff1646f4a5418fb012118600',uuid=65b04144-3b1f-4975-8524-2c9f9660672a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "address": "fa:16:3e:fd:8c:16", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1bb810-d0", "ovs_interfaceid": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converting VIF {"id": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "address": "fa:16:3e:fd:8c:16", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1bb810-d0", "ovs_interfaceid": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:8c:16,bridge_name='br-int',has_traffic_filtering=True,id=7f1bb810-d0cc-4f82-98c4-48abef3008b2,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1bb810-d0') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG os_vif [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:8c:16,bridge_name='br-int',has_traffic_filtering=True,id=7f1bb810-d0cc-4f82-98c4-48abef3008b2,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1bb810-d0') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f1bb810-d0, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f1bb810-d0, col_values=(('external_ids', {'iface-id': '7f1bb810-d0cc-4f82-98c4-48abef3008b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:8c:16', 'vm-uuid': '65b04144-3b1f-4975-8524-2c9f9660672a'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:32 user nova-compute[72150]: INFO os_vif [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:8c:16,bridge_name='br-int',has_traffic_filtering=True,id=7f1bb810-d0cc-4f82-98c4-48abef3008b2,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1bb810-d0')
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:33:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] No VIF found with MAC fa:16:3e:fd:8c:16, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:33:33 user nova-compute[72150]: DEBUG nova.network.neutron [req-c6786f48-5db0-4ffc-92ac-ba8fb3bf603e req-c2871539-dd37-49c5-be8f-00c117b647e2 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Updated VIF entry in instance network info cache for port 7f1bb810-d0cc-4f82-98c4-48abef3008b2. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:33:33 user nova-compute[72150]: DEBUG nova.network.neutron [req-c6786f48-5db0-4ffc-92ac-ba8fb3bf603e req-c2871539-dd37-49c5-be8f-00c117b647e2 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Updating instance_info_cache with network_info: [{"id": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "address": "fa:16:3e:fd:8c:16", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1bb810-d0", "ovs_interfaceid": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:33:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c6786f48-5db0-4ffc-92ac-ba8fb3bf603e req-c2871539-dd37-49c5-be8f-00c117b647e2 service nova] Releasing lock "refresh_cache-65b04144-3b1f-4975-8524-2c9f9660672a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:33:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:34 user nova-compute[72150]: DEBUG nova.compute.manager [req-4735d9ba-a13a-450d-9a31-25e12bdfbf54 req-b0a4c05c-eede-4b6d-a307-62ba57f9c73f service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received event network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4735d9ba-a13a-450d-9a31-25e12bdfbf54 req-b0a4c05c-eede-4b6d-a307-62ba57f9c73f service nova] Acquiring lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4735d9ba-a13a-450d-9a31-25e12bdfbf54 req-b0a4c05c-eede-4b6d-a307-62ba57f9c73f service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4735d9ba-a13a-450d-9a31-25e12bdfbf54 req-b0a4c05c-eede-4b6d-a307-62ba57f9c73f service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:34 user nova-compute[72150]: DEBUG nova.compute.manager [req-4735d9ba-a13a-450d-9a31-25e12bdfbf54 req-b0a4c05c-eede-4b6d-a307-62ba57f9c73f service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] No waiting events found dispatching network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:33:34 user nova-compute[72150]: WARNING nova.compute.manager [req-4735d9ba-a13a-450d-9a31-25e12bdfbf54 req-b0a4c05c-eede-4b6d-a307-62ba57f9c73f service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received unexpected event network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 for instance with vm_state building and task_state spawning.
Aug 01 18:33:35 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:33:36 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914801.0349514, 12a8b6e5-617d-466d-bb62-64b6b188f8f2 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:33:36 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] VM Stopped (Lifecycle Event)
Aug 01 18:33:36 user nova-compute[72150]: DEBUG nova.compute.manager [None req-199e0c5d-2721-4fd9-88f1-d3be453410c4 None None] [instance: 12a8b6e5-617d-466d-bb62-64b6b188f8f2] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:33:36 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914816.3809896, 65b04144-3b1f-4975-8524-2c9f9660672a => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:33:36 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] VM Resumed (Lifecycle Event)
Aug 01 18:33:36 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:33:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:33:36 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Instance spawned successfully.
Aug 01 18:33:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:33:36 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:33:36 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:33:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:33:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:33:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:33:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:33:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:33:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:33:36 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:33:36 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914816.3821676, 65b04144-3b1f-4975-8524-2c9f9660672a => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:33:36 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] VM Started (Lifecycle Event)
Aug 01 18:33:36 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:33:36 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:33:36 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:33:36 user nova-compute[72150]: INFO nova.compute.manager [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Took 5.78 seconds to spawn the instance on the hypervisor.
Aug 01 18:33:36 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:33:36 user nova-compute[72150]: INFO nova.compute.manager [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Took 6.75 seconds to build instance.
Aug 01 18:33:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7d42e47c-55af-4814-8ce3-1f1806bfc32b tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "65b04144-3b1f-4975-8524-2c9f9660672a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.867s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:36 user nova-compute[72150]: DEBUG nova.compute.manager [req-4946529d-c94d-4c2f-8c1d-8f0b4a5230b7 req-9986a5d4-bb46-4be3-a257-1d173b818a01 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received event network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4946529d-c94d-4c2f-8c1d-8f0b4a5230b7 req-9986a5d4-bb46-4be3-a257-1d173b818a01 service nova] Acquiring lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4946529d-c94d-4c2f-8c1d-8f0b4a5230b7 req-9986a5d4-bb46-4be3-a257-1d173b818a01 service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4946529d-c94d-4c2f-8c1d-8f0b4a5230b7 req-9986a5d4-bb46-4be3-a257-1d173b818a01 service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:36 user nova-compute[72150]: DEBUG nova.compute.manager [req-4946529d-c94d-4c2f-8c1d-8f0b4a5230b7 req-9986a5d4-bb46-4be3-a257-1d173b818a01 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] No waiting events found dispatching network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:33:36 user nova-compute[72150]: WARNING nova.compute.manager [req-4946529d-c94d-4c2f-8c1d-8f0b4a5230b7 req-9986a5d4-bb46-4be3-a257-1d173b818a01 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received unexpected event network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 for instance with vm_state active and task_state None.
Aug 01 18:33:36 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:33:36 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:33:36 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:33:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:38 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:33:38 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:33:38 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:33:38 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:33:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:38 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:33:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:33:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:39 user nova-compute[72150]: INFO nova.compute.manager [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Detaching volume a4f14ea5-97f3-4c69-8f61-d956809a15d5
Aug 01 18:33:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:39 user nova-compute[72150]: INFO nova.virt.block_device [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Attempting to driver detach volume a4f14ea5-97f3-4c69-8f61-d956809a15d5 from mountpoint /dev/vdb
Aug 01 18:33:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Attempting to detach device vdb from instance bf2d1f14-2227-41d1-bd73-a05ab3149aba from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:33:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:33:39 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:33:39 user nova-compute[72150]:   <source dev="/dev/sdd"/>
Aug 01 18:33:39 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:33:39 user nova-compute[72150]:   <serial>a4f14ea5-97f3-4c69-8f61-d956809a15d5</serial>
Aug 01 18:33:39 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 18:33:39 user nova-compute[72150]: </disk>
Aug 01 18:33:39 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:33:39 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Successfully detached device vdb from instance bf2d1f14-2227-41d1-bd73-a05ab3149aba from the persistent domain config.
Aug 01 18:33:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf2d1f14-2227-41d1-bd73-a05ab3149aba from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:33:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:33:39 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:33:39 user nova-compute[72150]:   <source dev="/dev/sdd"/>
Aug 01 18:33:39 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:33:39 user nova-compute[72150]:   <serial>a4f14ea5-97f3-4c69-8f61-d956809a15d5</serial>
Aug 01 18:33:39 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 18:33:39 user nova-compute[72150]: </disk>
Aug 01 18:33:39 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:33:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690914820.3010154, bf2d1f14-2227-41d1-bd73-a05ab3149aba => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf2d1f14-2227-41d1-bd73-a05ab3149aba {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:33:40 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Successfully detached device vdb from instance bf2d1f14-2227-41d1-bd73-a05ab3149aba from the live domain config.
Aug 01 18:33:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PGUlJqzL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:33:40 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:33:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f7b0c1-472d-45a2-b0df-b27683f7fec3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd049096-36c7-48b7-8cfd-c0f024c544cf]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:33:40 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:33:40 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:33:40 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:33:40 user nova-compute[72150]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)
Aug 01 18:33:40 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:33:40 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:33:40 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:33:40 user nova-compute[72150]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 (non-flash)
Aug 01 18:33:40 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:33:40 user nova-compute[72150]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)
Aug 01 18:33:40 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:33:40 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec566290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5'): ({'sdd'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Removing single pathed devices sdd {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ea8cc5-e894-46c7-bf15-315ed43af3e4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7743b1-bde3-4c23-ac1e-a7670e5ab419]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Flushing IO for device /dev/sdd {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c211bf-1dfe-454f-9cfe-3b044ff03a43]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.068s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5af676-abad-489f-b67f-2164a3d2f109]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] SCSI volumes sdd have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad3bf76-092e-4c56-b67d-f6dc5ac4b730]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c33892d-7fa2-4311-89f5-52fbe842f9e0]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5, portal: 172.16.0.220,3260]
Aug 01 18:33:40 user nova-compute[72150]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5, portal: 172.16.0.220,3260] successful.
Aug 01 18:33:40 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4f14ea5-97f3-4c69-8f61-d956809a15d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44d827f-aeaa-4b1f-b5f4-5a5d0c6d5aad]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] <== disconnect_volume: return (395ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:33:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:41 user nova-compute[72150]: DEBUG nova.objects.instance [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lazy-loading 'flavor' on Instance uuid bf2d1f14-2227-41d1-bd73-a05ab3149aba {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:33:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8beb0ba5-f837-45d8-a98a-062ff7c147d9 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.088s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:33:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:33:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:43 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:33:43 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:33:43 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=7087MB free_disk=25.209857940673828GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:33:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:43 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 769690c8-53c5-4057-88a5-fbdbcb930e32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:33:43 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ea68420b-8362-4df3-b710-cd1cf76adba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:33:43 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 08851ec4-6f71-4ec1-a092-42aab83ee87f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:33:43 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance bf2d1f14-2227-41d1-bd73-a05ab3149aba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:33:43 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ceee3912-ca68-4b15-8fe6-985d905e8128 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:33:43 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 42e75a98-beb1-4688-a375-affc63b14252 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:33:43 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 1de0ad54-0d7a-4287-9532-7b4982b1e2bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:33:43 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance eb113972-7a86-4cb7-9f8d-ca690693e27d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:33:43 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance a5f0eca7-d060-4226-b36e-a3cd15b15703 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:33:43 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 441a61de-ad9d-412d-95f3-882cef273e88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:33:43 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance b10328c7-3328-4c3c-8ebe-3dd282ece0c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:33:43 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 65b04144-3b1f-4975-8524-2c9f9660672a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:33:43 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:33:43 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:33:43 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:33:43 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:33:43 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:33:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:44 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:33:44 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:33:44 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:33:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-ea68420b-8362-4df3-b710-cd1cf76adba0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:33:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-ea68420b-8362-4df3-b710-cd1cf76adba0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:33:44 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:33:45 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Updating instance_info_cache with network_info: [{"id": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "address": "fa:16:3e:a6:bd:40", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a63bb1a-08", "ovs_interfaceid": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:33:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-ea68420b-8362-4df3-b710-cd1cf76adba0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:33:45 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:33:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-dfe8bcb7-89b9-4f83-ab58-275fbea667bd req-f9e10a9a-6b8e-4bc5-bf40-f9949e94992b service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Received event network-changed-a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-dfe8bcb7-89b9-4f83-ab58-275fbea667bd req-f9e10a9a-6b8e-4bc5-bf40-f9949e94992b service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Refreshing instance network info cache due to event network-changed-a519018d-4c4e-4d06-ba14-c2d2054529ea. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:33:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-dfe8bcb7-89b9-4f83-ab58-275fbea667bd req-f9e10a9a-6b8e-4bc5-bf40-f9949e94992b service nova] Acquiring lock "refresh_cache-eb113972-7a86-4cb7-9f8d-ca690693e27d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:33:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-dfe8bcb7-89b9-4f83-ab58-275fbea667bd req-f9e10a9a-6b8e-4bc5-bf40-f9949e94992b service nova] Acquired lock "refresh_cache-eb113972-7a86-4cb7-9f8d-ca690693e27d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:33:51 user nova-compute[72150]: DEBUG nova.network.neutron [req-dfe8bcb7-89b9-4f83-ab58-275fbea667bd req-f9e10a9a-6b8e-4bc5-bf40-f9949e94992b service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Refreshing network info cache for port a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:33:51 user nova-compute[72150]: DEBUG nova.network.neutron [req-dfe8bcb7-89b9-4f83-ab58-275fbea667bd req-f9e10a9a-6b8e-4bc5-bf40-f9949e94992b service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Updated VIF entry in instance network info cache for port a519018d-4c4e-4d06-ba14-c2d2054529ea. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:33:51 user nova-compute[72150]: DEBUG nova.network.neutron [req-dfe8bcb7-89b9-4f83-ab58-275fbea667bd req-f9e10a9a-6b8e-4bc5-bf40-f9949e94992b service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Updating instance_info_cache with network_info: [{"id": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "address": "fa:16:3e:b3:96:a5", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519018d-4c", "ovs_interfaceid": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:33:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-dfe8bcb7-89b9-4f83-ab58-275fbea667bd req-f9e10a9a-6b8e-4bc5-bf40-f9949e94992b service nova] Releasing lock "refresh_cache-eb113972-7a86-4cb7-9f8d-ca690693e27d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:33:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-84aa365c-0218-41d5-8923-489cc144d41b req-187da3fb-ee83-44b2-a671-f9c925b8ca0b service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Received event network-changed-a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-84aa365c-0218-41d5-8923-489cc144d41b req-187da3fb-ee83-44b2-a671-f9c925b8ca0b service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Refreshing instance network info cache due to event network-changed-a519018d-4c4e-4d06-ba14-c2d2054529ea. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:33:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-84aa365c-0218-41d5-8923-489cc144d41b req-187da3fb-ee83-44b2-a671-f9c925b8ca0b service nova] Acquiring lock "refresh_cache-eb113972-7a86-4cb7-9f8d-ca690693e27d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:33:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-84aa365c-0218-41d5-8923-489cc144d41b req-187da3fb-ee83-44b2-a671-f9c925b8ca0b service nova] Acquired lock "refresh_cache-eb113972-7a86-4cb7-9f8d-ca690693e27d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:33:51 user nova-compute[72150]: DEBUG nova.network.neutron [req-84aa365c-0218-41d5-8923-489cc144d41b req-187da3fb-ee83-44b2-a671-f9c925b8ca0b service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Refreshing network info cache for port a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "eb113972-7a86-4cb7-9f8d-ca690693e27d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:52 user nova-compute[72150]: INFO nova.compute.manager [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Detaching volume aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5
Aug 01 18:33:52 user nova-compute[72150]: INFO nova.virt.block_device [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Attempting to driver detach volume aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 from mountpoint /dev/vdb
Aug 01 18:33:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Attempting to detach device vdb from instance eb113972-7a86-4cb7-9f8d-ca690693e27d from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:33:52 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:33:52 user nova-compute[72150]:   <source dev="/dev/sdh"/>
Aug 01 18:33:52 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:33:52 user nova-compute[72150]:   <serial>aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5</serial>
Aug 01 18:33:52 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:33:52 user nova-compute[72150]: </disk>
Aug 01 18:33:52 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:33:52 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Successfully detached device vdb from instance eb113972-7a86-4cb7-9f8d-ca690693e27d from the persistent domain config.
Aug 01 18:33:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eb113972-7a86-4cb7-9f8d-ca690693e27d from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:33:52 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:33:52 user nova-compute[72150]:   <source dev="/dev/sdh"/>
Aug 01 18:33:52 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:33:52 user nova-compute[72150]:   <serial>aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5</serial>
Aug 01 18:33:52 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:33:52 user nova-compute[72150]: </disk>
Aug 01 18:33:52 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG nova.network.neutron [req-84aa365c-0218-41d5-8923-489cc144d41b req-187da3fb-ee83-44b2-a671-f9c925b8ca0b service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Updated VIF entry in instance network info cache for port a519018d-4c4e-4d06-ba14-c2d2054529ea. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG nova.network.neutron [req-84aa365c-0218-41d5-8923-489cc144d41b req-187da3fb-ee83-44b2-a671-f9c925b8ca0b service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Updating instance_info_cache with network_info: [{"id": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "address": "fa:16:3e:b3:96:a5", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519018d-4c", "ovs_interfaceid": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-84aa365c-0218-41d5-8923-489cc144d41b req-187da3fb-ee83-44b2-a671-f9c925b8ca0b service nova] Releasing lock "refresh_cache-eb113972-7a86-4cb7-9f8d-ca690693e27d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690914832.5188723, eb113972-7a86-4cb7-9f8d-ca690693e27d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eb113972-7a86-4cb7-9f8d-ca690693e27d {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:33:52 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Successfully detached device vdb from instance eb113972-7a86-4cb7-9f8d-ca690693e27d from the live domain config.
Aug 01 18:33:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wOqhJMLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:33:52 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:33:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a030b30-54d1-4e30-a11e-4184f92976c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2ce1c6-5358-46fb-af41-9eb4537f8b33]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:33:52 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:33:52 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:33:52 user nova-compute[72150]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)
Aug 01 18:33:52 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:33:52 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:33:52 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:33:52 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:33:52 user nova-compute[72150]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 (non-flash)
Aug 01 18:33:52 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:33:52 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec556710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5'): ({'sdh'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Removing single pathed devices sdh {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddba37ad-849f-42a8-9bf3-6128b11f41fa]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61f25c9-153f-4a63-ab2e-3ba1a0ec5e31]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Flushing IO for device /dev/sdh {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[613bb4b1-5fe6-44c4-9af2-0afadfe9d978]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc123992-35a6-48d5-b885-ecf6e3d4cb7a]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] SCSI volumes sdh have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabbcbd7-f41f-4413-80c5-fd8d704b7b46]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[26706ad8-8d7b-4435-9f9a-16c01d1fdcfa]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5, portal: 172.16.0.220,3260]
Aug 01 18:33:52 user nova-compute[72150]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5, portal: 172.16.0.220,3260] successful.
Aug 01 18:33:52 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa03ab5f-68fb-4889-9a8b-3d96d1cfb7c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb48ddee-cd82-4600-b4c0-fd1d2986ec55]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] <== disconnect_volume: return (311ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:33:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:33:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquiring lock "ceee3912-ca68-4b15-8fe6-985d905e8128" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:53 user nova-compute[72150]: INFO nova.compute.manager [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Detaching volume 4853a41d-803e-4f6f-b35f-0fb4cf2ba697
Aug 01 18:33:53 user nova-compute[72150]: INFO nova.virt.block_device [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Attempting to driver detach volume 4853a41d-803e-4f6f-b35f-0fb4cf2ba697 from mountpoint /dev/vdb
Aug 01 18:33:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Attempting to detach device vdb from instance ceee3912-ca68-4b15-8fe6-985d905e8128 from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:33:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:33:53 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:33:53 user nova-compute[72150]:   <source dev="/dev/sde"/>
Aug 01 18:33:53 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:33:53 user nova-compute[72150]:   <serial>4853a41d-803e-4f6f-b35f-0fb4cf2ba697</serial>
Aug 01 18:33:53 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:33:53 user nova-compute[72150]: </disk>
Aug 01 18:33:53 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:33:53 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Successfully detached device vdb from instance ceee3912-ca68-4b15-8fe6-985d905e8128 from the persistent domain config.
Aug 01 18:33:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ceee3912-ca68-4b15-8fe6-985d905e8128 from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:33:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:33:53 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:33:53 user nova-compute[72150]:   <source dev="/dev/sde"/>
Aug 01 18:33:53 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:33:53 user nova-compute[72150]:   <serial>4853a41d-803e-4f6f-b35f-0fb4cf2ba697</serial>
Aug 01 18:33:53 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:33:53 user nova-compute[72150]: </disk>
Aug 01 18:33:53 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:33:53 user nova-compute[72150]: DEBUG nova.objects.instance [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lazy-loading 'flavor' on Instance uuid eb113972-7a86-4cb7-9f8d-ca690693e27d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:33:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f28cb753-3ffb-47ba-aec1-d81a03def8cc tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.776s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690914834.1471171, ceee3912-ca68-4b15-8fe6-985d905e8128 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ceee3912-ca68-4b15-8fe6-985d905e8128 {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:33:54 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Successfully detached device vdb from instance ceee3912-ca68-4b15-8fe6-985d905e8128 from the live domain config.
Aug 01 18:33:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IaRyAEMh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:33:54 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:33:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34688d4-d8ae-413a-af9d-b213cf63b2e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[38444199-af5d-4964-9586-be528180880c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:33:54 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:33:54 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:33:54 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:33:54 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:33:54 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:33:54 user nova-compute[72150]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 (non-flash)
Aug 01 18:33:54 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:33:54 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec5644c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697'): ({'sde'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Removing single pathed devices sde {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bf4171-a1f6-4e90-b51a-2f6ee167d2f0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22a5caa-8333-480d-8623-ee0363c00141]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Flushing IO for device /dev/sde {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[218df909-7231-4ddc-b82c-557d32e7f78d]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bf0a4f-7386-4cfb-bcb6-3f9bea193827]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] SCSI volumes sde have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f307eb85-cacf-4443-8b29-de5c59cf0687]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be88249-6a50-436a-ad6e-8c2f3c012cf0]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697, portal: 172.16.0.220,3260]
Aug 01 18:33:54 user nova-compute[72150]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697, portal: 172.16.0.220,3260] successful.
Aug 01 18:33:54 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4853a41d-803e-4f6f-b35f-0fb4cf2ba697 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c7f7d9-a684-4345-a9ba-0fafcae7183d]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] <== disconnect_volume: return (286ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "7e5b12a0-6673-4e12-b23c-73141346dd83" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "7e5b12a0-6673-4e12-b23c-73141346dd83" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:33:54 user nova-compute[72150]: INFO nova.compute.claims [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Claim successful on node user
Aug 01 18:33:55 user nova-compute[72150]: DEBUG nova.objects.instance [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lazy-loading 'flavor' on Instance uuid ceee3912-ca68-4b15-8fe6-985d905e8128 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:33:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0d13dfc8-f127-41cf-9d7d-09a497d784de tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.796s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:55 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:33:55 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:33:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:55 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:33:55 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:33:55 user nova-compute[72150]: DEBUG nova.network.neutron [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:33:55 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:33:55 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:33:55 user nova-compute[72150]: DEBUG nova.policy [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c975577646d746d192f038a3608d1f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efbd504761845f88d59b78115119d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:33:55 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:33:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:33:55 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Creating image(s)
Aug 01 18:33:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e5b12a0-6673-4e12-b23c-73141346dd83/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "/opt/stack/data/nova/instances/7e5b12a0-6673-4e12-b23c-73141346dd83/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "/opt/stack/data/nova/instances/7e5b12a0-6673-4e12-b23c-73141346dd83/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/7e5b12a0-6673-4e12-b23c-73141346dd83/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/7e5b12a0-6673-4e12-b23c-73141346dd83/disk 1073741824" returned: 0 in 0.050s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.142s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:56 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e5b12a0-6673-4e12-b23c-73141346dd83/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:33:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b12a0-6673-4e12-b23c-73141346dd83/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:33:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b12a0-6673-4e12-b23c-73141346dd83/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:33:56 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Cannot resize image /opt/stack/data/nova/instances/7e5b12a0-6673-4e12-b23c-73141346dd83/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:33:56 user nova-compute[72150]: DEBUG nova.objects.instance [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lazy-loading 'migration_context' on Instance uuid 7e5b12a0-6673-4e12-b23c-73141346dd83 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:33:56 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:33:56 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Ensure instance console log exists: /opt/stack/data/nova/instances/7e5b12a0-6673-4e12-b23c-73141346dd83/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:33:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:56 user nova-compute[72150]: DEBUG nova.network.neutron [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Successfully created port: a83e9ff9-3d8f-479b-b142-58b06f1901c2 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.network.neutron [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Successfully updated port: a83e9ff9-3d8f-479b-b142-58b06f1901c2 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "refresh_cache-7e5b12a0-6673-4e12-b23c-73141346dd83" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquired lock "refresh_cache-7e5b12a0-6673-4e12-b23c-73141346dd83" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.network.neutron [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-ac866aea-1525-4f01-92c6-a4034ee6f2a7 req-7097a80b-29c7-42db-a419-351319975a7f service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Received event network-changed-a83e9ff9-3d8f-479b-b142-58b06f1901c2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-ac866aea-1525-4f01-92c6-a4034ee6f2a7 req-7097a80b-29c7-42db-a419-351319975a7f service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Refreshing instance network info cache due to event network-changed-a83e9ff9-3d8f-479b-b142-58b06f1901c2. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ac866aea-1525-4f01-92c6-a4034ee6f2a7 req-7097a80b-29c7-42db-a419-351319975a7f service nova] Acquiring lock "refresh_cache-7e5b12a0-6673-4e12-b23c-73141346dd83" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.network.neutron [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.network.neutron [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Updating instance_info_cache with network_info: [{"id": "a83e9ff9-3d8f-479b-b142-58b06f1901c2", "address": "fa:16:3e:e7:39:89", "network": {"id": "87bd2699-a52f-4b66-9d6c-fbf9fa54792d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1887490690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efbd504761845f88d59b78115119d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e9ff9-3d", "ovs_interfaceid": "a83e9ff9-3d8f-479b-b142-58b06f1901c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Releasing lock "refresh_cache-7e5b12a0-6673-4e12-b23c-73141346dd83" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Instance network_info: |[{"id": "a83e9ff9-3d8f-479b-b142-58b06f1901c2", "address": "fa:16:3e:e7:39:89", "network": {"id": "87bd2699-a52f-4b66-9d6c-fbf9fa54792d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1887490690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efbd504761845f88d59b78115119d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e9ff9-3d", "ovs_interfaceid": "a83e9ff9-3d8f-479b-b142-58b06f1901c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ac866aea-1525-4f01-92c6-a4034ee6f2a7 req-7097a80b-29c7-42db-a419-351319975a7f service nova] Acquired lock "refresh_cache-7e5b12a0-6673-4e12-b23c-73141346dd83" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.network.neutron [req-ac866aea-1525-4f01-92c6-a4034ee6f2a7 req-7097a80b-29c7-42db-a419-351319975a7f service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Refreshing network info cache for port a83e9ff9-3d8f-479b-b142-58b06f1901c2 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Start _get_guest_xml network_info=[{"id": "a83e9ff9-3d8f-479b-b142-58b06f1901c2", "address": "fa:16:3e:e7:39:89", "network": {"id": "87bd2699-a52f-4b66-9d6c-fbf9fa54792d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1887490690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efbd504761845f88d59b78115119d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e9ff9-3d", "ovs_interfaceid": "a83e9ff9-3d8f-479b-b142-58b06f1901c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:33:57 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:33:57 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:33:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-653144405',display_name='tempest-VolumesSnapshotTestJSON-instance-653144405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-653144405',id=29,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwpNLeWawVas+fprRqDj6ZBu94kEPC0iDpL4ztTBVk2dbskvBFKJ0YMcVK7fTLVKRn4jnm2Axcl0np/IlX/+VX6j8ecu7pz11jGJxsn8RGJnfbg4a91TakOYPfJizVeQA==',key_name='tempest-keypair-798821890',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5efbd504761845f88d59b78115119d62',ramdisk_id='',reservation_id='r-www6h0hu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-710086109',owner_user_name='tempest-VolumesSnapshotTestJSON-710086109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:33:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c975577646d746d192f038a3608d1f76',uuid=7e5b12a0-6673-4e12-b23c-73141346dd83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a83e9ff9-3d8f-479b-b142-58b06f1901c2", "address": "fa:16:3e:e7:39:89", "network": {"id": "87bd2699-a52f-4b66-9d6c-fbf9fa54792d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1887490690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efbd504761845f88d59b78115119d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e9ff9-3d", "ovs_interfaceid": "a83e9ff9-3d8f-479b-b142-58b06f1901c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Converting VIF {"id": "a83e9ff9-3d8f-479b-b142-58b06f1901c2", "address": "fa:16:3e:e7:39:89", "network": {"id": "87bd2699-a52f-4b66-9d6c-fbf9fa54792d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1887490690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efbd504761845f88d59b78115119d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e9ff9-3d", "ovs_interfaceid": "a83e9ff9-3d8f-479b-b142-58b06f1901c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:39:89,bridge_name='br-int',has_traffic_filtering=True,id=a83e9ff9-3d8f-479b-b142-58b06f1901c2,network=Network(87bd2699-a52f-4b66-9d6c-fbf9fa54792d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83e9ff9-3d') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.objects.instance [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e5b12a0-6673-4e12-b23c-73141346dd83 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:33:57 user nova-compute[72150]:   <uuid>7e5b12a0-6673-4e12-b23c-73141346dd83</uuid>
Aug 01 18:33:57 user nova-compute[72150]:   <name>instance-0000001d</name>
Aug 01 18:33:57 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:33:57 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:33:57 user nova-compute[72150]:   <metadata>
Aug 01 18:33:57 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:33:57 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:33:57 user nova-compute[72150]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-653144405</nova:name>
Aug 01 18:33:57 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:33:57</nova:creationTime>
Aug 01 18:33:57 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:33:57 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:33:57 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:33:57 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:33:57 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:33:57 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:33:57 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:33:57 user nova-compute[72150]:       <nova:owner>
Aug 01 18:33:57 user nova-compute[72150]:         <nova:user uuid="c975577646d746d192f038a3608d1f76">tempest-VolumesSnapshotTestJSON-710086109-project-member</nova:user>
Aug 01 18:33:57 user nova-compute[72150]:         <nova:project uuid="5efbd504761845f88d59b78115119d62">tempest-VolumesSnapshotTestJSON-710086109</nova:project>
Aug 01 18:33:57 user nova-compute[72150]:       </nova:owner>
Aug 01 18:33:57 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:33:57 user nova-compute[72150]:       <nova:ports>
Aug 01 18:33:57 user nova-compute[72150]:         <nova:port uuid="a83e9ff9-3d8f-479b-b142-58b06f1901c2">
Aug 01 18:33:57 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 18:33:57 user nova-compute[72150]:         </nova:port>
Aug 01 18:33:57 user nova-compute[72150]:       </nova:ports>
Aug 01 18:33:57 user nova-compute[72150]:     </nova:instance>
Aug 01 18:33:57 user nova-compute[72150]:   </metadata>
Aug 01 18:33:57 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:33:57 user nova-compute[72150]:     <system>
Aug 01 18:33:57 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:33:57 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:33:57 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:33:57 user nova-compute[72150]:       <entry name="serial">7e5b12a0-6673-4e12-b23c-73141346dd83</entry>
Aug 01 18:33:57 user nova-compute[72150]:       <entry name="uuid">7e5b12a0-6673-4e12-b23c-73141346dd83</entry>
Aug 01 18:33:57 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:33:57 user nova-compute[72150]:     </system>
Aug 01 18:33:57 user nova-compute[72150]:   </sysinfo>
Aug 01 18:33:57 user nova-compute[72150]:   <os>
Aug 01 18:33:57 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:33:57 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:33:57 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:33:57 user nova-compute[72150]:   </os>
Aug 01 18:33:57 user nova-compute[72150]:   <features>
Aug 01 18:33:57 user nova-compute[72150]:     <acpi/>
Aug 01 18:33:57 user nova-compute[72150]:     <apic/>
Aug 01 18:33:57 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:33:57 user nova-compute[72150]:   </features>
Aug 01 18:33:57 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:33:57 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:33:57 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:33:57 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:33:57 user nova-compute[72150]:   </clock>
Aug 01 18:33:57 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:33:57 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:33:57 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:33:57 user nova-compute[72150]:   </cpu>
Aug 01 18:33:57 user nova-compute[72150]:   <devices>
Aug 01 18:33:57 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:33:57 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:33:57 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/7e5b12a0-6673-4e12-b23c-73141346dd83/disk"/>
Aug 01 18:33:57 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:33:57 user nova-compute[72150]:     </disk>
Aug 01 18:33:57 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:33:57 user nova-compute[72150]:       <mac address="fa:16:3e:e7:39:89"/>
Aug 01 18:33:57 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:33:57 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:33:57 user nova-compute[72150]:       <target dev="tapa83e9ff9-3d"/>
Aug 01 18:33:57 user nova-compute[72150]:     </interface>
Aug 01 18:33:57 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:33:57 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/7e5b12a0-6673-4e12-b23c-73141346dd83/console.log" append="off"/>
Aug 01 18:33:57 user nova-compute[72150]:     </serial>
Aug 01 18:33:57 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:33:57 user nova-compute[72150]:     <video>
Aug 01 18:33:57 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:33:57 user nova-compute[72150]:     </video>
Aug 01 18:33:57 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:33:57 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:33:57 user nova-compute[72150]:     </rng>
Aug 01 18:33:57 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:33:57 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:33:57 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:33:57 user nova-compute[72150]:     </memballoon>
Aug 01 18:33:57 user nova-compute[72150]:   </devices>
Aug 01 18:33:57 user nova-compute[72150]: </domain>
Aug 01 18:33:57 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:33:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-653144405',display_name='tempest-VolumesSnapshotTestJSON-instance-653144405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-653144405',id=29,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwpNLeWawVas+fprRqDj6ZBu94kEPC0iDpL4ztTBVk2dbskvBFKJ0YMcVK7fTLVKRn4jnm2Axcl0np/IlX/+VX6j8ecu7pz11jGJxsn8RGJnfbg4a91TakOYPfJizVeQA==',key_name='tempest-keypair-798821890',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5efbd504761845f88d59b78115119d62',ramdisk_id='',reservation_id='r-www6h0hu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-710086109',owner_user_name='tempest-VolumesSnapshotTestJSON-710086109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:33:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c975577646d746d192f038a3608d1f76',uuid=7e5b12a0-6673-4e12-b23c-73141346dd83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a83e9ff9-3d8f-479b-b142-58b06f1901c2", "address": "fa:16:3e:e7:39:89", "network": {"id": "87bd2699-a52f-4b66-9d6c-fbf9fa54792d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1887490690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efbd504761845f88d59b78115119d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e9ff9-3d", "ovs_interfaceid": "a83e9ff9-3d8f-479b-b142-58b06f1901c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Converting VIF {"id": "a83e9ff9-3d8f-479b-b142-58b06f1901c2", "address": "fa:16:3e:e7:39:89", "network": {"id": "87bd2699-a52f-4b66-9d6c-fbf9fa54792d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1887490690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efbd504761845f88d59b78115119d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e9ff9-3d", "ovs_interfaceid": "a83e9ff9-3d8f-479b-b142-58b06f1901c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:39:89,bridge_name='br-int',has_traffic_filtering=True,id=a83e9ff9-3d8f-479b-b142-58b06f1901c2,network=Network(87bd2699-a52f-4b66-9d6c-fbf9fa54792d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83e9ff9-3d') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG os_vif [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:39:89,bridge_name='br-int',has_traffic_filtering=True,id=a83e9ff9-3d8f-479b-b142-58b06f1901c2,network=Network(87bd2699-a52f-4b66-9d6c-fbf9fa54792d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83e9ff9-3d') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa83e9ff9-3d, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa83e9ff9-3d, col_values=(('external_ids', {'iface-id': 'a83e9ff9-3d8f-479b-b142-58b06f1901c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:39:89', 'vm-uuid': '7e5b12a0-6673-4e12-b23c-73141346dd83'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:57 user nova-compute[72150]: INFO os_vif [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:39:89,bridge_name='br-int',has_traffic_filtering=True,id=a83e9ff9-3d8f-479b-b142-58b06f1901c2,network=Network(87bd2699-a52f-4b66-9d6c-fbf9fa54792d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83e9ff9-3d')
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:33:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] No VIF found with MAC fa:16:3e:e7:39:89, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:33:58 user nova-compute[72150]: DEBUG nova.network.neutron [req-ac866aea-1525-4f01-92c6-a4034ee6f2a7 req-7097a80b-29c7-42db-a419-351319975a7f service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Updated VIF entry in instance network info cache for port a83e9ff9-3d8f-479b-b142-58b06f1901c2. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:33:58 user nova-compute[72150]: DEBUG nova.network.neutron [req-ac866aea-1525-4f01-92c6-a4034ee6f2a7 req-7097a80b-29c7-42db-a419-351319975a7f service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Updating instance_info_cache with network_info: [{"id": "a83e9ff9-3d8f-479b-b142-58b06f1901c2", "address": "fa:16:3e:e7:39:89", "network": {"id": "87bd2699-a52f-4b66-9d6c-fbf9fa54792d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1887490690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efbd504761845f88d59b78115119d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e9ff9-3d", "ovs_interfaceid": "a83e9ff9-3d8f-479b-b142-58b06f1901c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:33:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ac866aea-1525-4f01-92c6-a4034ee6f2a7 req-7097a80b-29c7-42db-a419-351319975a7f service nova] Releasing lock "refresh_cache-7e5b12a0-6673-4e12-b23c-73141346dd83" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:33:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-2ff732f8-d6b1-4fda-9ea9-160d936b3b26 req-67eb7650-0312-43b6-b82e-8ed702edfa7e service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Received event network-vif-plugged-a83e9ff9-3d8f-479b-b142-58b06f1901c2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:33:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2ff732f8-d6b1-4fda-9ea9-160d936b3b26 req-67eb7650-0312-43b6-b82e-8ed702edfa7e service nova] Acquiring lock "7e5b12a0-6673-4e12-b23c-73141346dd83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:33:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2ff732f8-d6b1-4fda-9ea9-160d936b3b26 req-67eb7650-0312-43b6-b82e-8ed702edfa7e service nova] Lock "7e5b12a0-6673-4e12-b23c-73141346dd83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:33:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2ff732f8-d6b1-4fda-9ea9-160d936b3b26 req-67eb7650-0312-43b6-b82e-8ed702edfa7e service nova] Lock "7e5b12a0-6673-4e12-b23c-73141346dd83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:33:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-2ff732f8-d6b1-4fda-9ea9-160d936b3b26 req-67eb7650-0312-43b6-b82e-8ed702edfa7e service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] No waiting events found dispatching network-vif-plugged-a83e9ff9-3d8f-479b-b142-58b06f1901c2 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:33:59 user nova-compute[72150]: WARNING nova.compute.manager [req-2ff732f8-d6b1-4fda-9ea9-160d936b3b26 req-67eb7650-0312-43b6-b82e-8ed702edfa7e service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Received unexpected event network-vif-plugged-a83e9ff9-3d8f-479b-b142-58b06f1901c2 for instance with vm_state building and task_state spawning.
Aug 01 18:33:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:33:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:01 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914841.22859, 7e5b12a0-6673-4e12-b23c-73141346dd83 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:34:01 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] VM Resumed (Lifecycle Event)
Aug 01 18:34:01 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:34:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:34:01 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Instance spawned successfully.
Aug 01 18:34:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:34:01 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:34:01 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:34:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:34:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:34:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:34:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:34:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:34:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:34:01 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:34:01 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914841.2298596, 7e5b12a0-6673-4e12-b23c-73141346dd83 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:34:01 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] VM Started (Lifecycle Event)
Aug 01 18:34:01 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:34:01 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:34:01 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:34:01 user nova-compute[72150]: INFO nova.compute.manager [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Took 5.69 seconds to spawn the instance on the hypervisor.
Aug 01 18:34:01 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:34:01 user nova-compute[72150]: INFO nova.compute.manager [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Took 6.47 seconds to build instance.
Aug 01 18:34:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8d0afd35-24c4-4eb8-8531-4b92e2ca2588 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "7e5b12a0-6673-4e12-b23c-73141346dd83" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.575s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:01 user nova-compute[72150]: DEBUG nova.compute.manager [req-edb3936a-5a53-4449-9494-b010bfec169b req-b7cfe730-913c-436a-a578-df343c09876b service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Received event network-vif-plugged-a83e9ff9-3d8f-479b-b142-58b06f1901c2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:34:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-edb3936a-5a53-4449-9494-b010bfec169b req-b7cfe730-913c-436a-a578-df343c09876b service nova] Acquiring lock "7e5b12a0-6673-4e12-b23c-73141346dd83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-edb3936a-5a53-4449-9494-b010bfec169b req-b7cfe730-913c-436a-a578-df343c09876b service nova] Lock "7e5b12a0-6673-4e12-b23c-73141346dd83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-edb3936a-5a53-4449-9494-b010bfec169b req-b7cfe730-913c-436a-a578-df343c09876b service nova] Lock "7e5b12a0-6673-4e12-b23c-73141346dd83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:01 user nova-compute[72150]: DEBUG nova.compute.manager [req-edb3936a-5a53-4449-9494-b010bfec169b req-b7cfe730-913c-436a-a578-df343c09876b service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] No waiting events found dispatching network-vif-plugged-a83e9ff9-3d8f-479b-b142-58b06f1901c2 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:34:01 user nova-compute[72150]: WARNING nova.compute.manager [req-edb3936a-5a53-4449-9494-b010bfec169b req-b7cfe730-913c-436a-a578-df343c09876b service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Received unexpected event network-vif-plugged-a83e9ff9-3d8f-479b-b142-58b06f1901c2 for instance with vm_state active and task_state None.
Aug 01 18:34:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "1de0ad54-0d7a-4287-9532-7b4982b1e2bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "1de0ad54-0d7a-4287-9532-7b4982b1e2bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "1de0ad54-0d7a-4287-9532-7b4982b1e2bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "1de0ad54-0d7a-4287-9532-7b4982b1e2bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "1de0ad54-0d7a-4287-9532-7b4982b1e2bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:14 user nova-compute[72150]: INFO nova.compute.manager [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Terminating instance
Aug 01 18:34:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG nova.compute.manager [req-ec097c37-c11c-4a31-ae3a-5871782a4a83 req-aae31ca0-eeef-427a-a02a-61c6d9eed9e9 service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Received event network-vif-unplugged-47fc57e5-3a55-4719-944f-5d65f5fbcce4 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ec097c37-c11c-4a31-ae3a-5871782a4a83 req-aae31ca0-eeef-427a-a02a-61c6d9eed9e9 service nova] Acquiring lock "1de0ad54-0d7a-4287-9532-7b4982b1e2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ec097c37-c11c-4a31-ae3a-5871782a4a83 req-aae31ca0-eeef-427a-a02a-61c6d9eed9e9 service nova] Lock "1de0ad54-0d7a-4287-9532-7b4982b1e2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ec097c37-c11c-4a31-ae3a-5871782a4a83 req-aae31ca0-eeef-427a-a02a-61c6d9eed9e9 service nova] Lock "1de0ad54-0d7a-4287-9532-7b4982b1e2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG nova.compute.manager [req-ec097c37-c11c-4a31-ae3a-5871782a4a83 req-aae31ca0-eeef-427a-a02a-61c6d9eed9e9 service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] No waiting events found dispatching network-vif-unplugged-47fc57e5-3a55-4719-944f-5d65f5fbcce4 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG nova.compute.manager [req-ec097c37-c11c-4a31-ae3a-5871782a4a83 req-aae31ca0-eeef-427a-a02a-61c6d9eed9e9 service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Received event network-vif-unplugged-47fc57e5-3a55-4719-944f-5d65f5fbcce4 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:34:14 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Instance destroyed successfully.
Aug 01 18:34:14 user nova-compute[72150]: DEBUG nova.objects.instance [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lazy-loading 'resources' on Instance uuid 1de0ad54-0d7a-4287-9532-7b4982b1e2bf {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:29:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-829016891',display_name='tempest-TestVolumeBootPattern-volume-backed-server-829016891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-829016891',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/Zr+Ocb8YCIrHaOzeaW66DJo7yyFAwj0m/obLW8/159dcQuEf2CVcL9NGhxgsjAPlmry/M82McWmgRoQ0Wy+HOFrOm4/xvY1j1BH4/W/pWbJB/Sfdzb2kQLiBMCkYKfA==',key_name='tempest-keypair-721385634',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:29:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7ca44f23b114893afcfe57c52f693b1',ramdisk_id='',reservation_id='r-99c7dn9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-295340968',owner_user_name='tempest-TestVolumeBootPattern-295340968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:29:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92c7ef0ed6814f8880de76adb913a487',uuid=1de0ad54-0d7a-4287-9532-7b4982b1e2bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47fc57e5-3a55-4719-944f-5d65f5fbcce4", "address": "fa:16:3e:20:25:3c", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc57e5-3a", "ovs_interfaceid": "47fc57e5-3a55-4719-944f-5d65f5fbcce4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converting VIF {"id": "47fc57e5-3a55-4719-944f-5d65f5fbcce4", "address": "fa:16:3e:20:25:3c", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc57e5-3a", "ovs_interfaceid": "47fc57e5-3a55-4719-944f-5d65f5fbcce4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:25:3c,bridge_name='br-int',has_traffic_filtering=True,id=47fc57e5-3a55-4719-944f-5d65f5fbcce4,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47fc57e5-3a') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG os_vif [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:25:3c,bridge_name='br-int',has_traffic_filtering=True,id=47fc57e5-3a55-4719-944f-5d65f5fbcce4,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47fc57e5-3a') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47fc57e5-3a, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:14 user nova-compute[72150]: INFO os_vif [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:25:3c,bridge_name='br-int',has_traffic_filtering=True,id=47fc57e5-3a55-4719-944f-5d65f5fbcce4,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47fc57e5-3a')
Aug 01 18:34:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mxcIukbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:34:14 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:34:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[759c318a-f4cd-42ae-8fe1-4e3648f74ab9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d45b3d9-1bb6-4a51-858f-3494e90e83af]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:34:14 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:34:14 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:34:14 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 (non-flash)
Aug 01 18:34:14 user nova-compute[72150]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:34:14 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:34:14 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec567910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264'): ({'sdb'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Removing single pathed devices sdb {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42effb7-eb63-4682-84be-009eb7287cd9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e08b9d3-371b-484c-901f-b4f0886d1698]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Flushing IO for device /dev/sdb {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d11453-d4df-406b-8070-52f8cf7be7f6]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:34:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc8b9a7-b4e3-43f2-bdbf-aecf98b02570]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO5ddb3da2-2444253ec46d2f07', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5ddb3da2', '/dev/disk/by-id/scsi-23234343432353365') {{(pid=82940) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a436ad65-b2a8-49de-80a3-ad11dad938ad]: (4, None) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[960f8a8e-3a66-4b33-b449-87524991d0f3]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efc6d3e-e000-4da0-b6a4-63f9a8878d0b]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264, portal: 172.16.0.220,3260]
Aug 01 18:34:15 user nova-compute[72150]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264, portal: 172.16.0.220,3260] successful.
Aug 01 18:34:15 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52afa80c-1b78-452e-bfe6-468e631bd264 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3df2751-dc62-4e4d-ac3b-4669367e9dcb]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] <== disconnect_volume: return (303ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:34:15 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Deleting instance files /opt/stack/data/nova/instances/1de0ad54-0d7a-4287-9532-7b4982b1e2bf_del
Aug 01 18:34:15 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Deletion of /opt/stack/data/nova/instances/1de0ad54-0d7a-4287-9532-7b4982b1e2bf_del complete
Aug 01 18:34:15 user nova-compute[72150]: INFO nova.compute.manager [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 01 18:34:15 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:34:15 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:34:15 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Took 0.75 seconds to deallocate network for instance.
Aug 01 18:34:16 user nova-compute[72150]: DEBUG nova.compute.manager [req-79f53c5b-9a9c-4f69-8b3f-9d6f4bf57f55 req-5ec018fe-13fe-4e84-b1af-1b91ea531519 service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Received event network-vif-plugged-47fc57e5-3a55-4719-944f-5d65f5fbcce4 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:34:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-79f53c5b-9a9c-4f69-8b3f-9d6f4bf57f55 req-5ec018fe-13fe-4e84-b1af-1b91ea531519 service nova] Acquiring lock "1de0ad54-0d7a-4287-9532-7b4982b1e2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-79f53c5b-9a9c-4f69-8b3f-9d6f4bf57f55 req-5ec018fe-13fe-4e84-b1af-1b91ea531519 service nova] Lock "1de0ad54-0d7a-4287-9532-7b4982b1e2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-79f53c5b-9a9c-4f69-8b3f-9d6f4bf57f55 req-5ec018fe-13fe-4e84-b1af-1b91ea531519 service nova] Lock "1de0ad54-0d7a-4287-9532-7b4982b1e2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:16 user nova-compute[72150]: DEBUG nova.compute.manager [req-79f53c5b-9a9c-4f69-8b3f-9d6f4bf57f55 req-5ec018fe-13fe-4e84-b1af-1b91ea531519 service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] No waiting events found dispatching network-vif-plugged-47fc57e5-3a55-4719-944f-5d65f5fbcce4 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:34:16 user nova-compute[72150]: WARNING nova.compute.manager [req-79f53c5b-9a9c-4f69-8b3f-9d6f4bf57f55 req-5ec018fe-13fe-4e84-b1af-1b91ea531519 service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Received unexpected event network-vif-plugged-47fc57e5-3a55-4719-944f-5d65f5fbcce4 for instance with vm_state active and task_state deleting.
Aug 01 18:34:16 user nova-compute[72150]: DEBUG nova.compute.manager [req-79f53c5b-9a9c-4f69-8b3f-9d6f4bf57f55 req-5ec018fe-13fe-4e84-b1af-1b91ea531519 service nova] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Received event network-vif-deleted-47fc57e5-3a55-4719-944f-5d65f5fbcce4 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:34:16 user nova-compute[72150]: INFO nova.compute.manager [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Took 0.85 seconds to detach 1 volumes for instance.
Aug 01 18:34:16 user nova-compute[72150]: DEBUG nova.compute.manager [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Deleting volume: 52afa80c-1b78-452e-bfe6-468e631bd264 {{(pid=72150) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 18:34:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:17 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:34:17 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:34:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:17 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Deleted allocations for instance 1de0ad54-0d7a-4287-9532-7b4982b1e2bf
Aug 01 18:34:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-980815b7-e3f6-4d7c-9f8e-61fd53b6f527 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "1de0ad54-0d7a-4287-9532-7b4982b1e2bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.360s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:29 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914854.8260653, 1de0ad54-0d7a-4287-9532-7b4982b1e2bf => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:34:29 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] VM Stopped (Lifecycle Event)
Aug 01 18:34:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-716b7fcb-509b-4f15-83a2-b28115e34136 None None] [instance: 1de0ad54-0d7a-4287-9532-7b4982b1e2bf] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:34:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:32 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:34:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:35 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:34:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "441a61de-ad9d-412d-95f3-882cef273e88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "441a61de-ad9d-412d-95f3-882cef273e88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "441a61de-ad9d-412d-95f3-882cef273e88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "441a61de-ad9d-412d-95f3-882cef273e88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "441a61de-ad9d-412d-95f3-882cef273e88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:37 user nova-compute[72150]: INFO nova.compute.manager [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Terminating instance
Aug 01 18:34:37 user nova-compute[72150]: DEBUG nova.compute.manager [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:34:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:37 user nova-compute[72150]: DEBUG nova.compute.manager [req-2a5294a5-e090-43f3-905e-87fec4f52abb req-9ab3b2a7-2059-4dd1-b2e5-32390972c97d service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Received event network-vif-unplugged-9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:34:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2a5294a5-e090-43f3-905e-87fec4f52abb req-9ab3b2a7-2059-4dd1-b2e5-32390972c97d service nova] Acquiring lock "441a61de-ad9d-412d-95f3-882cef273e88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2a5294a5-e090-43f3-905e-87fec4f52abb req-9ab3b2a7-2059-4dd1-b2e5-32390972c97d service nova] Lock "441a61de-ad9d-412d-95f3-882cef273e88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2a5294a5-e090-43f3-905e-87fec4f52abb req-9ab3b2a7-2059-4dd1-b2e5-32390972c97d service nova] Lock "441a61de-ad9d-412d-95f3-882cef273e88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:37 user nova-compute[72150]: DEBUG nova.compute.manager [req-2a5294a5-e090-43f3-905e-87fec4f52abb req-9ab3b2a7-2059-4dd1-b2e5-32390972c97d service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] No waiting events found dispatching network-vif-unplugged-9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:34:37 user nova-compute[72150]: DEBUG nova.compute.manager [req-2a5294a5-e090-43f3-905e-87fec4f52abb req-9ab3b2a7-2059-4dd1-b2e5-32390972c97d service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Received event network-vif-unplugged-9c02fc93-434e-4e02-8855-14348e691115 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:34:38 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Instance destroyed successfully.
Aug 01 18:34:38 user nova-compute[72150]: DEBUG nova.objects.instance [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lazy-loading 'resources' on Instance uuid 441a61de-ad9d-412d-95f3-882cef273e88 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:34:38 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T18:28:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1473327332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1473327332',id=21,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWQMZQX2D/HQW8cg/YsV/NE/LRrdrO+ZwZNwgE1ATaVLlle4kzRuW5pJKzece0RgDQ87aRWUqjcNBY/DtyoPUj7uXTkdjNjIryRHAPyMBeR9HCitjxLaKFcLOHTGnSeiw==',key_name='tempest-keypair-1274630906',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:32:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='493923414b464384bb3a1ce3e6f7a2f0',ramdisk_id='',reservation_id='r-hphvdvst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849821930',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849821930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:32:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5804d69f9f18482f9fe0e0d4d73c4e92',uuid=441a61de-ad9d-412d-95f3-882cef273e88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c02fc93-434e-4e02-8855-14348e691115", "address": "fa:16:3e:ba:5c:56", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c02fc93-43", "ovs_interfaceid": "9c02fc93-434e-4e02-8855-14348e691115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:34:38 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converting VIF {"id": "9c02fc93-434e-4e02-8855-14348e691115", "address": "fa:16:3e:ba:5c:56", "network": {"id": "540ae15a-2f68-4b69-98d8-b79c02c40868", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-26559924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "493923414b464384bb3a1ce3e6f7a2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c02fc93-43", "ovs_interfaceid": "9c02fc93-434e-4e02-8855-14348e691115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:34:38 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:56,bridge_name='br-int',has_traffic_filtering=True,id=9c02fc93-434e-4e02-8855-14348e691115,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c02fc93-43') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:34:38 user nova-compute[72150]: DEBUG os_vif [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:56,bridge_name='br-int',has_traffic_filtering=True,id=9c02fc93-434e-4e02-8855-14348e691115,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c02fc93-43') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:34:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c02fc93-43, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:34:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:38 user nova-compute[72150]: INFO os_vif [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:56,bridge_name='br-int',has_traffic_filtering=True,id=9c02fc93-434e-4e02-8855-14348e691115,network=Network(540ae15a-2f68-4b69-98d8-b79c02c40868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c02fc93-43')
Aug 01 18:34:38 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Deleting instance files /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88_del
Aug 01 18:34:38 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Deletion of /opt/stack/data/nova/instances/441a61de-ad9d-412d-95f3-882cef273e88_del complete
Aug 01 18:34:38 user nova-compute[72150]: INFO nova.compute.manager [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 01 18:34:38 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:34:38 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:34:38 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:34:38 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:34:38 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:34:38 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:34:39 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:34:39 user nova-compute[72150]: DEBUG nova.compute.manager [req-ab2a1bb0-b88b-4820-9666-50efdaeb57bf req-6d7de53d-3bde-4f5d-bb3d-ff681255a084 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Received event network-vif-deleted-9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:34:39 user nova-compute[72150]: INFO nova.compute.manager [req-ab2a1bb0-b88b-4820-9666-50efdaeb57bf req-6d7de53d-3bde-4f5d-bb3d-ff681255a084 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Neutron deleted interface 9c02fc93-434e-4e02-8855-14348e691115; detaching it from the instance and deleting it from the info cache
Aug 01 18:34:39 user nova-compute[72150]: DEBUG nova.network.neutron [req-ab2a1bb0-b88b-4820-9666-50efdaeb57bf req-6d7de53d-3bde-4f5d-bb3d-ff681255a084 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:34:39 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Took 0.90 seconds to deallocate network for instance.
Aug 01 18:34:39 user nova-compute[72150]: DEBUG nova.compute.manager [req-ab2a1bb0-b88b-4820-9666-50efdaeb57bf req-6d7de53d-3bde-4f5d-bb3d-ff681255a084 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Detach interface failed, port_id=9c02fc93-434e-4e02-8855-14348e691115, reason: Instance 441a61de-ad9d-412d-95f3-882cef273e88 could not be found. {{(pid=72150) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 18:34:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:39 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:34:39 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:34:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:39 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Deleted allocations for instance 441a61de-ad9d-412d-95f3-882cef273e88
Aug 01 18:34:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-eebfb201-b754-436d-9457-56e1db763122 tempest-AttachVolumeShelveTestJSON-1849821930 tempest-AttachVolumeShelveTestJSON-1849821930-project-member] Lock "441a61de-ad9d-412d-95f3-882cef273e88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.191s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:39 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:34:39 user nova-compute[72150]: DEBUG nova.compute.manager [req-73d499eb-5252-4e6b-81a8-7bf5412ef582 req-49bab159-e7a1-43a5-9a7d-20f48de2b549 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Received event network-vif-plugged-9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:34:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-73d499eb-5252-4e6b-81a8-7bf5412ef582 req-49bab159-e7a1-43a5-9a7d-20f48de2b549 service nova] Acquiring lock "441a61de-ad9d-412d-95f3-882cef273e88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-73d499eb-5252-4e6b-81a8-7bf5412ef582 req-49bab159-e7a1-43a5-9a7d-20f48de2b549 service nova] Lock "441a61de-ad9d-412d-95f3-882cef273e88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-73d499eb-5252-4e6b-81a8-7bf5412ef582 req-49bab159-e7a1-43a5-9a7d-20f48de2b549 service nova] Lock "441a61de-ad9d-412d-95f3-882cef273e88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:39 user nova-compute[72150]: DEBUG nova.compute.manager [req-73d499eb-5252-4e6b-81a8-7bf5412ef582 req-49bab159-e7a1-43a5-9a7d-20f48de2b549 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] No waiting events found dispatching network-vif-plugged-9c02fc93-434e-4e02-8855-14348e691115 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:34:39 user nova-compute[72150]: WARNING nova.compute.manager [req-73d499eb-5252-4e6b-81a8-7bf5412ef582 req-49bab159-e7a1-43a5-9a7d-20f48de2b549 service nova] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Received unexpected event network-vif-plugged-9c02fc93-434e-4e02-8855-14348e691115 for instance with vm_state deleted and task_state None.
Aug 01 18:34:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:39 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:34:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:34:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG nova.compute.manager [req-619da7d1-e9f3-4b32-b281-29c4f10e77f9 req-884bc25a-5913-4924-9545-8382b741ea02 service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Received event network-changed-0558e7ef-e6d8-48fa-a27a-910bd9535e71 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG nova.compute.manager [req-619da7d1-e9f3-4b32-b281-29c4f10e77f9 req-884bc25a-5913-4924-9545-8382b741ea02 service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Refreshing instance network info cache due to event network-changed-0558e7ef-e6d8-48fa-a27a-910bd9535e71. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-619da7d1-e9f3-4b32-b281-29c4f10e77f9 req-884bc25a-5913-4924-9545-8382b741ea02 service nova] Acquiring lock "refresh_cache-b10328c7-3328-4c3c-8ebe-3dd282ece0c9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-619da7d1-e9f3-4b32-b281-29c4f10e77f9 req-884bc25a-5913-4924-9545-8382b741ea02 service nova] Acquired lock "refresh_cache-b10328c7-3328-4c3c-8ebe-3dd282ece0c9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG nova.network.neutron [req-619da7d1-e9f3-4b32-b281-29c4f10e77f9 req-884bc25a-5913-4924-9545-8382b741ea02 service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Refreshing network info cache for port 0558e7ef-e6d8-48fa-a27a-910bd9535e71 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG nova.network.neutron [req-619da7d1-e9f3-4b32-b281-29c4f10e77f9 req-884bc25a-5913-4924-9545-8382b741ea02 service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Updated VIF entry in instance network info cache for port 0558e7ef-e6d8-48fa-a27a-910bd9535e71. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG nova.network.neutron [req-619da7d1-e9f3-4b32-b281-29c4f10e77f9 req-884bc25a-5913-4924-9545-8382b741ea02 service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Updating instance_info_cache with network_info: [{"id": "0558e7ef-e6d8-48fa-a27a-910bd9535e71", "address": "fa:16:3e:f6:d1:22", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0558e7ef-e6", "ovs_interfaceid": "0558e7ef-e6d8-48fa-a27a-910bd9535e71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-619da7d1-e9f3-4b32-b281-29c4f10e77f9 req-884bc25a-5913-4924-9545-8382b741ea02 service nova] Releasing lock "refresh_cache-b10328c7-3328-4c3c-8ebe-3dd282ece0c9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b12a0-6673-4e12-b23c-73141346dd83/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b12a0-6673-4e12-b23c-73141346dd83/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b12a0-6673-4e12-b23c-73141346dd83/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b12a0-6673-4e12-b23c-73141346dd83/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:43 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:34:43 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:34:43 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=7085MB free_disk=25.178836822509766GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:34:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 769690c8-53c5-4057-88a5-fbdbcb930e32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ea68420b-8362-4df3-b710-cd1cf76adba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 08851ec4-6f71-4ec1-a092-42aab83ee87f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance bf2d1f14-2227-41d1-bd73-a05ab3149aba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ceee3912-ca68-4b15-8fe6-985d905e8128 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 42e75a98-beb1-4688-a375-affc63b14252 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance eb113972-7a86-4cb7-9f8d-ca690693e27d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance a5f0eca7-d060-4226-b36e-a3cd15b15703 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance b10328c7-3328-4c3c-8ebe-3dd282ece0c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 65b04144-3b1f-4975-8524-2c9f9660672a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 7e5b12a0-6673-4e12-b23c-73141346dd83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquiring lock "ceee3912-ca68-4b15-8fe6-985d905e8128" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquiring lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:44 user nova-compute[72150]: INFO nova.compute.manager [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Terminating instance
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.compute.manager [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.558s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-01dbef13-b763-45bf-b11c-fa3c6b02b54b req-753f9faf-724f-4e8d-8a0d-25c8c19e32fa service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received event network-vif-unplugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-01dbef13-b763-45bf-b11c-fa3c6b02b54b req-753f9faf-724f-4e8d-8a0d-25c8c19e32fa service nova] Acquiring lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-01dbef13-b763-45bf-b11c-fa3c6b02b54b req-753f9faf-724f-4e8d-8a0d-25c8c19e32fa service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-01dbef13-b763-45bf-b11c-fa3c6b02b54b req-753f9faf-724f-4e8d-8a0d-25c8c19e32fa service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-01dbef13-b763-45bf-b11c-fa3c6b02b54b req-753f9faf-724f-4e8d-8a0d-25c8c19e32fa service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] No waiting events found dispatching network-vif-unplugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-01dbef13-b763-45bf-b11c-fa3c6b02b54b req-753f9faf-724f-4e8d-8a0d-25c8c19e32fa service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received event network-vif-unplugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:34:44 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Instance destroyed successfully.
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.objects.instance [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lazy-loading 'resources' on Instance uuid ceee3912-ca68-4b15-8fe6-985d905e8128 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:27:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1031087304',display_name='tempest-ServerStableDeviceRescueTest-server-1031087304',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1031087304',id=19,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXknm48O+sHdtxwG6tm4FYBXZP3XaIW2WM3AK91piLPeoMnQQ4qv/ck/RizkVbsO3RmdgJYcVKp+GZNypXSFhAn+S6lpUIGjz/mDUmenWQw+T1tA09bruOrFwdJDPcLiA==',key_name='tempest-keypair-409987953',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:31:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8759cb04dd744d7895a63bc5bd1d1c83',ramdisk_id='',reservation_id='r-t0lo8wvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1141204139',owner_user_name='tempest-ServerStableDeviceRescueTest-1141204139-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:33:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e75ce9ed1ddf4011bf578b72580eedad',uuid=ceee3912-ca68-4b15-8fe6-985d905e8128,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "address": "fa:16:3e:e0:04:f1", "network": {"id": "838d4cba-b00d-46ff-ad55-9d7dd511581a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-732384801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8759cb04dd744d7895a63bc5bd1d1c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee07a0f4-22", "ovs_interfaceid": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Converting VIF {"id": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "address": "fa:16:3e:e0:04:f1", "network": {"id": "838d4cba-b00d-46ff-ad55-9d7dd511581a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-732384801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8759cb04dd744d7895a63bc5bd1d1c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee07a0f4-22", "ovs_interfaceid": "ee07a0f4-222d-4863-92b2-f70a7afd75f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:04:f1,bridge_name='br-int',has_traffic_filtering=True,id=ee07a0f4-222d-4863-92b2-f70a7afd75f1,network=Network(838d4cba-b00d-46ff-ad55-9d7dd511581a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee07a0f4-22') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG os_vif [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:04:f1,bridge_name='br-int',has_traffic_filtering=True,id=ee07a0f4-222d-4863-92b2-f70a7afd75f1,network=Network(838d4cba-b00d-46ff-ad55-9d7dd511581a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee07a0f4-22') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee07a0f4-22, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:34:44 user nova-compute[72150]: INFO os_vif [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:04:f1,bridge_name='br-int',has_traffic_filtering=True,id=ee07a0f4-222d-4863-92b2-f70a7afd75f1,network=Network(838d4cba-b00d-46ff-ad55-9d7dd511581a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee07a0f4-22')
Aug 01 18:34:44 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Deleting instance files /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128_del
Aug 01 18:34:44 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Deletion of /opt/stack/data/nova/instances/ceee3912-ca68-4b15-8fe6-985d905e8128_del complete
Aug 01 18:34:44 user nova-compute[72150]: INFO nova.compute.manager [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 01 18:34:44 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:34:44 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG nova.objects.instance [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lazy-loading 'flavor' on Instance uuid b10328c7-3328-4c3c-8ebe-3dd282ece0c9 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:45 user nova-compute[72150]: INFO nova.compute.manager [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Attaching volume 489f01df-bee5-47d2-a63a-8f1445b81f73 to /dev/vdb
Aug 01 18:34:45 user nova-compute[72150]: DEBUG os_brick.utils [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[54291cf1-bc9c-4586-b80b-7136a280b4f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f58687-ec3e-4358-9e6e-dd250430f20f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba21c0bd-2e29-4cbf-8ac9-11743bcdbdc2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bf2a6a-371f-45ab-a0d5-741563038178]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:34:45 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[981064d8-535f-4394-819b-2e53fd4065ad]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG os_brick.utils [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Updating existing volume attachment record: cb602a5d-33dd-4199-bf5b-c7e669c65571 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-08851ec4-6f71-4ec1-a092-42aab83ee87f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-08851ec4-6f71-4ec1-a092-42aab83ee87f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:34:45 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:34:46 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:34:46 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Took 1.06 seconds to deallocate network for instance.
Aug 01 18:34:46 user nova-compute[72150]: DEBUG nova.compute.manager [req-123b4a00-d280-43a2-8dec-c0d0abe8a5a5 req-0b5eee82-1ff0-46a5-b017-0c1377b7c22e service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received event network-vif-deleted-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:34:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:46 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Updating instance_info_cache with network_info: [{"id": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "address": "fa:16:3e:e4:fb:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c860dfa-73", "ovs_interfaceid": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:34:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-08851ec4-6f71-4ec1-a092-42aab83ee87f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:34:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:34:46 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:34:46 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:34:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:34:46 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:34:46 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:34:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:46 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Deleted allocations for instance ceee3912-ca68-4b15-8fe6-985d905e8128
Aug 01 18:34:46 user nova-compute[72150]: DEBUG nova.compute.manager [req-cfb0caca-6157-4320-8cc8-0cbd145c45fc req-dd2e3978-1402-4418-a7d5-ec01c8ac65c4 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received event network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:34:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-cfb0caca-6157-4320-8cc8-0cbd145c45fc req-dd2e3978-1402-4418-a7d5-ec01c8ac65c4 service nova] Acquiring lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-cfb0caca-6157-4320-8cc8-0cbd145c45fc req-dd2e3978-1402-4418-a7d5-ec01c8ac65c4 service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-cfb0caca-6157-4320-8cc8-0cbd145c45fc req-dd2e3978-1402-4418-a7d5-ec01c8ac65c4 service nova] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:46 user nova-compute[72150]: DEBUG nova.compute.manager [req-cfb0caca-6157-4320-8cc8-0cbd145c45fc req-dd2e3978-1402-4418-a7d5-ec01c8ac65c4 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] No waiting events found dispatching network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:34:46 user nova-compute[72150]: WARNING nova.compute.manager [req-cfb0caca-6157-4320-8cc8-0cbd145c45fc req-dd2e3978-1402-4418-a7d5-ec01c8ac65c4 service nova] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Received unexpected event network-vif-plugged-ee07a0f4-222d-4863-92b2-f70a7afd75f1 for instance with vm_state deleted and task_state None.
Aug 01 18:34:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-2c248450-e8f1-4056-8a96-c8c863730bc1 tempest-ServerStableDeviceRescueTest-1141204139 tempest-ServerStableDeviceRescueTest-1141204139-project-member] Lock "ceee3912-ca68-4b15-8fe6-985d905e8128" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.508s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "eb113972-7a86-4cb7-9f8d-ca690693e27d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:47 user nova-compute[72150]: INFO nova.compute.manager [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Terminating instance
Aug 01 18:34:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:34:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:48 user nova-compute[72150]: DEBUG nova.compute.manager [req-9eb45aa5-4c98-433a-95a4-66ad5ada2627 req-cf0848a6-b5fa-4e28-b90f-d335957c39fc service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Received event network-vif-unplugged-a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:34:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9eb45aa5-4c98-433a-95a4-66ad5ada2627 req-cf0848a6-b5fa-4e28-b90f-d335957c39fc service nova] Acquiring lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9eb45aa5-4c98-433a-95a4-66ad5ada2627 req-cf0848a6-b5fa-4e28-b90f-d335957c39fc service nova] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9eb45aa5-4c98-433a-95a4-66ad5ada2627 req-cf0848a6-b5fa-4e28-b90f-d335957c39fc service nova] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:48 user nova-compute[72150]: DEBUG nova.compute.manager [req-9eb45aa5-4c98-433a-95a4-66ad5ada2627 req-cf0848a6-b5fa-4e28-b90f-d335957c39fc service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] No waiting events found dispatching network-vif-unplugged-a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:34:48 user nova-compute[72150]: DEBUG nova.compute.manager [req-9eb45aa5-4c98-433a-95a4-66ad5ada2627 req-cf0848a6-b5fa-4e28-b90f-d335957c39fc service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Received event network-vif-unplugged-a519018d-4c4e-4d06-ba14-c2d2054529ea for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:34:48 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Instance destroyed successfully.
Aug 01 18:34:48 user nova-compute[72150]: DEBUG nova.objects.instance [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lazy-loading 'resources' on Instance uuid eb113972-7a86-4cb7-9f8d-ca690693e27d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:34:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:29:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1800718826',display_name='tempest-TestMinimumBasicScenario-server-1800718826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1800718826',id=24,image_ref='4bc70f80-a2f7-482d-8395-58908ca01d7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8oPReI02FuGINag0FKlnJ0joSVprUFqu+HGUn3O1VOzI1R8ynKFVjJ83L1heMbU56Gi4RSJnG1LS16jayyztjBp/Sg3G4J0y+mGh4i+3RWPcDlSy3MF3Vx7G6aTOKGrg==',key_name='tempest-TestMinimumBasicScenario-1923183796',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:29:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96498272792348f3a3c36ee8544100f2',ramdisk_id='',reservation_id='r-c0m3e17x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4bc70f80-a2f7-482d-8395-58908ca01d7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-879365140',owner_user_name='tempest-TestMinimumBasicScenario-879365140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:32:07Z,user_data=None,user_id='3d89a05b857d43c48f0767eb073a2f37',uuid=eb113972-7a86-4cb7-9f8d-ca690693e27d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "address": "fa:16:3e:b3:96:a5", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519018d-4c", "ovs_interfaceid": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:34:48 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Converting VIF {"id": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "address": "fa:16:3e:b3:96:a5", "network": {"id": "e3a4003a-4248-4265-b270-f289b1c2810f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-893904474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96498272792348f3a3c36ee8544100f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519018d-4c", "ovs_interfaceid": "a519018d-4c4e-4d06-ba14-c2d2054529ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:34:48 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:96:a5,bridge_name='br-int',has_traffic_filtering=True,id=a519018d-4c4e-4d06-ba14-c2d2054529ea,network=Network(e3a4003a-4248-4265-b270-f289b1c2810f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa519018d-4c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:34:48 user nova-compute[72150]: DEBUG os_vif [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:96:a5,bridge_name='br-int',has_traffic_filtering=True,id=a519018d-4c4e-4d06-ba14-c2d2054529ea,network=Network(e3a4003a-4248-4265-b270-f289b1c2810f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa519018d-4c') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:34:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa519018d-4c, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:34:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:48 user nova-compute[72150]: INFO os_vif [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:96:a5,bridge_name='br-int',has_traffic_filtering=True,id=a519018d-4c4e-4d06-ba14-c2d2054529ea,network=Network(e3a4003a-4248-4265-b270-f289b1c2810f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa519018d-4c')
Aug 01 18:34:48 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Deleting instance files /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d_del
Aug 01 18:34:48 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Deletion of /opt/stack/data/nova/instances/eb113972-7a86-4cb7-9f8d-ca690693e27d_del complete
Aug 01 18:34:48 user nova-compute[72150]: INFO nova.compute.manager [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 01 18:34:48 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:34:48 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:34:48 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:34:49 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:34:49 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Took 0.48 seconds to deallocate network for instance.
Aug 01 18:34:49 user nova-compute[72150]: DEBUG nova.compute.manager [req-87fffafc-ec0b-42a9-b139-1434c16b4ee6 req-ec147760-8d50-424c-a7f0-26fc7b675bea service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Received event network-vif-deleted-a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:34:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:49 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:34:49 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:34:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:49 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Deleted allocations for instance eb113972-7a86-4cb7-9f8d-ca690693e27d
Aug 01 18:34:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6cedc5b7-0d42-4ca1-b230-169d8795eb4f tempest-TestMinimumBasicScenario-879365140 tempest-TestMinimumBasicScenario-879365140-project-member] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.978s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-d9c4f67d-f115-4dca-8e3e-bcd4021fd079 req-e87a73ff-c3a1-4a3b-a03e-c6266dfc59fb service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Received event network-vif-plugged-a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:34:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d9c4f67d-f115-4dca-8e3e-bcd4021fd079 req-e87a73ff-c3a1-4a3b-a03e-c6266dfc59fb service nova] Acquiring lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d9c4f67d-f115-4dca-8e3e-bcd4021fd079 req-e87a73ff-c3a1-4a3b-a03e-c6266dfc59fb service nova] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d9c4f67d-f115-4dca-8e3e-bcd4021fd079 req-e87a73ff-c3a1-4a3b-a03e-c6266dfc59fb service nova] Lock "eb113972-7a86-4cb7-9f8d-ca690693e27d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-d9c4f67d-f115-4dca-8e3e-bcd4021fd079 req-e87a73ff-c3a1-4a3b-a03e-c6266dfc59fb service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] No waiting events found dispatching network-vif-plugged-a519018d-4c4e-4d06-ba14-c2d2054529ea {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:34:50 user nova-compute[72150]: WARNING nova.compute.manager [req-d9c4f67d-f115-4dca-8e3e-bcd4021fd079 req-e87a73ff-c3a1-4a3b-a03e-c6266dfc59fb service nova] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Received unexpected event network-vif-plugged-a519018d-4c4e-4d06-ba14-c2d2054529ea for instance with vm_state deleted and task_state None.
Aug 01 18:34:53 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914878.0598717, 441a61de-ad9d-412d-95f3-882cef273e88 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:34:53 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] VM Stopped (Lifecycle Event)
Aug 01 18:34:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-a9b7468c-05d9-4265-a480-06385ab2613a None None] [instance: 441a61de-ad9d-412d-95f3-882cef273e88] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKrXQAyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:34:53 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:34:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:34:53 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:34:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:34:53 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5419b6f9-5430-452a-81a2-5d3b8a679f0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:34:53 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a29fc0a-222d-46f2-8387-619e5110dd39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73] added
Aug 01 18:34:53 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8872102-b8cb-416e-9bee-aaf93a882e61]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f0c4f5-2b63-4c1d-bbe0-886b8b999adb]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TKrXQAyM {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TKrXQAyM" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9898cb87-ce1f-4c00-95ea-1a5d561e4416]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TKrXQAyM'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d017e5-96ce-4757-ac7d-9660167c2816]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aac1602-8392-4f29-a0ec-3617a5f6a09a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:34:53 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:34:53 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:34:53 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:34:53 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee2e308-1177-450c-b38e-d34015148655]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73, portal: 172.16.0.220,3260]
Aug 01 18:34:53 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73, portal: 172.16.0.220,3260] successful.
Aug 01 18:34:53 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a163560-5c3e-414f-ae16-673e33b7faeb]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fcf93c-3efa-4a5d-bbac-55cf655c3e3a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:34:53 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:34:53 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:34:53 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:34:53 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:34:53 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:34:53 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e3eef6-8e2b-4105-8166-d01c94e41f75]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:34:53 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: None {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:34:54 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:34:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKrXQAyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:34:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:34:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23734343132323130', 'path': '/dev/sdb'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:34:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734343132323130', 'path': '/dev/sdb'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:34:54 user nova-compute[72150]: DEBUG nova.objects.instance [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lazy-loading 'flavor' on Instance uuid b10328c7-3328-4c3c-8ebe-3dd282ece0c9 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:34:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:34:54 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:34:54 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 18:34:54 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:34:54 user nova-compute[72150]:   <serial>489f01df-bee5-47d2-a63a-8f1445b81f73</serial>
Aug 01 18:34:54 user nova-compute[72150]: </disk>
Aug 01 18:34:54 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:34:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:34:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:34:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] No VIF found with MAC fa:16:3e:f6:d1:22, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:34:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-de6536c7-688e-482f-b50c-bf36627d4d48 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.065s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "fd12a8f9-593d-4e48-97f8-64e210d46d77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "fd12a8f9-593d-4e48-97f8-64e210d46d77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:34:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:34:58 user nova-compute[72150]: INFO nova.compute.claims [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Claim successful on node user
Aug 01 18:34:58 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:34:58 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:34:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:34:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:34:58 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:34:58 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:34:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:34:58 user nova-compute[72150]: DEBUG nova.policy [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f11bcc2f9cc048beb928fc0d3c30403e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bad8c4e2a74caf8d35ad98e7888266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:34:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:34:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:34:58 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Creating image(s)
Aug 01 18:34:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd12a8f9-593d-4e48-97f8-64e210d46d77/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "/opt/stack/data/nova/instances/fd12a8f9-593d-4e48-97f8-64e210d46d77/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "/opt/stack/data/nova/instances/fd12a8f9-593d-4e48-97f8-64e210d46d77/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/fd12a8f9-593d-4e48-97f8-64e210d46d77/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/fd12a8f9-593d-4e48-97f8-64e210d46d77/disk 1073741824" returned: 0 in 0.049s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.147s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd12a8f9-593d-4e48-97f8-64e210d46d77/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd12a8f9-593d-4e48-97f8-64e210d46d77/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd12a8f9-593d-4e48-97f8-64e210d46d77/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Cannot resize image /opt/stack/data/nova/instances/fd12a8f9-593d-4e48-97f8-64e210d46d77/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG nova.objects.instance [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lazy-loading 'migration_context' on Instance uuid fd12a8f9-593d-4e48-97f8-64e210d46d77 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Ensure instance console log exists: /opt/stack/data/nova/instances/fd12a8f9-593d-4e48-97f8-64e210d46d77/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914884.8993356, ceee3912-ca68-4b15-8fe6-985d905e8128 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:34:59 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] VM Stopped (Lifecycle Event)
Aug 01 18:34:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:34:59 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:34:59 user nova-compute[72150]: INFO nova.compute.claims [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Claim successful on node user
Aug 01 18:34:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-62c56f61-fc1e-4e42-b4bf-abbd54355195 None None] [instance: ceee3912-ca68-4b15-8fe6-985d905e8128] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:35:00 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Successfully created port: 9478d2ba-2463-48fc-a572-a162788e22c3 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:35:00 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:35:00 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:35:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:00 user nova-compute[72150]: DEBUG nova.compute.manager [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:35:00 user nova-compute[72150]: DEBUG nova.compute.manager [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:35:00 user nova-compute[72150]: DEBUG nova.network.neutron [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:35:00 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:35:00 user nova-compute[72150]: DEBUG nova.compute.manager [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:35:00 user nova-compute[72150]: DEBUG nova.policy [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc00b9006f5842c6b875c5d25538b718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad8ef64d051424e9fe644a1fb40fcb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:35:00 user nova-compute[72150]: DEBUG nova.compute.manager [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:35:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:35:00 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Creating image(s)
Aug 01 18:35:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "/opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "/opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Successfully updated port: 9478d2ba-2463-48fc-a572-a162788e22c3 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "refresh_cache-fd12a8f9-593d-4e48-97f8-64e210d46d77" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquired lock "refresh_cache-fd12a8f9-593d-4e48-97f8-64e210d46d77" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.149s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.compute.manager [req-666c13a2-46b4-4a11-835c-7a947ce427f7 req-84912435-0aa2-4402-bba5-eb5c23cc153e service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Received event network-changed-9478d2ba-2463-48fc-a572-a162788e22c3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.compute.manager [req-666c13a2-46b4-4a11-835c-7a947ce427f7 req-84912435-0aa2-4402-bba5-eb5c23cc153e service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Refreshing instance network info cache due to event network-changed-9478d2ba-2463-48fc-a572-a162788e22c3. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-666c13a2-46b4-4a11-835c-7a947ce427f7 req-84912435-0aa2-4402-bba5-eb5c23cc153e service nova] Acquiring lock "refresh_cache-fd12a8f9-593d-4e48-97f8-64e210d46d77" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk 1073741824" returned: 0 in 0.060s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.network.neutron [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Successfully created port: 4cc0118a-e179-46b8-916b-b705b8568daa {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Cannot resize image /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.objects.instance [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'migration_context' on Instance uuid d2117837-5552-4ec3-9f9b-62629c1ff4cb {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Ensure instance console log exists: /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Updating instance_info_cache with network_info: [{"id": "9478d2ba-2463-48fc-a572-a162788e22c3", "address": "fa:16:3e:38:92:c3", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9478d2ba-24", "ovs_interfaceid": "9478d2ba-2463-48fc-a572-a162788e22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Releasing lock "refresh_cache-fd12a8f9-593d-4e48-97f8-64e210d46d77" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Instance network_info: |[{"id": "9478d2ba-2463-48fc-a572-a162788e22c3", "address": "fa:16:3e:38:92:c3", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9478d2ba-24", "ovs_interfaceid": "9478d2ba-2463-48fc-a572-a162788e22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-666c13a2-46b4-4a11-835c-7a947ce427f7 req-84912435-0aa2-4402-bba5-eb5c23cc153e service nova] Acquired lock "refresh_cache-fd12a8f9-593d-4e48-97f8-64e210d46d77" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.network.neutron [req-666c13a2-46b4-4a11-835c-7a947ce427f7 req-84912435-0aa2-4402-bba5-eb5c23cc153e service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Refreshing network info cache for port 9478d2ba-2463-48fc-a572-a162788e22c3 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Start _get_guest_xml network_info=[{"id": "9478d2ba-2463-48fc-a572-a162788e22c3", "address": "fa:16:3e:38:92:c3", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9478d2ba-24", "ovs_interfaceid": "9478d2ba-2463-48fc-a572-a162788e22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:35:01 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:35:01 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:34:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2064079036',display_name='tempest-AttachVolumeNegativeTest-server-2064079036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2064079036',id=30,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBu0JOY2VhCFH2ZfZz3TVbtKO6Srcvjl6d8IR+3sF6wWYYTNOKGabCWVjf3bt/bpBeMz4RXWGsJcTA0j7QIJ36ZSvbzPr9921ZZlvaZL69wp9DflJHw6OW81OgmViCL1Bg==',key_name='tempest-keypair-230423268',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66bad8c4e2a74caf8d35ad98e7888266',ramdisk_id='',reservation_id='r-pwifie1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-504132593',owner_user_name='tempest-AttachVolumeNegativeTest-504132593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f11bcc2f9cc048beb928fc0d3c30403e',uuid=fd12a8f9-593d-4e48-97f8-64e210d46d77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9478d2ba-2463-48fc-a572-a162788e22c3", "address": "fa:16:3e:38:92:c3", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9478d2ba-24", "ovs_interfaceid": "9478d2ba-2463-48fc-a572-a162788e22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converting VIF {"id": "9478d2ba-2463-48fc-a572-a162788e22c3", "address": "fa:16:3e:38:92:c3", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9478d2ba-24", "ovs_interfaceid": "9478d2ba-2463-48fc-a572-a162788e22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:92:c3,bridge_name='br-int',has_traffic_filtering=True,id=9478d2ba-2463-48fc-a572-a162788e22c3,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9478d2ba-24') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.objects.instance [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lazy-loading 'pci_devices' on Instance uuid fd12a8f9-593d-4e48-97f8-64e210d46d77 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:35:01 user nova-compute[72150]:   <uuid>fd12a8f9-593d-4e48-97f8-64e210d46d77</uuid>
Aug 01 18:35:01 user nova-compute[72150]:   <name>instance-0000001e</name>
Aug 01 18:35:01 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:35:01 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:35:01 user nova-compute[72150]:   <metadata>
Aug 01 18:35:01 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:35:01 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:35:01 user nova-compute[72150]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2064079036</nova:name>
Aug 01 18:35:01 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:35:01</nova:creationTime>
Aug 01 18:35:01 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:35:01 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:35:01 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:35:01 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:35:01 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:35:01 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:35:01 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:35:01 user nova-compute[72150]:       <nova:owner>
Aug 01 18:35:01 user nova-compute[72150]:         <nova:user uuid="f11bcc2f9cc048beb928fc0d3c30403e">tempest-AttachVolumeNegativeTest-504132593-project-member</nova:user>
Aug 01 18:35:01 user nova-compute[72150]:         <nova:project uuid="66bad8c4e2a74caf8d35ad98e7888266">tempest-AttachVolumeNegativeTest-504132593</nova:project>
Aug 01 18:35:01 user nova-compute[72150]:       </nova:owner>
Aug 01 18:35:01 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:35:01 user nova-compute[72150]:       <nova:ports>
Aug 01 18:35:01 user nova-compute[72150]:         <nova:port uuid="9478d2ba-2463-48fc-a572-a162788e22c3">
Aug 01 18:35:01 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 18:35:01 user nova-compute[72150]:         </nova:port>
Aug 01 18:35:01 user nova-compute[72150]:       </nova:ports>
Aug 01 18:35:01 user nova-compute[72150]:     </nova:instance>
Aug 01 18:35:01 user nova-compute[72150]:   </metadata>
Aug 01 18:35:01 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:35:01 user nova-compute[72150]:     <system>
Aug 01 18:35:01 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:35:01 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:35:01 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:35:01 user nova-compute[72150]:       <entry name="serial">fd12a8f9-593d-4e48-97f8-64e210d46d77</entry>
Aug 01 18:35:01 user nova-compute[72150]:       <entry name="uuid">fd12a8f9-593d-4e48-97f8-64e210d46d77</entry>
Aug 01 18:35:01 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:35:01 user nova-compute[72150]:     </system>
Aug 01 18:35:01 user nova-compute[72150]:   </sysinfo>
Aug 01 18:35:01 user nova-compute[72150]:   <os>
Aug 01 18:35:01 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:35:01 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:35:01 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:35:01 user nova-compute[72150]:   </os>
Aug 01 18:35:01 user nova-compute[72150]:   <features>
Aug 01 18:35:01 user nova-compute[72150]:     <acpi/>
Aug 01 18:35:01 user nova-compute[72150]:     <apic/>
Aug 01 18:35:01 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:35:01 user nova-compute[72150]:   </features>
Aug 01 18:35:01 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:35:01 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:35:01 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:35:01 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:35:01 user nova-compute[72150]:   </clock>
Aug 01 18:35:01 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:35:01 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:35:01 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:35:01 user nova-compute[72150]:   </cpu>
Aug 01 18:35:01 user nova-compute[72150]:   <devices>
Aug 01 18:35:01 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:35:01 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:35:01 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/fd12a8f9-593d-4e48-97f8-64e210d46d77/disk"/>
Aug 01 18:35:01 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:35:01 user nova-compute[72150]:     </disk>
Aug 01 18:35:01 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:35:01 user nova-compute[72150]:       <mac address="fa:16:3e:38:92:c3"/>
Aug 01 18:35:01 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:35:01 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:35:01 user nova-compute[72150]:       <target dev="tap9478d2ba-24"/>
Aug 01 18:35:01 user nova-compute[72150]:     </interface>
Aug 01 18:35:01 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:35:01 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/fd12a8f9-593d-4e48-97f8-64e210d46d77/console.log" append="off"/>
Aug 01 18:35:01 user nova-compute[72150]:     </serial>
Aug 01 18:35:01 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:35:01 user nova-compute[72150]:     <video>
Aug 01 18:35:01 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:35:01 user nova-compute[72150]:     </video>
Aug 01 18:35:01 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:35:01 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:35:01 user nova-compute[72150]:     </rng>
Aug 01 18:35:01 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:35:01 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:35:01 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:35:01 user nova-compute[72150]:     </memballoon>
Aug 01 18:35:01 user nova-compute[72150]:   </devices>
Aug 01 18:35:01 user nova-compute[72150]: </domain>
Aug 01 18:35:01 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:34:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2064079036',display_name='tempest-AttachVolumeNegativeTest-server-2064079036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2064079036',id=30,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBu0JOY2VhCFH2ZfZz3TVbtKO6Srcvjl6d8IR+3sF6wWYYTNOKGabCWVjf3bt/bpBeMz4RXWGsJcTA0j7QIJ36ZSvbzPr9921ZZlvaZL69wp9DflJHw6OW81OgmViCL1Bg==',key_name='tempest-keypair-230423268',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66bad8c4e2a74caf8d35ad98e7888266',ramdisk_id='',reservation_id='r-pwifie1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-504132593',owner_user_name='tempest-AttachVolumeNegativeTest-504132593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f11bcc2f9cc048beb928fc0d3c30403e',uuid=fd12a8f9-593d-4e48-97f8-64e210d46d77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9478d2ba-2463-48fc-a572-a162788e22c3", "address": "fa:16:3e:38:92:c3", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9478d2ba-24", "ovs_interfaceid": "9478d2ba-2463-48fc-a572-a162788e22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converting VIF {"id": "9478d2ba-2463-48fc-a572-a162788e22c3", "address": "fa:16:3e:38:92:c3", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9478d2ba-24", "ovs_interfaceid": "9478d2ba-2463-48fc-a572-a162788e22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:92:c3,bridge_name='br-int',has_traffic_filtering=True,id=9478d2ba-2463-48fc-a572-a162788e22c3,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9478d2ba-24') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG os_vif [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:92:c3,bridge_name='br-int',has_traffic_filtering=True,id=9478d2ba-2463-48fc-a572-a162788e22c3,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9478d2ba-24') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9478d2ba-24, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9478d2ba-24, col_values=(('external_ids', {'iface-id': '9478d2ba-2463-48fc-a572-a162788e22c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:92:c3', 'vm-uuid': 'fd12a8f9-593d-4e48-97f8-64e210d46d77'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:01 user nova-compute[72150]: INFO os_vif [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:92:c3,bridge_name='br-int',has_traffic_filtering=True,id=9478d2ba-2463-48fc-a572-a162788e22c3,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9478d2ba-24')
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:35:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] No VIF found with MAC fa:16:3e:38:92:c3, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.network.neutron [req-666c13a2-46b4-4a11-835c-7a947ce427f7 req-84912435-0aa2-4402-bba5-eb5c23cc153e service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Updated VIF entry in instance network info cache for port 9478d2ba-2463-48fc-a572-a162788e22c3. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.network.neutron [req-666c13a2-46b4-4a11-835c-7a947ce427f7 req-84912435-0aa2-4402-bba5-eb5c23cc153e service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Updating instance_info_cache with network_info: [{"id": "9478d2ba-2463-48fc-a572-a162788e22c3", "address": "fa:16:3e:38:92:c3", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9478d2ba-24", "ovs_interfaceid": "9478d2ba-2463-48fc-a572-a162788e22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-666c13a2-46b4-4a11-835c-7a947ce427f7 req-84912435-0aa2-4402-bba5-eb5c23cc153e service nova] Releasing lock "refresh_cache-fd12a8f9-593d-4e48-97f8-64e210d46d77" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.network.neutron [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Successfully updated port: 4cc0118a-e179-46b8-916b-b705b8568daa {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "refresh_cache-d2117837-5552-4ec3-9f9b-62629c1ff4cb" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquired lock "refresh_cache-d2117837-5552-4ec3-9f9b-62629c1ff4cb" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.network.neutron [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.compute.manager [req-79d47c04-a723-4e0b-ac12-e0be5d2edde5 req-1a2fa848-c2f8-459e-879d-7000aa529561 service nova] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Received event network-changed-4cc0118a-e179-46b8-916b-b705b8568daa {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.compute.manager [req-79d47c04-a723-4e0b-ac12-e0be5d2edde5 req-1a2fa848-c2f8-459e-879d-7000aa529561 service nova] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Refreshing instance network info cache due to event network-changed-4cc0118a-e179-46b8-916b-b705b8568daa. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-79d47c04-a723-4e0b-ac12-e0be5d2edde5 req-1a2fa848-c2f8-459e-879d-7000aa529561 service nova] Acquiring lock "refresh_cache-d2117837-5552-4ec3-9f9b-62629c1ff4cb" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.network.neutron [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.network.neutron [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Updating instance_info_cache with network_info: [{"id": "4cc0118a-e179-46b8-916b-b705b8568daa", "address": "fa:16:3e:c7:1f:09", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0118a-e1", "ovs_interfaceid": "4cc0118a-e179-46b8-916b-b705b8568daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Releasing lock "refresh_cache-d2117837-5552-4ec3-9f9b-62629c1ff4cb" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.compute.manager [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Instance network_info: |[{"id": "4cc0118a-e179-46b8-916b-b705b8568daa", "address": "fa:16:3e:c7:1f:09", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0118a-e1", "ovs_interfaceid": "4cc0118a-e179-46b8-916b-b705b8568daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-79d47c04-a723-4e0b-ac12-e0be5d2edde5 req-1a2fa848-c2f8-459e-879d-7000aa529561 service nova] Acquired lock "refresh_cache-d2117837-5552-4ec3-9f9b-62629c1ff4cb" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.network.neutron [req-79d47c04-a723-4e0b-ac12-e0be5d2edde5 req-1a2fa848-c2f8-459e-879d-7000aa529561 service nova] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Refreshing network info cache for port 4cc0118a-e179-46b8-916b-b705b8568daa {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Start _get_guest_xml network_info=[{"id": "4cc0118a-e179-46b8-916b-b705b8568daa", "address": "fa:16:3e:c7:1f:09", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0118a-e1", "ovs_interfaceid": "4cc0118a-e179-46b8-916b-b705b8568daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:35:02 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:35:02 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:34:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-900314610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-900314610',id=31,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ad8ef64d051424e9fe644a1fb40fcb4',ramdisk_id='',reservation_id='r-pq3gqg00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-23372548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:35:01Z,user_data=None,user_id='cc00b9006f5842c6b875c5d25538b718',uuid=d2117837-5552-4ec3-9f9b-62629c1ff4cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cc0118a-e179-46b8-916b-b705b8568daa", "address": "fa:16:3e:c7:1f:09", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0118a-e1", "ovs_interfaceid": "4cc0118a-e179-46b8-916b-b705b8568daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converting VIF {"id": "4cc0118a-e179-46b8-916b-b705b8568daa", "address": "fa:16:3e:c7:1f:09", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0118a-e1", "ovs_interfaceid": "4cc0118a-e179-46b8-916b-b705b8568daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:1f:09,bridge_name='br-int',has_traffic_filtering=True,id=4cc0118a-e179-46b8-916b-b705b8568daa,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc0118a-e1') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.objects.instance [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'pci_devices' on Instance uuid d2117837-5552-4ec3-9f9b-62629c1ff4cb {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:35:02 user nova-compute[72150]:   <uuid>d2117837-5552-4ec3-9f9b-62629c1ff4cb</uuid>
Aug 01 18:35:02 user nova-compute[72150]:   <name>instance-0000001f</name>
Aug 01 18:35:02 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:35:02 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:35:02 user nova-compute[72150]:   <metadata>
Aug 01 18:35:02 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:35:02 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:35:02 user nova-compute[72150]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-900314610</nova:name>
Aug 01 18:35:02 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:35:02</nova:creationTime>
Aug 01 18:35:02 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:35:02 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:35:02 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:35:02 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:35:02 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:35:02 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:35:02 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:35:02 user nova-compute[72150]:       <nova:owner>
Aug 01 18:35:02 user nova-compute[72150]:         <nova:user uuid="cc00b9006f5842c6b875c5d25538b718">tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member</nova:user>
Aug 01 18:35:02 user nova-compute[72150]:         <nova:project uuid="5ad8ef64d051424e9fe644a1fb40fcb4">tempest-ServerBootFromVolumeStableRescueTest-23372548</nova:project>
Aug 01 18:35:02 user nova-compute[72150]:       </nova:owner>
Aug 01 18:35:02 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:35:02 user nova-compute[72150]:       <nova:ports>
Aug 01 18:35:02 user nova-compute[72150]:         <nova:port uuid="4cc0118a-e179-46b8-916b-b705b8568daa">
Aug 01 18:35:02 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 18:35:02 user nova-compute[72150]:         </nova:port>
Aug 01 18:35:02 user nova-compute[72150]:       </nova:ports>
Aug 01 18:35:02 user nova-compute[72150]:     </nova:instance>
Aug 01 18:35:02 user nova-compute[72150]:   </metadata>
Aug 01 18:35:02 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:35:02 user nova-compute[72150]:     <system>
Aug 01 18:35:02 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:35:02 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:35:02 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:35:02 user nova-compute[72150]:       <entry name="serial">d2117837-5552-4ec3-9f9b-62629c1ff4cb</entry>
Aug 01 18:35:02 user nova-compute[72150]:       <entry name="uuid">d2117837-5552-4ec3-9f9b-62629c1ff4cb</entry>
Aug 01 18:35:02 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:35:02 user nova-compute[72150]:     </system>
Aug 01 18:35:02 user nova-compute[72150]:   </sysinfo>
Aug 01 18:35:02 user nova-compute[72150]:   <os>
Aug 01 18:35:02 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:35:02 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:35:02 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:35:02 user nova-compute[72150]:   </os>
Aug 01 18:35:02 user nova-compute[72150]:   <features>
Aug 01 18:35:02 user nova-compute[72150]:     <acpi/>
Aug 01 18:35:02 user nova-compute[72150]:     <apic/>
Aug 01 18:35:02 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:35:02 user nova-compute[72150]:   </features>
Aug 01 18:35:02 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:35:02 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:35:02 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:35:02 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:35:02 user nova-compute[72150]:   </clock>
Aug 01 18:35:02 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:35:02 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:35:02 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:35:02 user nova-compute[72150]:   </cpu>
Aug 01 18:35:02 user nova-compute[72150]:   <devices>
Aug 01 18:35:02 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:35:02 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:35:02 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk"/>
Aug 01 18:35:02 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:35:02 user nova-compute[72150]:     </disk>
Aug 01 18:35:02 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:35:02 user nova-compute[72150]:       <mac address="fa:16:3e:c7:1f:09"/>
Aug 01 18:35:02 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:35:02 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:35:02 user nova-compute[72150]:       <target dev="tap4cc0118a-e1"/>
Aug 01 18:35:02 user nova-compute[72150]:     </interface>
Aug 01 18:35:02 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:35:02 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/console.log" append="off"/>
Aug 01 18:35:02 user nova-compute[72150]:     </serial>
Aug 01 18:35:02 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:35:02 user nova-compute[72150]:     <video>
Aug 01 18:35:02 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:35:02 user nova-compute[72150]:     </video>
Aug 01 18:35:02 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:35:02 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:35:02 user nova-compute[72150]:     </rng>
Aug 01 18:35:02 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:35:02 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:35:02 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:35:02 user nova-compute[72150]:     </memballoon>
Aug 01 18:35:02 user nova-compute[72150]:   </devices>
Aug 01 18:35:02 user nova-compute[72150]: </domain>
Aug 01 18:35:02 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:34:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-900314610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-900314610',id=31,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ad8ef64d051424e9fe644a1fb40fcb4',ramdisk_id='',reservation_id='r-pq3gqg00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-23372548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:35:01Z,user_data=None,user_id='cc00b9006f5842c6b875c5d25538b718',uuid=d2117837-5552-4ec3-9f9b-62629c1ff4cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cc0118a-e179-46b8-916b-b705b8568daa", "address": "fa:16:3e:c7:1f:09", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0118a-e1", "ovs_interfaceid": "4cc0118a-e179-46b8-916b-b705b8568daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converting VIF {"id": "4cc0118a-e179-46b8-916b-b705b8568daa", "address": "fa:16:3e:c7:1f:09", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0118a-e1", "ovs_interfaceid": "4cc0118a-e179-46b8-916b-b705b8568daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:1f:09,bridge_name='br-int',has_traffic_filtering=True,id=4cc0118a-e179-46b8-916b-b705b8568daa,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc0118a-e1') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG os_vif [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:1f:09,bridge_name='br-int',has_traffic_filtering=True,id=4cc0118a-e179-46b8-916b-b705b8568daa,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc0118a-e1') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cc0118a-e1, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4cc0118a-e1, col_values=(('external_ids', {'iface-id': '4cc0118a-e179-46b8-916b-b705b8568daa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:1f:09', 'vm-uuid': 'd2117837-5552-4ec3-9f9b-62629c1ff4cb'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:02 user nova-compute[72150]: INFO os_vif [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:1f:09,bridge_name='br-int',has_traffic_filtering=True,id=4cc0118a-e179-46b8-916b-b705b8568daa,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc0118a-e1')
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:35:02 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] No VIF found with MAC fa:16:3e:c7:1f:09, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:35:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:03 user nova-compute[72150]: DEBUG nova.network.neutron [req-79d47c04-a723-4e0b-ac12-e0be5d2edde5 req-1a2fa848-c2f8-459e-879d-7000aa529561 service nova] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Updated VIF entry in instance network info cache for port 4cc0118a-e179-46b8-916b-b705b8568daa. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:35:03 user nova-compute[72150]: DEBUG nova.network.neutron [req-79d47c04-a723-4e0b-ac12-e0be5d2edde5 req-1a2fa848-c2f8-459e-879d-7000aa529561 service nova] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Updating instance_info_cache with network_info: [{"id": "4cc0118a-e179-46b8-916b-b705b8568daa", "address": "fa:16:3e:c7:1f:09", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0118a-e1", "ovs_interfaceid": "4cc0118a-e179-46b8-916b-b705b8568daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:35:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-79d47c04-a723-4e0b-ac12-e0be5d2edde5 req-1a2fa848-c2f8-459e-879d-7000aa529561 service nova] Releasing lock "refresh_cache-d2117837-5552-4ec3-9f9b-62629c1ff4cb" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:35:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:03 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914888.7067244, eb113972-7a86-4cb7-9f8d-ca690693e27d => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:35:03 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] VM Stopped (Lifecycle Event)
Aug 01 18:35:03 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8f45f4da-b7aa-453b-bcfa-c8aec0ef9234 None None] [instance: eb113972-7a86-4cb7-9f8d-ca690693e27d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:35:04 user nova-compute[72150]: DEBUG nova.compute.manager [req-32ec4a42-4a4a-461a-ba39-28b89eec2b80 req-3b19503d-4492-480b-b96b-036c02fd9253 service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Received event network-vif-plugged-9478d2ba-2463-48fc-a572-a162788e22c3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:35:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-32ec4a42-4a4a-461a-ba39-28b89eec2b80 req-3b19503d-4492-480b-b96b-036c02fd9253 service nova] Acquiring lock "fd12a8f9-593d-4e48-97f8-64e210d46d77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-32ec4a42-4a4a-461a-ba39-28b89eec2b80 req-3b19503d-4492-480b-b96b-036c02fd9253 service nova] Lock "fd12a8f9-593d-4e48-97f8-64e210d46d77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-32ec4a42-4a4a-461a-ba39-28b89eec2b80 req-3b19503d-4492-480b-b96b-036c02fd9253 service nova] Lock "fd12a8f9-593d-4e48-97f8-64e210d46d77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:04 user nova-compute[72150]: DEBUG nova.compute.manager [req-32ec4a42-4a4a-461a-ba39-28b89eec2b80 req-3b19503d-4492-480b-b96b-036c02fd9253 service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] No waiting events found dispatching network-vif-plugged-9478d2ba-2463-48fc-a572-a162788e22c3 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:35:04 user nova-compute[72150]: WARNING nova.compute.manager [req-32ec4a42-4a4a-461a-ba39-28b89eec2b80 req-3b19503d-4492-480b-b96b-036c02fd9253 service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Received unexpected event network-vif-plugged-9478d2ba-2463-48fc-a572-a162788e22c3 for instance with vm_state building and task_state spawning.
Aug 01 18:35:04 user nova-compute[72150]: DEBUG nova.compute.manager [req-32ec4a42-4a4a-461a-ba39-28b89eec2b80 req-3b19503d-4492-480b-b96b-036c02fd9253 service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Received event network-vif-plugged-9478d2ba-2463-48fc-a572-a162788e22c3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:35:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-32ec4a42-4a4a-461a-ba39-28b89eec2b80 req-3b19503d-4492-480b-b96b-036c02fd9253 service nova] Acquiring lock "fd12a8f9-593d-4e48-97f8-64e210d46d77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-32ec4a42-4a4a-461a-ba39-28b89eec2b80 req-3b19503d-4492-480b-b96b-036c02fd9253 service nova] Lock "fd12a8f9-593d-4e48-97f8-64e210d46d77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-32ec4a42-4a4a-461a-ba39-28b89eec2b80 req-3b19503d-4492-480b-b96b-036c02fd9253 service nova] Lock "fd12a8f9-593d-4e48-97f8-64e210d46d77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:04 user nova-compute[72150]: DEBUG nova.compute.manager [req-32ec4a42-4a4a-461a-ba39-28b89eec2b80 req-3b19503d-4492-480b-b96b-036c02fd9253 service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] No waiting events found dispatching network-vif-plugged-9478d2ba-2463-48fc-a572-a162788e22c3 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:35:04 user nova-compute[72150]: WARNING nova.compute.manager [req-32ec4a42-4a4a-461a-ba39-28b89eec2b80 req-3b19503d-4492-480b-b96b-036c02fd9253 service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Received unexpected event network-vif-plugged-9478d2ba-2463-48fc-a572-a162788e22c3 for instance with vm_state building and task_state spawning.
Aug 01 18:35:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:04 user nova-compute[72150]: DEBUG nova.compute.manager [req-adbf5690-4ae8-4c4c-bdbf-1f27673bbcc3 req-c419d91e-08fd-40cb-846e-7025f85af543 service nova] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Received event network-vif-plugged-4cc0118a-e179-46b8-916b-b705b8568daa {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:35:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-adbf5690-4ae8-4c4c-bdbf-1f27673bbcc3 req-c419d91e-08fd-40cb-846e-7025f85af543 service nova] Acquiring lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-adbf5690-4ae8-4c4c-bdbf-1f27673bbcc3 req-c419d91e-08fd-40cb-846e-7025f85af543 service nova] Lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-adbf5690-4ae8-4c4c-bdbf-1f27673bbcc3 req-c419d91e-08fd-40cb-846e-7025f85af543 service nova] Lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:04 user nova-compute[72150]: DEBUG nova.compute.manager [req-adbf5690-4ae8-4c4c-bdbf-1f27673bbcc3 req-c419d91e-08fd-40cb-846e-7025f85af543 service nova] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] No waiting events found dispatching network-vif-plugged-4cc0118a-e179-46b8-916b-b705b8568daa {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:35:04 user nova-compute[72150]: WARNING nova.compute.manager [req-adbf5690-4ae8-4c4c-bdbf-1f27673bbcc3 req-c419d91e-08fd-40cb-846e-7025f85af543 service nova] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Received unexpected event network-vif-plugged-4cc0118a-e179-46b8-916b-b705b8568daa for instance with vm_state building and task_state spawning.
Aug 01 18:35:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914906.5000565, fd12a8f9-593d-4e48-97f8-64e210d46d77 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:35:06 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] VM Resumed (Lifecycle Event)
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:35:06 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Instance spawned successfully.
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:35:06 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914906.5097249, fd12a8f9-593d-4e48-97f8-64e210d46d77 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:35:06 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] VM Started (Lifecycle Event)
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:35:06 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:35:06 user nova-compute[72150]: INFO nova.compute.manager [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Took 7.69 seconds to spawn the instance on the hypervisor.
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:35:06 user nova-compute[72150]: INFO nova.compute.manager [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Took 8.37 seconds to build instance.
Aug 01 18:35:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d5df612d-ea52-4b64-bb15-990fb9095384 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "fd12a8f9-593d-4e48-97f8-64e210d46d77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.467s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914906.8898375, d2117837-5552-4ec3-9f9b-62629c1ff4cb => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:35:06 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] VM Resumed (Lifecycle Event)
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.compute.manager [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:35:06 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Instance spawned successfully.
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:35:06 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914906.896809, d2117837-5552-4ec3-9f9b-62629c1ff4cb => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:35:06 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] VM Started (Lifecycle Event)
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:35:06 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:35:06 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:35:07 user nova-compute[72150]: INFO nova.compute.manager [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Took 6.29 seconds to spawn the instance on the hypervisor.
Aug 01 18:35:07 user nova-compute[72150]: DEBUG nova.compute.manager [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:35:07 user nova-compute[72150]: DEBUG nova.compute.manager [req-de565060-07d3-4165-bfaa-fd3bd458e627 req-bb14c63f-f381-4c4e-9edc-9e7b7bbb42e9 service nova] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Received event network-vif-plugged-4cc0118a-e179-46b8-916b-b705b8568daa {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:35:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-de565060-07d3-4165-bfaa-fd3bd458e627 req-bb14c63f-f381-4c4e-9edc-9e7b7bbb42e9 service nova] Acquiring lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-de565060-07d3-4165-bfaa-fd3bd458e627 req-bb14c63f-f381-4c4e-9edc-9e7b7bbb42e9 service nova] Lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-de565060-07d3-4165-bfaa-fd3bd458e627 req-bb14c63f-f381-4c4e-9edc-9e7b7bbb42e9 service nova] Lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:07 user nova-compute[72150]: DEBUG nova.compute.manager [req-de565060-07d3-4165-bfaa-fd3bd458e627 req-bb14c63f-f381-4c4e-9edc-9e7b7bbb42e9 service nova] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] No waiting events found dispatching network-vif-plugged-4cc0118a-e179-46b8-916b-b705b8568daa {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:35:07 user nova-compute[72150]: WARNING nova.compute.manager [req-de565060-07d3-4165-bfaa-fd3bd458e627 req-bb14c63f-f381-4c4e-9edc-9e7b7bbb42e9 service nova] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Received unexpected event network-vif-plugged-4cc0118a-e179-46b8-916b-b705b8568daa for instance with vm_state building and task_state spawning.
Aug 01 18:35:07 user nova-compute[72150]: INFO nova.compute.manager [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Took 7.24 seconds to build instance.
Aug 01 18:35:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-48a4b441-2f7f-412d-914e-799af0ac6d59 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.341s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "493a8db6-68da-4c4e-88e4-2d6d949020e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "493a8db6-68da-4c4e-88e4-2d6d949020e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:15 user nova-compute[72150]: DEBUG nova.compute.manager [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:35:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:15 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:35:15 user nova-compute[72150]: INFO nova.compute.claims [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Claim successful on node user
Aug 01 18:35:16 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG nova.compute.manager [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG nova.compute.manager [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG nova.network.neutron [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:35:16 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:35:16 user nova-compute[72150]: DEBUG nova.compute.manager [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:35:16 user nova-compute[72150]: INFO nova.virt.block_device [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Booting with volume 134cfd38-e4a8-46fc-a35e-4c37a1e4a052 at /dev/vda
Aug 01 18:35:16 user nova-compute[72150]: DEBUG nova.policy [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92c7ef0ed6814f8880de76adb913a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ca44f23b114893afcfe57c52f693b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG os_brick.utils [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e28360-48c0-40fc-a21a-e651fddfa020]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ca064f-b762-460c-89bf-9c116a72dd08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0710ccb7-fb98-44d3-a76a-03509012143b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39b56c2-32fe-4c7d-9905-030990ff00ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:35:16 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:35:16 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0f3c8d-fbc8-4ce4-85a4-40cc493d04dd]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG os_brick.utils [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:35:16 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Updating existing volume attachment record: 4d8de88e-96b7-445d-9149-c71887db0d62 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:35:17 user nova-compute[72150]: DEBUG nova.network.neutron [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Successfully created port: 573fb408-5920-43c6-8e49-326b86965b0c {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:35:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:17 user nova-compute[72150]: DEBUG nova.network.neutron [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Successfully updated port: 573fb408-5920-43c6-8e49-326b86965b0c {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:35:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "refresh_cache-493a8db6-68da-4c4e-88e4-2d6d949020e8" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:35:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquired lock "refresh_cache-493a8db6-68da-4c4e-88e4-2d6d949020e8" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:35:17 user nova-compute[72150]: DEBUG nova.network.neutron [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:35:17 user nova-compute[72150]: DEBUG nova.compute.manager [req-8e59aa14-f5ed-47d7-b932-cf9e758e137e req-0d1362f4-d7a0-4691-bcb8-b0b6b98f0afb service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Received event network-changed-573fb408-5920-43c6-8e49-326b86965b0c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:35:17 user nova-compute[72150]: DEBUG nova.compute.manager [req-8e59aa14-f5ed-47d7-b932-cf9e758e137e req-0d1362f4-d7a0-4691-bcb8-b0b6b98f0afb service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Refreshing instance network info cache due to event network-changed-573fb408-5920-43c6-8e49-326b86965b0c. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:35:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8e59aa14-f5ed-47d7-b932-cf9e758e137e req-0d1362f4-d7a0-4691-bcb8-b0b6b98f0afb service nova] Acquiring lock "refresh_cache-493a8db6-68da-4c4e-88e4-2d6d949020e8" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:35:17 user nova-compute[72150]: DEBUG nova.network.neutron [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:35:18 user nova-compute[72150]: DEBUG nova.network.neutron [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Updating instance_info_cache with network_info: [{"id": "573fb408-5920-43c6-8e49-326b86965b0c", "address": "fa:16:3e:89:7e:2a", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap573fb408-59", "ovs_interfaceid": "573fb408-5920-43c6-8e49-326b86965b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:35:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Releasing lock "refresh_cache-493a8db6-68da-4c4e-88e4-2d6d949020e8" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:35:18 user nova-compute[72150]: DEBUG nova.compute.manager [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Instance network_info: |[{"id": "573fb408-5920-43c6-8e49-326b86965b0c", "address": "fa:16:3e:89:7e:2a", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap573fb408-59", "ovs_interfaceid": "573fb408-5920-43c6-8e49-326b86965b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:35:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8e59aa14-f5ed-47d7-b932-cf9e758e137e req-0d1362f4-d7a0-4691-bcb8-b0b6b98f0afb service nova] Acquired lock "refresh_cache-493a8db6-68da-4c4e-88e4-2d6d949020e8" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:35:18 user nova-compute[72150]: DEBUG nova.network.neutron [req-8e59aa14-f5ed-47d7-b932-cf9e758e137e req-0d1362f4-d7a0-4691-bcb8-b0b6b98f0afb service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Refreshing network info cache for port 573fb408-5920-43c6-8e49-326b86965b0c {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:35:18 user nova-compute[72150]: DEBUG nova.network.neutron [req-8e59aa14-f5ed-47d7-b932-cf9e758e137e req-0d1362f4-d7a0-4691-bcb8-b0b6b98f0afb service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Updated VIF entry in instance network info cache for port 573fb408-5920-43c6-8e49-326b86965b0c. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:35:18 user nova-compute[72150]: DEBUG nova.network.neutron [req-8e59aa14-f5ed-47d7-b932-cf9e758e137e req-0d1362f4-d7a0-4691-bcb8-b0b6b98f0afb service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Updating instance_info_cache with network_info: [{"id": "573fb408-5920-43c6-8e49-326b86965b0c", "address": "fa:16:3e:89:7e:2a", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap573fb408-59", "ovs_interfaceid": "573fb408-5920-43c6-8e49-326b86965b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:35:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8e59aa14-f5ed-47d7-b932-cf9e758e137e req-0d1362f4-d7a0-4691-bcb8-b0b6b98f0afb service nova] Releasing lock "refresh_cache-493a8db6-68da-4c4e-88e4-2d6d949020e8" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG nova.compute.manager [req-fb68955f-b4d3-4573-af23-d448f0a6c54d req-5eb7c63c-271d-4e6b-8667-f071112c7460 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received event network-changed-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG nova.compute.manager [req-fb68955f-b4d3-4573-af23-d448f0a6c54d req-5eb7c63c-271d-4e6b-8667-f071112c7460 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Refreshing instance network info cache due to event network-changed-7f1bb810-d0cc-4f82-98c4-48abef3008b2. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fb68955f-b4d3-4573-af23-d448f0a6c54d req-5eb7c63c-271d-4e6b-8667-f071112c7460 service nova] Acquiring lock "refresh_cache-65b04144-3b1f-4975-8524-2c9f9660672a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fb68955f-b4d3-4573-af23-d448f0a6c54d req-5eb7c63c-271d-4e6b-8667-f071112c7460 service nova] Acquired lock "refresh_cache-65b04144-3b1f-4975-8524-2c9f9660672a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG nova.network.neutron [req-fb68955f-b4d3-4573-af23-d448f0a6c54d req-5eb7c63c-271d-4e6b-8667-f071112c7460 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Refreshing network info cache for port 7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "65b04144-3b1f-4975-8524-2c9f9660672a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "65b04144-3b1f-4975-8524-2c9f9660672a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG nova.objects.instance [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'flavor' on Instance uuid 65b04144-3b1f-4975-8524-2c9f9660672a {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "65b04144-3b1f-4975-8524-2c9f9660672a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "65b04144-3b1f-4975-8524-2c9f9660672a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "65b04144-3b1f-4975-8524-2c9f9660672a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:21 user nova-compute[72150]: INFO nova.compute.manager [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Attaching volume d6c42960-8ac9-4b2b-8716-21565e5c0923 to /dev/vdb
Aug 01 18:35:21 user nova-compute[72150]: DEBUG os_brick.utils [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG nova.network.neutron [req-fb68955f-b4d3-4573-af23-d448f0a6c54d req-5eb7c63c-271d-4e6b-8667-f071112c7460 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Updated VIF entry in instance network info cache for port 7f1bb810-d0cc-4f82-98c4-48abef3008b2. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG nova.network.neutron [req-fb68955f-b4d3-4573-af23-d448f0a6c54d req-5eb7c63c-271d-4e6b-8667-f071112c7460 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Updating instance_info_cache with network_info: [{"id": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "address": "fa:16:3e:fd:8c:16", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1bb810-d0", "ovs_interfaceid": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c018dfa7-6703-44ed-9574-13aaf9125ca0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fb68955f-b4d3-4573-af23-d448f0a6c54d req-5eb7c63c-271d-4e6b-8667-f071112c7460 service nova] Releasing lock "refresh_cache-65b04144-3b1f-4975-8524-2c9f9660672a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe24eee3-2d78-4502-ac5e-1fb852a03f90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df7cc22-48f2-4813-9b22-a6c3d4230af1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[17350124-630f-45bb-a352-285c1d402a36]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:35:21 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:35:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8aca25-424b-4fb8-bb6c-5bc8729b2f99]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG os_brick.utils [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:35:21 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Updating existing volume attachment record: 1666dcbe-d5f6-4a9d-9b7d-cb8761d95dab {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:35:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG nova.compute.manager [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:35:24 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Creating image(s)
Aug 01 18:35:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Did not create local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Ensure instance console log exists: /opt/stack/data/nova/instances/493a8db6-68da-4c4e-88e4-2d6d949020e8/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Start _get_guest_xml network_info=[{"id": "573fb408-5920-43c6-8e49-326b86965b0c", "address": "fa:16:3e:89:7e:2a", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap573fb408-59", "ovs_interfaceid": "573fb408-5920-43c6-8e49-326b86965b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4d8de88e-96b7-445d-9149-c71887db0d62', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTkRwigS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '493a8db6-68da-4c4e-88e4-2d6d949020e8', 'attached_at': '', 'detached_at': '', 'volume_id': '134cfd38-e4a8-46fc-a35e-4c37a1e4a052', 'serial': '134cfd38-e4a8-46fc-a35e-4c37a1e4a052'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:35:24 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:35:24 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:35:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTkRwigS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:35:24 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:35:24 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:35:24 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:35:24 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:35:24 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbbbdaa-e4ed-49c8-8fd9-fd4d8daa608d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:35:24 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5fda53-7b02-4ca5-a190-f2913879690f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052] added
Aug 01 18:35:24 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b3aefc-6cba-4883-99ee-ffb1e02a2783]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc4faea-3aee-473c-86f8-12d1a35e7e78]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YTkRwigS {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YTkRwigS" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3406d887-77c7-467e-b257-15ab40b98e2a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YTkRwigS'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e63da5-3f49-467e-af1e-98b1d27e263b]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd6b492-bd1f-4718-8694-95adae5f0712]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:35:24 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:35:24 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:35:24 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:35:24 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:35:24 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:35:24 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f414f08-2f44-487f-80c3-64f1bb55bc54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052, portal: 172.16.0.220,3260]
Aug 01 18:35:24 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052, portal: 172.16.0.220,3260] successful.
Aug 01 18:35:24 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a88e996-2063-4fc2-b9fb-a2507a1de6b7]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:35:24 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ca3a06-7fdc-4353-bada-4f461e051945]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:35:25 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:35:25 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:35:25 user nova-compute[72150]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:35:25 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:35:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:35:25 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:35:25 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:35:25 user nova-compute[72150]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:35:25 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:35:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:35:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:35:25 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:35:25 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:35:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaf635d-74b8-480b-a661-dcbf582e0642]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:25 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:35:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTkRwigS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:35:26 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:35:26 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26339313664346631', 'path': '/dev/sdd'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:35:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339313664346631', 'path': '/dev/sdd'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:35:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:35:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2128942014',display_name='tempest-TestVolumeBootPattern-server-2128942014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2128942014',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVf3lHt050k356A8Gut9WieNqP8u9vIp5xdHm1rq7ONC5kHGtGA6mBo7SyXu2T5UgJrBcaDoeDkrLO73m2dxgj5g1F2RdpTy7mOLuxRD5SR618gGiTwTven5q6qp8rd8g==',key_name='tempest-TestVolumeBootPattern-35567601',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7ca44f23b114893afcfe57c52f693b1',ramdisk_id='',reservation_id='r-o9vk0fpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-295340968',owner_user_name='tempest-TestVolumeBootPattern-295340968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:35:16Z,user_data=None,user_id='92c7ef0ed6814f8880de76adb913a487',uuid=493a8db6-68da-4c4e-88e4-2d6d949020e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "573fb408-5920-43c6-8e49-326b86965b0c", "address": "fa:16:3e:89:7e:2a", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap573fb408-59", "ovs_interfaceid": "573fb408-5920-43c6-8e49-326b86965b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:35:26 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converting VIF {"id": "573fb408-5920-43c6-8e49-326b86965b0c", "address": "fa:16:3e:89:7e:2a", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap573fb408-59", "ovs_interfaceid": "573fb408-5920-43c6-8e49-326b86965b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:35:26 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:7e:2a,bridge_name='br-int',has_traffic_filtering=True,id=573fb408-5920-43c6-8e49-326b86965b0c,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap573fb408-59') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:35:26 user nova-compute[72150]: DEBUG nova.objects.instance [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lazy-loading 'pci_devices' on Instance uuid 493a8db6-68da-4c4e-88e4-2d6d949020e8 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:35:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:35:26 user nova-compute[72150]:   <uuid>493a8db6-68da-4c4e-88e4-2d6d949020e8</uuid>
Aug 01 18:35:26 user nova-compute[72150]:   <name>instance-00000020</name>
Aug 01 18:35:26 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:35:26 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:35:26 user nova-compute[72150]:   <metadata>
Aug 01 18:35:26 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:35:26 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:35:26 user nova-compute[72150]:       <nova:name>tempest-TestVolumeBootPattern-server-2128942014</nova:name>
Aug 01 18:35:26 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:35:24</nova:creationTime>
Aug 01 18:35:26 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:35:26 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:35:26 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:35:26 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:35:26 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:35:26 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:35:26 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:35:26 user nova-compute[72150]:       <nova:owner>
Aug 01 18:35:26 user nova-compute[72150]:         <nova:user uuid="92c7ef0ed6814f8880de76adb913a487">tempest-TestVolumeBootPattern-295340968-project-member</nova:user>
Aug 01 18:35:26 user nova-compute[72150]:         <nova:project uuid="e7ca44f23b114893afcfe57c52f693b1">tempest-TestVolumeBootPattern-295340968</nova:project>
Aug 01 18:35:26 user nova-compute[72150]:       </nova:owner>
Aug 01 18:35:26 user nova-compute[72150]:       <nova:ports>
Aug 01 18:35:26 user nova-compute[72150]:         <nova:port uuid="573fb408-5920-43c6-8e49-326b86965b0c">
Aug 01 18:35:26 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 18:35:26 user nova-compute[72150]:         </nova:port>
Aug 01 18:35:26 user nova-compute[72150]:       </nova:ports>
Aug 01 18:35:26 user nova-compute[72150]:     </nova:instance>
Aug 01 18:35:26 user nova-compute[72150]:   </metadata>
Aug 01 18:35:26 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:35:26 user nova-compute[72150]:     <system>
Aug 01 18:35:26 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:35:26 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:35:26 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:35:26 user nova-compute[72150]:       <entry name="serial">493a8db6-68da-4c4e-88e4-2d6d949020e8</entry>
Aug 01 18:35:26 user nova-compute[72150]:       <entry name="uuid">493a8db6-68da-4c4e-88e4-2d6d949020e8</entry>
Aug 01 18:35:26 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:35:26 user nova-compute[72150]:     </system>
Aug 01 18:35:26 user nova-compute[72150]:   </sysinfo>
Aug 01 18:35:26 user nova-compute[72150]:   <os>
Aug 01 18:35:26 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:35:26 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:35:26 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:35:26 user nova-compute[72150]:   </os>
Aug 01 18:35:26 user nova-compute[72150]:   <features>
Aug 01 18:35:26 user nova-compute[72150]:     <acpi/>
Aug 01 18:35:26 user nova-compute[72150]:     <apic/>
Aug 01 18:35:26 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:35:26 user nova-compute[72150]:   </features>
Aug 01 18:35:26 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:35:26 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:35:26 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:35:26 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:35:26 user nova-compute[72150]:   </clock>
Aug 01 18:35:26 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:35:26 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:35:26 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:35:26 user nova-compute[72150]:   </cpu>
Aug 01 18:35:26 user nova-compute[72150]:   <devices>
Aug 01 18:35:26 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:35:26 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:35:26 user nova-compute[72150]:       <source dev="/dev/sdd"/>
Aug 01 18:35:26 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:35:26 user nova-compute[72150]:       <serial>134cfd38-e4a8-46fc-a35e-4c37a1e4a052</serial>
Aug 01 18:35:26 user nova-compute[72150]:     </disk>
Aug 01 18:35:26 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:35:26 user nova-compute[72150]:       <mac address="fa:16:3e:89:7e:2a"/>
Aug 01 18:35:26 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:35:26 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:35:26 user nova-compute[72150]:       <target dev="tap573fb408-59"/>
Aug 01 18:35:26 user nova-compute[72150]:     </interface>
Aug 01 18:35:26 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:35:26 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/493a8db6-68da-4c4e-88e4-2d6d949020e8/console.log" append="off"/>
Aug 01 18:35:26 user nova-compute[72150]:     </serial>
Aug 01 18:35:26 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:35:26 user nova-compute[72150]:     <video>
Aug 01 18:35:26 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:35:26 user nova-compute[72150]:     </video>
Aug 01 18:35:26 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:35:26 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:35:26 user nova-compute[72150]:     </rng>
Aug 01 18:35:26 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:35:26 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:35:26 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:35:26 user nova-compute[72150]:     </memballoon>
Aug 01 18:35:26 user nova-compute[72150]:   </devices>
Aug 01 18:35:26 user nova-compute[72150]: </domain>
Aug 01 18:35:26 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:35:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:35:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2128942014',display_name='tempest-TestVolumeBootPattern-server-2128942014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2128942014',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVf3lHt050k356A8Gut9WieNqP8u9vIp5xdHm1rq7ONC5kHGtGA6mBo7SyXu2T5UgJrBcaDoeDkrLO73m2dxgj5g1F2RdpTy7mOLuxRD5SR618gGiTwTven5q6qp8rd8g==',key_name='tempest-TestVolumeBootPattern-35567601',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7ca44f23b114893afcfe57c52f693b1',ramdisk_id='',reservation_id='r-o9vk0fpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-295340968',owner_user_name='tempest-TestVolumeBootPattern-295340968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:35:16Z,user_data=None,user_id='92c7ef0ed6814f8880de76adb913a487',uuid=493a8db6-68da-4c4e-88e4-2d6d949020e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "573fb408-5920-43c6-8e49-326b86965b0c", "address": "fa:16:3e:89:7e:2a", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap573fb408-59", "ovs_interfaceid": "573fb408-5920-43c6-8e49-326b86965b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:35:26 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converting VIF {"id": "573fb408-5920-43c6-8e49-326b86965b0c", "address": "fa:16:3e:89:7e:2a", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap573fb408-59", "ovs_interfaceid": "573fb408-5920-43c6-8e49-326b86965b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:35:26 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:7e:2a,bridge_name='br-int',has_traffic_filtering=True,id=573fb408-5920-43c6-8e49-326b86965b0c,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap573fb408-59') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:35:26 user nova-compute[72150]: DEBUG os_vif [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:7e:2a,bridge_name='br-int',has_traffic_filtering=True,id=573fb408-5920-43c6-8e49-326b86965b0c,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap573fb408-59') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:35:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:35:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:35:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap573fb408-59, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:35:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap573fb408-59, col_values=(('external_ids', {'iface-id': '573fb408-5920-43c6-8e49-326b86965b0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:7e:2a', 'vm-uuid': '493a8db6-68da-4c4e-88e4-2d6d949020e8'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:35:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:35:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:26 user nova-compute[72150]: INFO os_vif [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:7e:2a,bridge_name='br-int',has_traffic_filtering=True,id=573fb408-5920-43c6-8e49-326b86965b0c,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap573fb408-59')
Aug 01 18:35:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:35:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] No VIF found with MAC fa:16:3e:89:7e:2a, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:35:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:27 user nova-compute[72150]: DEBUG nova.compute.manager [req-9b3026dd-5494-441d-8ea8-2d74d9fa8e18 req-60ba0443-8e06-4fab-87e3-cb32bf1f69a5 service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Received event network-vif-plugged-573fb408-5920-43c6-8e49-326b86965b0c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:35:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9b3026dd-5494-441d-8ea8-2d74d9fa8e18 req-60ba0443-8e06-4fab-87e3-cb32bf1f69a5 service nova] Acquiring lock "493a8db6-68da-4c4e-88e4-2d6d949020e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9b3026dd-5494-441d-8ea8-2d74d9fa8e18 req-60ba0443-8e06-4fab-87e3-cb32bf1f69a5 service nova] Lock "493a8db6-68da-4c4e-88e4-2d6d949020e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9b3026dd-5494-441d-8ea8-2d74d9fa8e18 req-60ba0443-8e06-4fab-87e3-cb32bf1f69a5 service nova] Lock "493a8db6-68da-4c4e-88e4-2d6d949020e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:27 user nova-compute[72150]: DEBUG nova.compute.manager [req-9b3026dd-5494-441d-8ea8-2d74d9fa8e18 req-60ba0443-8e06-4fab-87e3-cb32bf1f69a5 service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] No waiting events found dispatching network-vif-plugged-573fb408-5920-43c6-8e49-326b86965b0c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:35:27 user nova-compute[72150]: WARNING nova.compute.manager [req-9b3026dd-5494-441d-8ea8-2d74d9fa8e18 req-60ba0443-8e06-4fab-87e3-cb32bf1f69a5 service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Received unexpected event network-vif-plugged-573fb408-5920-43c6-8e49-326b86965b0c for instance with vm_state building and task_state spawning.
Aug 01 18:35:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZxvRiyJW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:35:29 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:35:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:35:29 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:35:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:35:29 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c331f2-059c-49bb-819f-63ad98ed9de0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:35:29 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914929.6004462, 493a8db6-68da-4c4e-88e4-2d6d949020e8 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:35:29 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] VM Resumed (Lifecycle Event)
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7764b87a-e7db-44f0-afa5-7ee286dfd7e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923] added
Aug 01 18:35:29 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:29 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Instance spawned successfully.
Aug 01 18:35:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e61e978-5d00-43b1-91ed-e42027fc799b]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-260809b5-3fb5-4a7a-a2c2-78ab7690eae7 req-d0266299-1acb-4bc9-9f9a-31cfba98b2a9 service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Received event network-vif-plugged-573fb408-5920-43c6-8e49-326b86965b0c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-260809b5-3fb5-4a7a-a2c2-78ab7690eae7 req-d0266299-1acb-4bc9-9f9a-31cfba98b2a9 service nova] Acquiring lock "493a8db6-68da-4c4e-88e4-2d6d949020e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-260809b5-3fb5-4a7a-a2c2-78ab7690eae7 req-d0266299-1acb-4bc9-9f9a-31cfba98b2a9 service nova] Lock "493a8db6-68da-4c4e-88e4-2d6d949020e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-260809b5-3fb5-4a7a-a2c2-78ab7690eae7 req-d0266299-1acb-4bc9-9f9a-31cfba98b2a9 service nova] Lock "493a8db6-68da-4c4e-88e4-2d6d949020e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-260809b5-3fb5-4a7a-a2c2-78ab7690eae7 req-d0266299-1acb-4bc9-9f9a-31cfba98b2a9 service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] No waiting events found dispatching network-vif-plugged-573fb408-5920-43c6-8e49-326b86965b0c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:35:29 user nova-compute[72150]: WARNING nova.compute.manager [req-260809b5-3fb5-4a7a-a2c2-78ab7690eae7 req-d0266299-1acb-4bc9-9f9a-31cfba98b2a9 service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Received unexpected event network-vif-plugged-573fb408-5920-43c6-8e49-326b86965b0c for instance with vm_state building and task_state spawning.
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5834c7-482f-48da-b4d7-f1f600e293eb]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZxvRiyJW {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:29 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:35:29 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914929.6020644, 493a8db6-68da-4c4e-88e4-2d6d949020e8 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:35:29 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] VM Started (Lifecycle Event)
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZxvRiyJW" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad60ccc-79af-4ab9-a2db-88152c72cc76]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZxvRiyJW'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1deea82f-a086-46c8-88e5-246c73f31b36]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5510e14a-53d9-412d-9268-e614db710cb0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:35:29 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:35:29 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:35:29 user nova-compute[72150]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:35:29 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:35:29 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:35:29 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:35:29 user nova-compute[72150]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:35:29 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:29 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:35:29 user nova-compute[72150]: INFO nova.compute.manager [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Took 5.10 seconds to spawn the instance on the hypervisor.
Aug 01 18:35:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[312c0eb6-62ff-405d-975f-e330654c3b46]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923, portal: 172.16.0.220,3260]
Aug 01 18:35:29 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923, portal: 172.16.0.220,3260] successful.
Aug 01 18:35:29 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:29 user nova-compute[72150]: INFO nova.compute.manager [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Took 14.08 seconds to build instance.
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd47ad89-e8c9-4c13-b8ad-69533d9cb311]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4404c8c2-14dd-41fd-ba77-68200f94ff5d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "493a8db6-68da-4c4e-88e4-2d6d949020e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.181s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da7aa99-fdb8-425c-8c0d-9fce80ea5641]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:35:29 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:35:29 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:35:29 user nova-compute[72150]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:35:29 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:35:29 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:35:29 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:35:29 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:35:29 user nova-compute[72150]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:35:29 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:35:29 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa12f490-a8a4-4725-8042-cc01ee32ce40]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:29 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: None {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:35:30 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:35:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZxvRiyJW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:35:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:35:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26339306430343231', 'path': '/dev/sde'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:35:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339306430343231', 'path': '/dev/sde'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:35:30 user nova-compute[72150]: DEBUG nova.objects.instance [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'flavor' on Instance uuid 65b04144-3b1f-4975-8524-2c9f9660672a {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:35:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:35:30 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:35:30 user nova-compute[72150]:   <source dev="/dev/sde"/>
Aug 01 18:35:30 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:35:30 user nova-compute[72150]:   <serial>d6c42960-8ac9-4b2b-8716-21565e5c0923</serial>
Aug 01 18:35:30 user nova-compute[72150]: </disk>
Aug 01 18:35:30 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:35:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:35:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:35:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] No VIF found with MAC fa:16:3e:fd:8c:16, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:35:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3b81d2c6-f48e-4096-936f-bdc82e809598 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "65b04144-3b1f-4975-8524-2c9f9660672a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.287s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:32 user nova-compute[72150]: INFO nova.compute.manager [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Rescuing
Aug 01 18:35:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "refresh_cache-65b04144-3b1f-4975-8524-2c9f9660672a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:35:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquired lock "refresh_cache-65b04144-3b1f-4975-8524-2c9f9660672a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:35:32 user nova-compute[72150]: DEBUG nova.network.neutron [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:35:32 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:35:32 user nova-compute[72150]: DEBUG nova.network.neutron [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Updating instance_info_cache with network_info: [{"id": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "address": "fa:16:3e:fd:8c:16", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1bb810-d0", "ovs_interfaceid": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:35:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Releasing lock "refresh_cache-65b04144-3b1f-4975-8524-2c9f9660672a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:35:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:33 user nova-compute[72150]: DEBUG nova.compute.manager [req-225272ed-b275-42cc-acd6-ce61c0720a53 req-93d3f3bd-d257-45bd-93df-473509bd8608 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received event network-vif-unplugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:35:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-225272ed-b275-42cc-acd6-ce61c0720a53 req-93d3f3bd-d257-45bd-93df-473509bd8608 service nova] Acquiring lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-225272ed-b275-42cc-acd6-ce61c0720a53 req-93d3f3bd-d257-45bd-93df-473509bd8608 service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-225272ed-b275-42cc-acd6-ce61c0720a53 req-93d3f3bd-d257-45bd-93df-473509bd8608 service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:33 user nova-compute[72150]: DEBUG nova.compute.manager [req-225272ed-b275-42cc-acd6-ce61c0720a53 req-93d3f3bd-d257-45bd-93df-473509bd8608 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] No waiting events found dispatching network-vif-unplugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:35:33 user nova-compute[72150]: WARNING nova.compute.manager [req-225272ed-b275-42cc-acd6-ce61c0720a53 req-93d3f3bd-d257-45bd-93df-473509bd8608 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received unexpected event network-vif-unplugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 for instance with vm_state active and task_state rescuing.
Aug 01 18:35:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:33 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Instance destroyed successfully.
Aug 01 18:35:33 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Attempting rescue
Aug 01 18:35:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72150) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 18:35:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Instance directory exists: not creating {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 18:35:33 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Creating image(s)
Aug 01 18:35:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "/opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "/opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "/opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:33 user nova-compute[72150]: DEBUG nova.objects.instance [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'trusted_certs' on Instance uuid 65b04144-3b1f-4975-8524-2c9f9660672a {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:35:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.151s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk.rescue {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk.rescue" returned: 0 in 0.057s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.objects.instance [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'migration_context' on Instance uuid 65b04144-3b1f-4975-8524-2c9f9660672a {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Start _get_guest_xml network_info=[{"id": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "address": "fa:16:3e:fd:8c:16", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "vif_mac": "fa:16:3e:fd:8c:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1bb810-d0", "ovs_interfaceid": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.objects.instance [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'resources' on Instance uuid 65b04144-3b1f-4975-8524-2c9f9660672a {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.objects.instance [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'numa_topology' on Instance uuid 65b04144-3b1f-4975-8524-2c9f9660672a {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:35:34 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:35:34 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.objects.instance [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'vcpu_model' on Instance uuid 65b04144-3b1f-4975-8524-2c9f9660672a {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:33:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1438581595',display_name='tempest-ServerRescueNegativeTestJSON-server-1438581595',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1438581595',id=28,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3bQqS2j4kZRk333FJ16crVHeGKsnlSqh38puJr9piXdSV+XYf+feSl84MueVV3t5BtCP0cq69HG1ekvpdvbT4swu2ub0xC3rQ4sqVxWLfImu3Ng8/Yes0u2g+aQjMwbw==',key_name='tempest-keypair-1393509934',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:33:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0b70fdffe9e414aa766f7c8f7a20d50',ramdisk_id='',reservation_id='r-f8e04fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2003578958',owner_user_name='tempest-ServerRescueNegativeTestJSON-2003578958-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:33:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375cd4acff1646f4a5418fb012118600',uuid=65b04144-3b1f-4975-8524-2c9f9660672a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "address": "fa:16:3e:fd:8c:16", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "vif_mac": "fa:16:3e:fd:8c:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1bb810-d0", "ovs_interfaceid": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converting VIF {"id": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "address": "fa:16:3e:fd:8c:16", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "vif_mac": "fa:16:3e:fd:8c:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1bb810-d0", "ovs_interfaceid": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:8c:16,bridge_name='br-int',has_traffic_filtering=True,id=7f1bb810-d0cc-4f82-98c4-48abef3008b2,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1bb810-d0') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.objects.instance [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'pci_devices' on Instance uuid 65b04144-3b1f-4975-8524-2c9f9660672a {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:35:34 user nova-compute[72150]:   <uuid>65b04144-3b1f-4975-8524-2c9f9660672a</uuid>
Aug 01 18:35:34 user nova-compute[72150]:   <name>instance-0000001c</name>
Aug 01 18:35:34 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:35:34 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:35:34 user nova-compute[72150]:   <metadata>
Aug 01 18:35:34 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:35:34 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:35:34 user nova-compute[72150]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1438581595</nova:name>
Aug 01 18:35:34 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:35:34</nova:creationTime>
Aug 01 18:35:34 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:35:34 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:35:34 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:35:34 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:35:34 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:35:34 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:35:34 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:35:34 user nova-compute[72150]:       <nova:owner>
Aug 01 18:35:34 user nova-compute[72150]:         <nova:user uuid="375cd4acff1646f4a5418fb012118600">tempest-ServerRescueNegativeTestJSON-2003578958-project-member</nova:user>
Aug 01 18:35:34 user nova-compute[72150]:         <nova:project uuid="e0b70fdffe9e414aa766f7c8f7a20d50">tempest-ServerRescueNegativeTestJSON-2003578958</nova:project>
Aug 01 18:35:34 user nova-compute[72150]:       </nova:owner>
Aug 01 18:35:34 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:35:34 user nova-compute[72150]:       <nova:ports>
Aug 01 18:35:34 user nova-compute[72150]:         <nova:port uuid="7f1bb810-d0cc-4f82-98c4-48abef3008b2">
Aug 01 18:35:34 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 18:35:34 user nova-compute[72150]:         </nova:port>
Aug 01 18:35:34 user nova-compute[72150]:       </nova:ports>
Aug 01 18:35:34 user nova-compute[72150]:     </nova:instance>
Aug 01 18:35:34 user nova-compute[72150]:   </metadata>
Aug 01 18:35:34 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:35:34 user nova-compute[72150]:     <system>
Aug 01 18:35:34 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:35:34 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:35:34 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:35:34 user nova-compute[72150]:       <entry name="serial">65b04144-3b1f-4975-8524-2c9f9660672a</entry>
Aug 01 18:35:34 user nova-compute[72150]:       <entry name="uuid">65b04144-3b1f-4975-8524-2c9f9660672a</entry>
Aug 01 18:35:34 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:35:34 user nova-compute[72150]:     </system>
Aug 01 18:35:34 user nova-compute[72150]:   </sysinfo>
Aug 01 18:35:34 user nova-compute[72150]:   <os>
Aug 01 18:35:34 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:35:34 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:35:34 user nova-compute[72150]:   </os>
Aug 01 18:35:34 user nova-compute[72150]:   <features>
Aug 01 18:35:34 user nova-compute[72150]:     <acpi/>
Aug 01 18:35:34 user nova-compute[72150]:     <apic/>
Aug 01 18:35:34 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:35:34 user nova-compute[72150]:   </features>
Aug 01 18:35:34 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:35:34 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:35:34 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:35:34 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:35:34 user nova-compute[72150]:   </clock>
Aug 01 18:35:34 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:35:34 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:35:34 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:35:34 user nova-compute[72150]:   </cpu>
Aug 01 18:35:34 user nova-compute[72150]:   <devices>
Aug 01 18:35:34 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:35:34 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:35:34 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk.rescue"/>
Aug 01 18:35:34 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:35:34 user nova-compute[72150]:     </disk>
Aug 01 18:35:34 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:35:34 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:35:34 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk"/>
Aug 01 18:35:34 user nova-compute[72150]:       <target dev="vdb" bus="virtio"/>
Aug 01 18:35:34 user nova-compute[72150]:     </disk>
Aug 01 18:35:34 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:35:34 user nova-compute[72150]:       <mac address="fa:16:3e:fd:8c:16"/>
Aug 01 18:35:34 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:35:34 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:35:34 user nova-compute[72150]:       <target dev="tap7f1bb810-d0"/>
Aug 01 18:35:34 user nova-compute[72150]:     </interface>
Aug 01 18:35:34 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:35:34 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/console.log" append="off"/>
Aug 01 18:35:34 user nova-compute[72150]:     </serial>
Aug 01 18:35:34 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:35:34 user nova-compute[72150]:     <video>
Aug 01 18:35:34 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:35:34 user nova-compute[72150]:     </video>
Aug 01 18:35:34 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:35:34 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:35:34 user nova-compute[72150]:     </rng>
Aug 01 18:35:34 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:35:34 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:35:34 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:35:34 user nova-compute[72150]:     </memballoon>
Aug 01 18:35:34 user nova-compute[72150]:   </devices>
Aug 01 18:35:34 user nova-compute[72150]: </domain>
Aug 01 18:35:34 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:35:34 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Instance destroyed successfully.
Aug 01 18:35:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:35:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] No VIF found with MAC fa:16:3e:fd:8c:16, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:35:35 user nova-compute[72150]: DEBUG nova.compute.manager [req-85fd30f6-0f4f-4121-ba7b-68826f7c6f56 req-98c10080-338e-42e0-acc7-27536f54daf7 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received event network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:35:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-85fd30f6-0f4f-4121-ba7b-68826f7c6f56 req-98c10080-338e-42e0-acc7-27536f54daf7 service nova] Acquiring lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-85fd30f6-0f4f-4121-ba7b-68826f7c6f56 req-98c10080-338e-42e0-acc7-27536f54daf7 service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-85fd30f6-0f4f-4121-ba7b-68826f7c6f56 req-98c10080-338e-42e0-acc7-27536f54daf7 service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:35 user nova-compute[72150]: DEBUG nova.compute.manager [req-85fd30f6-0f4f-4121-ba7b-68826f7c6f56 req-98c10080-338e-42e0-acc7-27536f54daf7 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] No waiting events found dispatching network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:35:35 user nova-compute[72150]: WARNING nova.compute.manager [req-85fd30f6-0f4f-4121-ba7b-68826f7c6f56 req-98c10080-338e-42e0-acc7-27536f54daf7 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received unexpected event network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 for instance with vm_state active and task_state rescuing.
Aug 01 18:35:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:37 user nova-compute[72150]: DEBUG nova.compute.manager [req-6be77a18-1037-4dc3-b470-402d811152e5 req-e8cacffb-f477-41d4-8042-3b2a5e3cb31f service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received event network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:35:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6be77a18-1037-4dc3-b470-402d811152e5 req-e8cacffb-f477-41d4-8042-3b2a5e3cb31f service nova] Acquiring lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6be77a18-1037-4dc3-b470-402d811152e5 req-e8cacffb-f477-41d4-8042-3b2a5e3cb31f service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6be77a18-1037-4dc3-b470-402d811152e5 req-e8cacffb-f477-41d4-8042-3b2a5e3cb31f service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:37 user nova-compute[72150]: DEBUG nova.compute.manager [req-6be77a18-1037-4dc3-b470-402d811152e5 req-e8cacffb-f477-41d4-8042-3b2a5e3cb31f service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] No waiting events found dispatching network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:35:37 user nova-compute[72150]: WARNING nova.compute.manager [req-6be77a18-1037-4dc3-b470-402d811152e5 req-e8cacffb-f477-41d4-8042-3b2a5e3cb31f service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received unexpected event network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 for instance with vm_state active and task_state rescuing.
Aug 01 18:35:37 user nova-compute[72150]: DEBUG nova.compute.manager [req-6be77a18-1037-4dc3-b470-402d811152e5 req-e8cacffb-f477-41d4-8042-3b2a5e3cb31f service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received event network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:35:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6be77a18-1037-4dc3-b470-402d811152e5 req-e8cacffb-f477-41d4-8042-3b2a5e3cb31f service nova] Acquiring lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6be77a18-1037-4dc3-b470-402d811152e5 req-e8cacffb-f477-41d4-8042-3b2a5e3cb31f service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6be77a18-1037-4dc3-b470-402d811152e5 req-e8cacffb-f477-41d4-8042-3b2a5e3cb31f service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:37 user nova-compute[72150]: DEBUG nova.compute.manager [req-6be77a18-1037-4dc3-b470-402d811152e5 req-e8cacffb-f477-41d4-8042-3b2a5e3cb31f service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] No waiting events found dispatching network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:35:37 user nova-compute[72150]: WARNING nova.compute.manager [req-6be77a18-1037-4dc3-b470-402d811152e5 req-e8cacffb-f477-41d4-8042-3b2a5e3cb31f service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received unexpected event network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 for instance with vm_state active and task_state rescuing.
Aug 01 18:35:37 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:35:38 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Removed pending event for 65b04144-3b1f-4975-8524-2c9f9660672a due to event {{(pid=72150) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 18:35:38 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914938.1579597, 65b04144-3b1f-4975-8524-2c9f9660672a => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:35:38 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] VM Resumed (Lifecycle Event)
Aug 01 18:35:38 user nova-compute[72150]: DEBUG nova.compute.manager [None req-b86f7245-142a-4e7e-b2d4-0b83849d8fc3 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:35:38 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:35:38 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:35:38 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 18:35:38 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914938.1596944, 65b04144-3b1f-4975-8524-2c9f9660672a => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:35:38 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] VM Started (Lifecycle Event)
Aug 01 18:35:38 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:35:38 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:35:38 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:35:38 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:35:38 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:35:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:40 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:35:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:40 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:35:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:35:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd12a8f9-593d-4e48-97f8-64e210d46d77/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd12a8f9-593d-4e48-97f8-64e210d46d77/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd12a8f9-593d-4e48-97f8-64e210d46d77/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd12a8f9-593d-4e48-97f8-64e210d46d77/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:35:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:35:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:35:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b12a0-6673-4e12-b23c-73141346dd83/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b12a0-6673-4e12-b23c-73141346dd83/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b12a0-6673-4e12-b23c-73141346dd83/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b12a0-6673-4e12-b23c-73141346dd83/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:35:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:45 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:35:45 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:35:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=7280MB free_disk=25.301639556884766GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:35:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 769690c8-53c5-4057-88a5-fbdbcb930e32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:35:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ea68420b-8362-4df3-b710-cd1cf76adba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:35:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 08851ec4-6f71-4ec1-a092-42aab83ee87f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:35:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance bf2d1f14-2227-41d1-bd73-a05ab3149aba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:35:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 42e75a98-beb1-4688-a375-affc63b14252 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:35:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance a5f0eca7-d060-4226-b36e-a3cd15b15703 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:35:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance b10328c7-3328-4c3c-8ebe-3dd282ece0c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:35:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 65b04144-3b1f-4975-8524-2c9f9660672a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:35:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 7e5b12a0-6673-4e12-b23c-73141346dd83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:35:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance fd12a8f9-593d-4e48-97f8-64e210d46d77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:35:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance d2117837-5552-4ec3-9f9b-62629c1ff4cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:35:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 493a8db6-68da-4c4e-88e4-2d6d949020e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:35:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 01 18:35:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:35:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:35:45 user nova-compute[72150]: DEBUG nova.compute.manager [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:35:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:46 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:35:46 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:35:46 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:35:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.768s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.247s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:46 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:35:46 user nova-compute[72150]: INFO nova.compute.claims [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Claim successful on node user
Aug 01 18:35:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:46 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:35:46 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:35:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.643s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:35:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:35:46 user nova-compute[72150]: DEBUG nova.network.neutron [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:35:46 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:35:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:35:46 user nova-compute[72150]: DEBUG nova.compute.manager [req-50d6e961-a039-4bf2-96ef-59cc8b5a4a09 req-2d455f00-f481-42e7-8b11-9229772ad3b0 service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Received event network-changed-a83e9ff9-3d8f-479b-b142-58b06f1901c2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:35:46 user nova-compute[72150]: DEBUG nova.compute.manager [req-50d6e961-a039-4bf2-96ef-59cc8b5a4a09 req-2d455f00-f481-42e7-8b11-9229772ad3b0 service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Refreshing instance network info cache due to event network-changed-a83e9ff9-3d8f-479b-b142-58b06f1901c2. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:35:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-50d6e961-a039-4bf2-96ef-59cc8b5a4a09 req-2d455f00-f481-42e7-8b11-9229772ad3b0 service nova] Acquiring lock "refresh_cache-7e5b12a0-6673-4e12-b23c-73141346dd83" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:35:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-50d6e961-a039-4bf2-96ef-59cc8b5a4a09 req-2d455f00-f481-42e7-8b11-9229772ad3b0 service nova] Acquired lock "refresh_cache-7e5b12a0-6673-4e12-b23c-73141346dd83" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:35:46 user nova-compute[72150]: DEBUG nova.network.neutron [req-50d6e961-a039-4bf2-96ef-59cc8b5a4a09 req-2d455f00-f481-42e7-8b11-9229772ad3b0 service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Refreshing network info cache for port a83e9ff9-3d8f-479b-b142-58b06f1901c2 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:35:46 user nova-compute[72150]: INFO nova.virt.block_device [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Booting with volume 194b3ab3-36b4-4099-99ce-e23a428c23b9 at /dev/vda
Aug 01 18:35:47 user nova-compute[72150]: DEBUG os_brick.utils [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2b3b98-2ac1-40a1-b4d5-d79d23f811d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[41857639-e65c-443a-836b-9ee15d12b6fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6174921-ef36-48fd-9ddf-fa2193252a23]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cf0844-19a9-4d0f-a0ea-4e7ff17c93ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "7e5b12a0-6673-4e12-b23c-73141346dd83" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "7e5b12a0-6673-4e12-b23c-73141346dd83" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG nova.policy [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9470bee775394bf5a3368d27b64911cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c393fdc0b774cd8a6208200011ba16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:35:47 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[82823961-a3d1-4fb1-bcd2-63f9d1b20fa1]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG os_brick.utils [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Updating existing volume attachment record: 96fff68f-c3a7-45de-92a1-08860ca5072c {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG nova.objects.instance [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lazy-loading 'flavor' on Instance uuid 7e5b12a0-6673-4e12-b23c-73141346dd83 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:35:47 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Ignoring supplied device name: /dev/vdb
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "7e5b12a0-6673-4e12-b23c-73141346dd83" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-bf2d1f14-2227-41d1-bd73-a05ab3149aba" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-bf2d1f14-2227-41d1-bd73-a05ab3149aba" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "7e5b12a0-6673-4e12-b23c-73141346dd83" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "7e5b12a0-6673-4e12-b23c-73141346dd83" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:47 user nova-compute[72150]: INFO nova.compute.manager [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Attaching volume ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 to /dev/vdb
Aug 01 18:35:47 user nova-compute[72150]: DEBUG os_brick.utils [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd1e9de-fa63-4090-95b9-cee6d982caa3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae029eb-6b5d-43f3-b35a-6a3d4d99b33c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05fe966-7654-4ed2-8ae8-c26b93da9244]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b9bbb6-49fb-4c12-a487-7334181166aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:35:47 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaee5c18-1a98-4781-9a9f-62d3ccafb9fc]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG os_brick.utils [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Updating existing volume attachment record: ecdbc36c-c012-45dc-bbf4-164c146eff39 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG nova.network.neutron [req-50d6e961-a039-4bf2-96ef-59cc8b5a4a09 req-2d455f00-f481-42e7-8b11-9229772ad3b0 service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Updated VIF entry in instance network info cache for port a83e9ff9-3d8f-479b-b142-58b06f1901c2. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG nova.network.neutron [req-50d6e961-a039-4bf2-96ef-59cc8b5a4a09 req-2d455f00-f481-42e7-8b11-9229772ad3b0 service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Updating instance_info_cache with network_info: [{"id": "a83e9ff9-3d8f-479b-b142-58b06f1901c2", "address": "fa:16:3e:e7:39:89", "network": {"id": "87bd2699-a52f-4b66-9d6c-fbf9fa54792d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1887490690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efbd504761845f88d59b78115119d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e9ff9-3d", "ovs_interfaceid": "a83e9ff9-3d8f-479b-b142-58b06f1901c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:35:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-50d6e961-a039-4bf2-96ef-59cc8b5a4a09 req-2d455f00-f481-42e7-8b11-9229772ad3b0 service nova] Releasing lock "refresh_cache-7e5b12a0-6673-4e12-b23c-73141346dd83" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:35:48 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Updating instance_info_cache with network_info: [{"id": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "address": "fa:16:3e:63:c8:50", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41eb682d-9c", "ovs_interfaceid": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:35:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-bf2d1f14-2227-41d1-bd73-a05ab3149aba" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:35:48 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:35:48 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:35:48 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:35:48 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:35:48 user nova-compute[72150]: DEBUG nova.network.neutron [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Successfully created port: 8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:35:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:49 user nova-compute[72150]: DEBUG nova.network.neutron [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Successfully updated port: 8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:35:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "refresh_cache-54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:35:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquired lock "refresh_cache-54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:35:49 user nova-compute[72150]: DEBUG nova.network.neutron [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:35:49 user nova-compute[72150]: DEBUG nova.compute.manager [req-61a4686c-6910-4df8-8233-062dcdb88aca req-64813e2a-e4d8-4590-8240-706b5eafaa1a service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Received event network-changed-8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:35:49 user nova-compute[72150]: DEBUG nova.compute.manager [req-61a4686c-6910-4df8-8233-062dcdb88aca req-64813e2a-e4d8-4590-8240-706b5eafaa1a service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Refreshing instance network info cache due to event network-changed-8839e09b-66e1-4465-88d2-19f19dc1b010. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:35:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-61a4686c-6910-4df8-8233-062dcdb88aca req-64813e2a-e4d8-4590-8240-706b5eafaa1a service nova] Acquiring lock "refresh_cache-54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:35:50 user nova-compute[72150]: DEBUG nova.network.neutron [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:35:50 user nova-compute[72150]: DEBUG nova.network.neutron [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Updating instance_info_cache with network_info: [{"id": "8839e09b-66e1-4465-88d2-19f19dc1b010", "address": "fa:16:3e:69:a8:32", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8839e09b-66", "ovs_interfaceid": "8839e09b-66e1-4465-88d2-19f19dc1b010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:35:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Releasing lock "refresh_cache-54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:35:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Instance network_info: |[{"id": "8839e09b-66e1-4465-88d2-19f19dc1b010", "address": "fa:16:3e:69:a8:32", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8839e09b-66", "ovs_interfaceid": "8839e09b-66e1-4465-88d2-19f19dc1b010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:35:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-61a4686c-6910-4df8-8233-062dcdb88aca req-64813e2a-e4d8-4590-8240-706b5eafaa1a service nova] Acquired lock "refresh_cache-54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:35:50 user nova-compute[72150]: DEBUG nova.network.neutron [req-61a4686c-6910-4df8-8233-062dcdb88aca req-64813e2a-e4d8-4590-8240-706b5eafaa1a service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Refreshing network info cache for port 8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:35:51 user nova-compute[72150]: DEBUG nova.network.neutron [req-61a4686c-6910-4df8-8233-062dcdb88aca req-64813e2a-e4d8-4590-8240-706b5eafaa1a service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Updated VIF entry in instance network info cache for port 8839e09b-66e1-4465-88d2-19f19dc1b010. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:35:51 user nova-compute[72150]: DEBUG nova.network.neutron [req-61a4686c-6910-4df8-8233-062dcdb88aca req-64813e2a-e4d8-4590-8240-706b5eafaa1a service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Updating instance_info_cache with network_info: [{"id": "8839e09b-66e1-4465-88d2-19f19dc1b010", "address": "fa:16:3e:69:a8:32", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8839e09b-66", "ovs_interfaceid": "8839e09b-66e1-4465-88d2-19f19dc1b010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:35:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-61a4686c-6910-4df8-8233-062dcdb88aca req-64813e2a-e4d8-4590-8240-706b5eafaa1a service nova] Releasing lock "refresh_cache-54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:35:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "a5f0eca7-d060-4226-b36e-a3cd15b15703" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:51 user nova-compute[72150]: INFO nova.compute.manager [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Terminating instance
Aug 01 18:35:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:35:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG nova.compute.manager [req-d8fd5a09-4167-48d6-9a91-c0ad608d5820 req-a2713552-aca2-4e52-95cf-9817b6965b28 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received event network-vif-unplugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d8fd5a09-4167-48d6-9a91-c0ad608d5820 req-a2713552-aca2-4e52-95cf-9817b6965b28 service nova] Acquiring lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d8fd5a09-4167-48d6-9a91-c0ad608d5820 req-a2713552-aca2-4e52-95cf-9817b6965b28 service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d8fd5a09-4167-48d6-9a91-c0ad608d5820 req-a2713552-aca2-4e52-95cf-9817b6965b28 service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG nova.compute.manager [req-d8fd5a09-4167-48d6-9a91-c0ad608d5820 req-a2713552-aca2-4e52-95cf-9817b6965b28 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] No waiting events found dispatching network-vif-unplugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG nova.compute.manager [req-d8fd5a09-4167-48d6-9a91-c0ad608d5820 req-a2713552-aca2-4e52-95cf-9817b6965b28 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received event network-vif-unplugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:35:52 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Instance destroyed successfully.
Aug 01 18:35:52 user nova-compute[72150]: DEBUG nova.objects.instance [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lazy-loading 'resources' on Instance uuid a5f0eca7-d060-4226-b36e-a3cd15b15703 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1769556587',display_name='tempest-ServerActionsTestOtherB-server-1769556587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1769556587',id=18,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHk1JfNPFXl8HOej4l4GGAFwiUlyr68TuvMkyJFt7CHfDXuZjpGZ30rkbU/oouT3R2Q9X+Pk0+5iMSh/dzvrWC0rsJ078sX31sP2prrj5uYPobmNDT4n3BlWJvWW4raDpA==',key_name='tempest-keypair-792111278',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:33:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d566eb776234eb4a834d0e3f6dd7792',ramdisk_id='',reservation_id='r-o20tu0o3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-623575398',owner_user_name='tempest-ServerActionsTestOtherB-623575398-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68c9836c352b488b934723c56f892c10',uuid=a5f0eca7-d060-4226-b36e-a3cd15b15703,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Converting VIF {"id": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "address": "fa:16:3e:65:82:a8", "network": {"id": "36c41dfd-577c-4ceb-a1f7-69187368b386", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1870690944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d566eb776234eb4a834d0e3f6dd7792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a2205a-4b", "ovs_interfaceid": "e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc,network=Network(36c41dfd-577c-4ceb-a1f7-69187368b386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0a2205a-4b') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG os_vif [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc,network=Network(36c41dfd-577c-4ceb-a1f7-69187368b386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0a2205a-4b') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0a2205a-4b, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:35:52 user nova-compute[72150]: INFO os_vif [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc,network=Network(36c41dfd-577c-4ceb-a1f7-69187368b386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0a2205a-4b')
Aug 01 18:35:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDySdpws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:35:52 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:35:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd23ee9-7fa3-4a8b-a94b-5f2bd372e21f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd864056-2cc8-4b97-9b6c-6b62df149c56]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:35:52 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:35:52 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:35:52 user nova-compute[72150]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:35:52 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:35:52 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:35:52 user nova-compute[72150]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 (non-flash)
Aug 01 18:35:52 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:35:52 user nova-compute[72150]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:35:52 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:35:52 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec44cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834'): ({'sdf'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Removing single pathed devices sdf {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0637d9-4b69-4b80-a602-179fd9543448]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeebcb7-e7e0-46f7-ba4f-04833d9325f4]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Flushing IO for device /dev/sdf {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fce817-8fc7-4ada-b243-c4ec22e7939d]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[218f8be8-8324-4b95-89f5-ac278e7efc08]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] SCSI volumes sdf have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6703dd18-1fba-4b11-b1ad-7b0db4cbb7ff]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdc1a30-b814-4963-b954-5a3f2466472d]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260]
Aug 01 18:35:52 user nova-compute[72150]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834, portal: 172.16.0.220,3260] successful.
Aug 01 18:35:52 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db690b5a-dd50-4971-9f5b-486fad1b1834 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb8331b-2380-49e2-aefd-45bdd9ba8c65]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] <== disconnect_volume: return (340ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:35:52 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Deleting instance files /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703_del
Aug 01 18:35:52 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Deletion of /opt/stack/data/nova/instances/a5f0eca7-d060-4226-b36e-a3cd15b15703_del complete
Aug 01 18:35:52 user nova-compute[72150]: INFO nova.compute.manager [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 01 18:35:52 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:35:52 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:35:53 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:35:53 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Took 0.99 seconds to deallocate network for instance.
Aug 01 18:35:53 user nova-compute[72150]: DEBUG nova.compute.manager [req-3a09bf66-c6b7-4c97-92c9-bbbbe4a708a7 req-26f502f6-74ce-48cb-8a14-3486267d8dd3 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received event network-vif-deleted-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:35:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:54 user nova-compute[72150]: DEBUG nova.compute.manager [req-26db12d7-960b-45e9-aa25-969f0f602628 req-8327b556-06e5-40ba-a0a9-f95de703a7f7 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received event network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:35:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-26db12d7-960b-45e9-aa25-969f0f602628 req-8327b556-06e5-40ba-a0a9-f95de703a7f7 service nova] Acquiring lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-26db12d7-960b-45e9-aa25-969f0f602628 req-8327b556-06e5-40ba-a0a9-f95de703a7f7 service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-26db12d7-960b-45e9-aa25-969f0f602628 req-8327b556-06e5-40ba-a0a9-f95de703a7f7 service nova] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:54 user nova-compute[72150]: DEBUG nova.compute.manager [req-26db12d7-960b-45e9-aa25-969f0f602628 req-8327b556-06e5-40ba-a0a9-f95de703a7f7 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] No waiting events found dispatching network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:35:54 user nova-compute[72150]: WARNING nova.compute.manager [req-26db12d7-960b-45e9-aa25-969f0f602628 req-8327b556-06e5-40ba-a0a9-f95de703a7f7 service nova] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Received unexpected event network-vif-plugged-e0a2205a-4b05-4c7d-bdc9-dbf32c0043bc for instance with vm_state active and task_state deleting.
Aug 01 18:35:54 user nova-compute[72150]: INFO nova.compute.manager [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Took 0.82 seconds to detach 1 volumes for instance.
Aug 01 18:35:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:35:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:35:55 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:35:55 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:35:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:55 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Deleted allocations for instance a5f0eca7-d060-4226-b36e-a3cd15b15703
Aug 01 18:35:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1f9de409-e034-4fa8-aced-a3affdb6bbe3 tempest-ServerActionsTestOtherB-623575398 tempest-ServerActionsTestOtherB-623575398-project-member] Lock "a5f0eca7-d060-4226-b36e-a3cd15b15703" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.664s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:35:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:35:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtTcIEzf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:36:04 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:36:04 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:36:04 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:36:04 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Creating image(s)
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Did not create local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Ensure instance console log exists: /opt/stack/data/nova/instances/54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Start _get_guest_xml network_info=[{"id": "8839e09b-66e1-4465-88d2-19f19dc1b010", "address": "fa:16:3e:69:a8:32", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8839e09b-66", "ovs_interfaceid": "8839e09b-66e1-4465-88d2-19f19dc1b010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '96fff68f-c3a7-45de-92a1-08860ca5072c', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KzEQLnfT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89', 'attached_at': '', 'detached_at': '', 'volume_id': '194b3ab3-36b4-4099-99ce-e23a428c23b9', 'serial': '194b3ab3-36b4-4099-99ce-e23a428c23b9'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[23001c89-f3bd-47f9-848d-b3f569b94419]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:36:04 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:04 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:36:04 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KzEQLnfT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:36:04 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f061be-3046-4734-b4e8-aa2886cd3f0a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9] added
Aug 01 18:36:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[140af111-bf2e-4275-a97a-d2f997c183e2]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44eb4bd-afb6-40ff-a4d4-9fbe61e4bb3c]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JtTcIEzf {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JtTcIEzf" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f479a3cc-1b3b-4db9-8de0-59e214239c5c]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JtTcIEzf'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f7f5a4-96d3-4866-915d-db157aa7a86b]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af7a3d3-fdc2-4fb9-97a3-d46981e121cb]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:36:04 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:36:04 user nova-compute[72150]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:36:04 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:36:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:36:04 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:36:04 user nova-compute[72150]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:36:04 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:36:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64c24b6-9107-478a-83a3-99ff9bdfaa68]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9, portal: 172.16.0.220,3260]
Aug 01 18:36:04 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9, portal: 172.16.0.220,3260] successful.
Aug 01 18:36:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89bc379-beb9-43c2-b95e-dff8dd49819e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[10eacb82-e88a-4c77-9009-d38870d461a3]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:36:04 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:36:04 user nova-compute[72150]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:36:04 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:36:04 user nova-compute[72150]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 (non-flash)
Aug 01 18:36:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:36:04 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:36:04 user nova-compute[72150]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:36:04 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:36:04 user nova-compute[72150]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 (non-flash)
Aug 01 18:36:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.489s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.069s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebbf027-c7a3-4f68-826c-66945e9e4bc6]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:04 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: None {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtTcIEzf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.572s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] <== connect_volume: return (1574ms) {'type': 'block', 'scsi_wwn': '26333303131643739', 'path': '/dev/sdf'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333303131643739', 'path': '/dev/sdf'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.485s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:36:05 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:36:05 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG nova.objects.instance [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lazy-loading 'flavor' on Instance uuid 7e5b12a0-6673-4e12-b23c-73141346dd83 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffd03f4-965e-4aab-9bb8-fc96ce7da37a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:36:05 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:36:05 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:36:05 user nova-compute[72150]:   <source dev="/dev/sdf"/>
Aug 01 18:36:05 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:36:05 user nova-compute[72150]:   <serial>ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9</serial>
Aug 01 18:36:05 user nova-compute[72150]: </disk>
Aug 01 18:36:05 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2503549b-15d9-4f2c-b824-2969f00c10cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9] added
Aug 01 18:36:05 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96a44db-f242-4711-a617-d3472cd84ebf]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6fdf0e-b33a-4e63-b227-da931eeb1458]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KzEQLnfT {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KzEQLnfT" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[661dcde8-09f2-4414-86b7-99e1b1448784]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KzEQLnfT'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfaafd2e-cd20-4b59-b561-f908e91e6100]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[021205eb-3efb-4d77-8561-5acd1ee69ab6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:36:05 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:36:05 user nova-compute[72150]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:36:05 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:36:05 user nova-compute[72150]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 (non-flash)
Aug 01 18:36:05 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:36:05 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:36:05 user nova-compute[72150]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:36:05 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:36:05 user nova-compute[72150]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 (non-flash)
Aug 01 18:36:05 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[333ae879-1779-4ee8-92c4-0deda54ead0b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9, portal: 172.16.0.220,3260]
Aug 01 18:36:05 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9, portal: 172.16.0.220,3260] successful.
Aug 01 18:36:05 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[986e4ea9-b6b4-4a2a-98c5-4e2fb69095da]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[adff8567-4740-4f21-acc3-b882c53099fc]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:36:05 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:36:05 user nova-compute[72150]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:36:05 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:36:05 user nova-compute[72150]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 (non-flash)
Aug 01 18:36:05 user nova-compute[72150]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:36:05 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:36:05 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:36:05 user nova-compute[72150]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:36:05 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:36:05 user nova-compute[72150]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 (non-flash)
Aug 01 18:36:05 user nova-compute[72150]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:36:05 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] HCTL ('38', '-', '-', 0) found on session 39 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:36:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:06 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:06 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb49fb5-e1e4-4ace-92e9-569ed5fbc2ff]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:06 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Searching for a device in session 39 and hctl ['38', '*', '*', 0] yield: None {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:36:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:36:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:36:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] No VIF found with MAC fa:16:3e:e7:39:89, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:36:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8dfe2612-269f-4b2c-bb0e-4414406b0fcc tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "7e5b12a0-6673-4e12-b23c-73141346dd83" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.853s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Searching for a device in session 39 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KzEQLnfT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] <== connect_volume: return (2855ms) {'type': 'block', 'scsi_wwn': '23738336234373635', 'path': '/dev/sdg'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738336234373635', 'path': '/dev/sdg'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:35:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-205787336',display_name='tempest-ServerActionsTestOtherA-server-205787336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-205787336',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJY2FlDJuzmLBeUAuDA5wUSU2UHRGDTZlkebFFQy7IaCc3RvIIFGPPP6kDQA5KkLRYt2dsIc0CUwBhPl2TFzcR9udfpfPek2FdJAmKOoaMyPBsGZqlWc4+qDiA+nCRd2Q==',key_name='tempest-keypair-605536790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c393fdc0b774cd8a6208200011ba16b',ramdisk_id='',reservation_id='r-40eismfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-993571413',owner_user_name='tempest-ServerActionsTestOtherA-993571413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9470bee775394bf5a3368d27b64911cb',uuid=54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8839e09b-66e1-4465-88d2-19f19dc1b010", "address": "fa:16:3e:69:a8:32", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8839e09b-66", "ovs_interfaceid": "8839e09b-66e1-4465-88d2-19f19dc1b010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converting VIF {"id": "8839e09b-66e1-4465-88d2-19f19dc1b010", "address": "fa:16:3e:69:a8:32", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8839e09b-66", "ovs_interfaceid": "8839e09b-66e1-4465-88d2-19f19dc1b010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:a8:32,bridge_name='br-int',has_traffic_filtering=True,id=8839e09b-66e1-4465-88d2-19f19dc1b010,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8839e09b-66') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG nova.objects.instance [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lazy-loading 'pci_devices' on Instance uuid 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:36:07 user nova-compute[72150]:   <uuid>54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89</uuid>
Aug 01 18:36:07 user nova-compute[72150]:   <name>instance-00000021</name>
Aug 01 18:36:07 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:36:07 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:36:07 user nova-compute[72150]:   <metadata>
Aug 01 18:36:07 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:36:07 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:36:07 user nova-compute[72150]:       <nova:name>tempest-ServerActionsTestOtherA-server-205787336</nova:name>
Aug 01 18:36:07 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:36:04</nova:creationTime>
Aug 01 18:36:07 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:36:07 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:36:07 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:36:07 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:36:07 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:36:07 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:36:07 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:36:07 user nova-compute[72150]:       <nova:owner>
Aug 01 18:36:07 user nova-compute[72150]:         <nova:user uuid="9470bee775394bf5a3368d27b64911cb">tempest-ServerActionsTestOtherA-993571413-project-member</nova:user>
Aug 01 18:36:07 user nova-compute[72150]:         <nova:project uuid="1c393fdc0b774cd8a6208200011ba16b">tempest-ServerActionsTestOtherA-993571413</nova:project>
Aug 01 18:36:07 user nova-compute[72150]:       </nova:owner>
Aug 01 18:36:07 user nova-compute[72150]:       <nova:ports>
Aug 01 18:36:07 user nova-compute[72150]:         <nova:port uuid="8839e09b-66e1-4465-88d2-19f19dc1b010">
Aug 01 18:36:07 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 18:36:07 user nova-compute[72150]:         </nova:port>
Aug 01 18:36:07 user nova-compute[72150]:       </nova:ports>
Aug 01 18:36:07 user nova-compute[72150]:     </nova:instance>
Aug 01 18:36:07 user nova-compute[72150]:   </metadata>
Aug 01 18:36:07 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:36:07 user nova-compute[72150]:     <system>
Aug 01 18:36:07 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:36:07 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:36:07 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:36:07 user nova-compute[72150]:       <entry name="serial">54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89</entry>
Aug 01 18:36:07 user nova-compute[72150]:       <entry name="uuid">54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89</entry>
Aug 01 18:36:07 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:36:07 user nova-compute[72150]:     </system>
Aug 01 18:36:07 user nova-compute[72150]:   </sysinfo>
Aug 01 18:36:07 user nova-compute[72150]:   <os>
Aug 01 18:36:07 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:36:07 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:36:07 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:36:07 user nova-compute[72150]:   </os>
Aug 01 18:36:07 user nova-compute[72150]:   <features>
Aug 01 18:36:07 user nova-compute[72150]:     <acpi/>
Aug 01 18:36:07 user nova-compute[72150]:     <apic/>
Aug 01 18:36:07 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:36:07 user nova-compute[72150]:   </features>
Aug 01 18:36:07 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:36:07 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:36:07 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:36:07 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:36:07 user nova-compute[72150]:   </clock>
Aug 01 18:36:07 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:36:07 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:36:07 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:36:07 user nova-compute[72150]:   </cpu>
Aug 01 18:36:07 user nova-compute[72150]:   <devices>
Aug 01 18:36:07 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:36:07 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:36:07 user nova-compute[72150]:       <source dev="/dev/sdg"/>
Aug 01 18:36:07 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:36:07 user nova-compute[72150]:       <serial>194b3ab3-36b4-4099-99ce-e23a428c23b9</serial>
Aug 01 18:36:07 user nova-compute[72150]:     </disk>
Aug 01 18:36:07 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:36:07 user nova-compute[72150]:       <mac address="fa:16:3e:69:a8:32"/>
Aug 01 18:36:07 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:36:07 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:36:07 user nova-compute[72150]:       <target dev="tap8839e09b-66"/>
Aug 01 18:36:07 user nova-compute[72150]:     </interface>
Aug 01 18:36:07 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:36:07 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89/console.log" append="off"/>
Aug 01 18:36:07 user nova-compute[72150]:     </serial>
Aug 01 18:36:07 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:36:07 user nova-compute[72150]:     <video>
Aug 01 18:36:07 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:36:07 user nova-compute[72150]:     </video>
Aug 01 18:36:07 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:36:07 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:36:07 user nova-compute[72150]:     </rng>
Aug 01 18:36:07 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:36:07 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:36:07 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:36:07 user nova-compute[72150]:     </memballoon>
Aug 01 18:36:07 user nova-compute[72150]:   </devices>
Aug 01 18:36:07 user nova-compute[72150]: </domain>
Aug 01 18:36:07 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:35:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-205787336',display_name='tempest-ServerActionsTestOtherA-server-205787336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-205787336',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJY2FlDJuzmLBeUAuDA5wUSU2UHRGDTZlkebFFQy7IaCc3RvIIFGPPP6kDQA5KkLRYt2dsIc0CUwBhPl2TFzcR9udfpfPek2FdJAmKOoaMyPBsGZqlWc4+qDiA+nCRd2Q==',key_name='tempest-keypair-605536790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c393fdc0b774cd8a6208200011ba16b',ramdisk_id='',reservation_id='r-40eismfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-993571413',owner_user_name='tempest-ServerActionsTestOtherA-993571413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9470bee775394bf5a3368d27b64911cb',uuid=54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8839e09b-66e1-4465-88d2-19f19dc1b010", "address": "fa:16:3e:69:a8:32", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8839e09b-66", "ovs_interfaceid": "8839e09b-66e1-4465-88d2-19f19dc1b010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converting VIF {"id": "8839e09b-66e1-4465-88d2-19f19dc1b010", "address": "fa:16:3e:69:a8:32", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8839e09b-66", "ovs_interfaceid": "8839e09b-66e1-4465-88d2-19f19dc1b010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:a8:32,bridge_name='br-int',has_traffic_filtering=True,id=8839e09b-66e1-4465-88d2-19f19dc1b010,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8839e09b-66') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG os_vif [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a8:32,bridge_name='br-int',has_traffic_filtering=True,id=8839e09b-66e1-4465-88d2-19f19dc1b010,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8839e09b-66') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8839e09b-66, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8839e09b-66, col_values=(('external_ids', {'iface-id': '8839e09b-66e1-4465-88d2-19f19dc1b010', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:a8:32', 'vm-uuid': '54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:07 user nova-compute[72150]: INFO os_vif [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a8:32,bridge_name='br-int',has_traffic_filtering=True,id=8839e09b-66e1-4465-88d2-19f19dc1b010,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8839e09b-66')
Aug 01 18:36:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] No VIF found with MAC fa:16:3e:69:a8:32, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:36:07 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914952.4858453, a5f0eca7-d060-4226-b36e-a3cd15b15703 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:36:07 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] VM Stopped (Lifecycle Event)
Aug 01 18:36:07 user nova-compute[72150]: DEBUG nova.compute.manager [None req-b46742e2-9adf-498d-9291-efc26ce0036b None None] [instance: a5f0eca7-d060-4226-b36e-a3cd15b15703] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:36:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:08 user nova-compute[72150]: DEBUG nova.compute.manager [req-ffeb6690-ce0c-4077-8721-d55b3a2354f8 req-9045ff1c-2ca0-4201-8b5d-4e188f99b7f0 service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Received event network-vif-plugged-8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:36:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ffeb6690-ce0c-4077-8721-d55b3a2354f8 req-9045ff1c-2ca0-4201-8b5d-4e188f99b7f0 service nova] Acquiring lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:36:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ffeb6690-ce0c-4077-8721-d55b3a2354f8 req-9045ff1c-2ca0-4201-8b5d-4e188f99b7f0 service nova] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:36:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ffeb6690-ce0c-4077-8721-d55b3a2354f8 req-9045ff1c-2ca0-4201-8b5d-4e188f99b7f0 service nova] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:36:08 user nova-compute[72150]: DEBUG nova.compute.manager [req-ffeb6690-ce0c-4077-8721-d55b3a2354f8 req-9045ff1c-2ca0-4201-8b5d-4e188f99b7f0 service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] No waiting events found dispatching network-vif-plugged-8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:36:08 user nova-compute[72150]: WARNING nova.compute.manager [req-ffeb6690-ce0c-4077-8721-d55b3a2354f8 req-9045ff1c-2ca0-4201-8b5d-4e188f99b7f0 service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Received unexpected event network-vif-plugged-8839e09b-66e1-4465-88d2-19f19dc1b010 for instance with vm_state building and task_state spawning.
Aug 01 18:36:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:10 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914970.836257, 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:36:10 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] VM Resumed (Lifecycle Event)
Aug 01 18:36:10 user nova-compute[72150]: DEBUG nova.compute.manager [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:36:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:36:10 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Instance spawned successfully.
Aug 01 18:36:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:36:10 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:36:10 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:36:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:36:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:36:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:36:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:36:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:36:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:36:10 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:36:10 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690914970.8394, 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:36:10 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] VM Started (Lifecycle Event)
Aug 01 18:36:10 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:36:10 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:36:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-4b2a1766-b89b-4247-b596-bfa9d8406256 req-1d0e305d-18b1-4c90-b43a-b1665b63ba27 service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Received event network-vif-plugged-8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:36:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4b2a1766-b89b-4247-b596-bfa9d8406256 req-1d0e305d-18b1-4c90-b43a-b1665b63ba27 service nova] Acquiring lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:36:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4b2a1766-b89b-4247-b596-bfa9d8406256 req-1d0e305d-18b1-4c90-b43a-b1665b63ba27 service nova] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:36:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4b2a1766-b89b-4247-b596-bfa9d8406256 req-1d0e305d-18b1-4c90-b43a-b1665b63ba27 service nova] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:36:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-4b2a1766-b89b-4247-b596-bfa9d8406256 req-1d0e305d-18b1-4c90-b43a-b1665b63ba27 service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] No waiting events found dispatching network-vif-plugged-8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:36:10 user nova-compute[72150]: WARNING nova.compute.manager [req-4b2a1766-b89b-4247-b596-bfa9d8406256 req-1d0e305d-18b1-4c90-b43a-b1665b63ba27 service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Received unexpected event network-vif-plugged-8839e09b-66e1-4465-88d2-19f19dc1b010 for instance with vm_state building and task_state spawning.
Aug 01 18:36:10 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:36:10 user nova-compute[72150]: INFO nova.compute.manager [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Took 6.88 seconds to spawn the instance on the hypervisor.
Aug 01 18:36:10 user nova-compute[72150]: DEBUG nova.compute.manager [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:36:11 user nova-compute[72150]: INFO nova.compute.manager [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Took 25.20 seconds to build instance.
Aug 01 18:36:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-345a1e65-dea0-4a9e-b73c-60717565e0c1 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.512s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:36:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:36:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "7e5b12a0-6673-4e12-b23c-73141346dd83" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:36:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "7e5b12a0-6673-4e12-b23c-73141346dd83" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:36:28 user nova-compute[72150]: INFO nova.compute.manager [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Detaching volume ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9
Aug 01 18:36:28 user nova-compute[72150]: INFO nova.virt.block_device [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Attempting to driver detach volume ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 from mountpoint /dev/vdb
Aug 01 18:36:28 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Attempting to detach device vdb from instance 7e5b12a0-6673-4e12-b23c-73141346dd83 from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:36:28 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:36:28 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:36:28 user nova-compute[72150]:   <source dev="/dev/sdf"/>
Aug 01 18:36:28 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:36:28 user nova-compute[72150]:   <serial>ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9</serial>
Aug 01 18:36:28 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:36:28 user nova-compute[72150]: </disk>
Aug 01 18:36:28 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:36:28 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Successfully detached device vdb from instance 7e5b12a0-6673-4e12-b23c-73141346dd83 from the persistent domain config.
Aug 01 18:36:28 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e5b12a0-6673-4e12-b23c-73141346dd83 from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:36:28 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:36:28 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:36:28 user nova-compute[72150]:   <source dev="/dev/sdf"/>
Aug 01 18:36:28 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:36:28 user nova-compute[72150]:   <serial>ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9</serial>
Aug 01 18:36:28 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:36:28 user nova-compute[72150]: </disk>
Aug 01 18:36:28 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "7e5b12a0-6673-4e12-b23c-73141346dd83" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690914989.4642072, 7e5b12a0-6673-4e12-b23c-73141346dd83 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e5b12a0-6673-4e12-b23c-73141346dd83 {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:36:29 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Successfully detached device vdb from instance 7e5b12a0-6673-4e12-b23c-73141346dd83 from the live domain config.
Aug 01 18:36:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtTcIEzf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:36:29 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:36:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ffd20e-5002-44a8-8460-bfed9f929506]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c15b5e5-11ff-4970-9005-aa3d15f95b97]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:36:29 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:36:29 user nova-compute[72150]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:36:29 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:36:29 user nova-compute[72150]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 (non-flash)
Aug 01 18:36:29 user nova-compute[72150]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:36:29 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:36:29 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:36:29 user nova-compute[72150]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:36:29 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:36:29 user nova-compute[72150]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 (non-flash)
Aug 01 18:36:29 user nova-compute[72150]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:36:29 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c522a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9'): ({'sdf'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Removing single pathed devices sdf {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec2cfc6-0132-48cc-8aae-108208e9650a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e809d3-fa6f-49a9-8526-7ab2811c1415]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Flushing IO for device /dev/sdf {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e019ef-412c-4568-94f4-4230b9557e28]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[69930b11-e5d3-463e-9287-afb2b20a26d3]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] SCSI volumes sdf have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5fc38a-a202-453b-afad-9cd82988ce04]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7848e7cb-f00c-41e6-b646-0e576e619791]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9, portal: 172.16.0.220,3260]
Aug 01 18:36:29 user nova-compute[72150]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9, portal: 172.16.0.220,3260] successful.
Aug 01 18:36:29 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fdea5d-06fe-4f00-be6d-d00c8268ad74]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] <== disconnect_volume: return (332ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:36:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:36:30 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lazy-loading 'flavor' on Instance uuid 7e5b12a0-6673-4e12-b23c-73141346dd83 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:36:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9df7d908-af88-47db-bac5-03a36d342a63 tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "7e5b12a0-6673-4e12-b23c-73141346dd83" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.814s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:36:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "7e5b12a0-6673-4e12-b23c-73141346dd83" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.615s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:36:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "7e5b12a0-6673-4e12-b23c-73141346dd83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:36:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "7e5b12a0-6673-4e12-b23c-73141346dd83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:36:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "7e5b12a0-6673-4e12-b23c-73141346dd83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:36:30 user nova-compute[72150]: INFO nova.compute.manager [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Terminating instance
Aug 01 18:36:30 user nova-compute[72150]: DEBUG nova.compute.manager [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:36:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG nova.compute.manager [req-dc1b798d-adcc-4e8c-bafc-0695c2842d99 req-f6132d83-9c7a-4fff-a6c0-87306996e67b service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Received event network-vif-unplugged-a83e9ff9-3d8f-479b-b142-58b06f1901c2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-dc1b798d-adcc-4e8c-bafc-0695c2842d99 req-f6132d83-9c7a-4fff-a6c0-87306996e67b service nova] Acquiring lock "7e5b12a0-6673-4e12-b23c-73141346dd83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-dc1b798d-adcc-4e8c-bafc-0695c2842d99 req-f6132d83-9c7a-4fff-a6c0-87306996e67b service nova] Lock "7e5b12a0-6673-4e12-b23c-73141346dd83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-dc1b798d-adcc-4e8c-bafc-0695c2842d99 req-f6132d83-9c7a-4fff-a6c0-87306996e67b service nova] Lock "7e5b12a0-6673-4e12-b23c-73141346dd83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG nova.compute.manager [req-dc1b798d-adcc-4e8c-bafc-0695c2842d99 req-f6132d83-9c7a-4fff-a6c0-87306996e67b service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] No waiting events found dispatching network-vif-unplugged-a83e9ff9-3d8f-479b-b142-58b06f1901c2 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG nova.compute.manager [req-dc1b798d-adcc-4e8c-bafc-0695c2842d99 req-f6132d83-9c7a-4fff-a6c0-87306996e67b service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Received event network-vif-unplugged-a83e9ff9-3d8f-479b-b142-58b06f1901c2 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:36:31 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Instance destroyed successfully.
Aug 01 18:36:31 user nova-compute[72150]: DEBUG nova.objects.instance [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lazy-loading 'resources' on Instance uuid 7e5b12a0-6673-4e12-b23c-73141346dd83 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:33:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-653144405',display_name='tempest-VolumesSnapshotTestJSON-instance-653144405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-653144405',id=29,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwpNLeWawVas+fprRqDj6ZBu94kEPC0iDpL4ztTBVk2dbskvBFKJ0YMcVK7fTLVKRn4jnm2Axcl0np/IlX/+VX6j8ecu7pz11jGJxsn8RGJnfbg4a91TakOYPfJizVeQA==',key_name='tempest-keypair-798821890',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:34:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5efbd504761845f88d59b78115119d62',ramdisk_id='',reservation_id='r-www6h0hu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-710086109',owner_user_name='tempest-VolumesSnapshotTestJSON-710086109-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:34:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c975577646d746d192f038a3608d1f76',uuid=7e5b12a0-6673-4e12-b23c-73141346dd83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a83e9ff9-3d8f-479b-b142-58b06f1901c2", "address": "fa:16:3e:e7:39:89", "network": {"id": "87bd2699-a52f-4b66-9d6c-fbf9fa54792d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1887490690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efbd504761845f88d59b78115119d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e9ff9-3d", "ovs_interfaceid": "a83e9ff9-3d8f-479b-b142-58b06f1901c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Converting VIF {"id": "a83e9ff9-3d8f-479b-b142-58b06f1901c2", "address": "fa:16:3e:e7:39:89", "network": {"id": "87bd2699-a52f-4b66-9d6c-fbf9fa54792d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1887490690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efbd504761845f88d59b78115119d62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e9ff9-3d", "ovs_interfaceid": "a83e9ff9-3d8f-479b-b142-58b06f1901c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:39:89,bridge_name='br-int',has_traffic_filtering=True,id=a83e9ff9-3d8f-479b-b142-58b06f1901c2,network=Network(87bd2699-a52f-4b66-9d6c-fbf9fa54792d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83e9ff9-3d') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG os_vif [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:39:89,bridge_name='br-int',has_traffic_filtering=True,id=a83e9ff9-3d8f-479b-b142-58b06f1901c2,network=Network(87bd2699-a52f-4b66-9d6c-fbf9fa54792d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83e9ff9-3d') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa83e9ff9-3d, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:31 user nova-compute[72150]: INFO os_vif [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:39:89,bridge_name='br-int',has_traffic_filtering=True,id=a83e9ff9-3d8f-479b-b142-58b06f1901c2,network=Network(87bd2699-a52f-4b66-9d6c-fbf9fa54792d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83e9ff9-3d')
Aug 01 18:36:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtTcIEzf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:36:31 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:36:31 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae00f0c6-78ad-4b3e-be16-027e9ac8a0f9', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1e1bc0-d056-422c-92d8-a7b077b0a429]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[87874c60-0544-4aa9-8f87-6674ba05c532]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:36:31 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:36:31 user nova-compute[72150]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:36:31 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:36:31 user nova-compute[72150]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:36:31 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:36:31 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:36:31 user nova-compute[72150]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:36:31 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:36:31 user nova-compute[72150]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:36:31 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c20b7f0>, {}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Disconnecting from: [] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.056s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] <== disconnect_volume: return (58ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:36:31 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Deleting instance files /opt/stack/data/nova/instances/7e5b12a0-6673-4e12-b23c-73141346dd83_del
Aug 01 18:36:31 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Deletion of /opt/stack/data/nova/instances/7e5b12a0-6673-4e12-b23c-73141346dd83_del complete
Aug 01 18:36:31 user nova-compute[72150]: INFO nova.compute.manager [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 01 18:36:31 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:36:31 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:36:32 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:36:32 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:36:32 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Took 1.10 seconds to deallocate network for instance.
Aug 01 18:36:32 user nova-compute[72150]: WARNING nova.volume.cinder [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Attachment ecdbc36c-c012-45dc-bbf4-164c146eff39 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ecdbc36c-c012-45dc-bbf4-164c146eff39. (HTTP 404) (Request-ID: req-a1ae6cfa-5246-4ba0-933a-6efa62a29e1a)
Aug 01 18:36:32 user nova-compute[72150]: INFO nova.compute.manager [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Took 0.03 seconds to detach 1 volumes for instance.
Aug 01 18:36:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:36:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:36:33 user nova-compute[72150]: DEBUG nova.compute.manager [req-833d4ce2-4e59-4b88-b39d-b600505aa61a req-8d37b38e-37d6-492d-bf10-964221d5991e service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Received event network-vif-plugged-a83e9ff9-3d8f-479b-b142-58b06f1901c2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:36:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-833d4ce2-4e59-4b88-b39d-b600505aa61a req-8d37b38e-37d6-492d-bf10-964221d5991e service nova] Acquiring lock "7e5b12a0-6673-4e12-b23c-73141346dd83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:36:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-833d4ce2-4e59-4b88-b39d-b600505aa61a req-8d37b38e-37d6-492d-bf10-964221d5991e service nova] Lock "7e5b12a0-6673-4e12-b23c-73141346dd83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:36:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-833d4ce2-4e59-4b88-b39d-b600505aa61a req-8d37b38e-37d6-492d-bf10-964221d5991e service nova] Lock "7e5b12a0-6673-4e12-b23c-73141346dd83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:36:33 user nova-compute[72150]: DEBUG nova.compute.manager [req-833d4ce2-4e59-4b88-b39d-b600505aa61a req-8d37b38e-37d6-492d-bf10-964221d5991e service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] No waiting events found dispatching network-vif-plugged-a83e9ff9-3d8f-479b-b142-58b06f1901c2 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:36:33 user nova-compute[72150]: WARNING nova.compute.manager [req-833d4ce2-4e59-4b88-b39d-b600505aa61a req-8d37b38e-37d6-492d-bf10-964221d5991e service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Received unexpected event network-vif-plugged-a83e9ff9-3d8f-479b-b142-58b06f1901c2 for instance with vm_state deleted and task_state None.
Aug 01 18:36:33 user nova-compute[72150]: DEBUG nova.compute.manager [req-833d4ce2-4e59-4b88-b39d-b600505aa61a req-8d37b38e-37d6-492d-bf10-964221d5991e service nova] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Received event network-vif-deleted-a83e9ff9-3d8f-479b-b142-58b06f1901c2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:36:33 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:36:33 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:36:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:36:33 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Deleted allocations for instance 7e5b12a0-6673-4e12-b23c-73141346dd83
Aug 01 18:36:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-635cc392-317b-4121-a1f7-891d6e9e9adb tempest-VolumesSnapshotTestJSON-710086109 tempest-VolumesSnapshotTestJSON-710086109-project-member] Lock "7e5b12a0-6673-4e12-b23c-73141346dd83" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.735s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:36:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:38 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:36:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:39 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:36:39 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:36:39 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:36:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:41 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:36:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:36:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:36:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:36:41 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:36:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:42 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd12a8f9-593d-4e48-97f8-64e210d46d77/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd12a8f9-593d-4e48-97f8-64e210d46d77/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd12a8f9-593d-4e48-97f8-64e210d46d77/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd12a8f9-593d-4e48-97f8-64e210d46d77/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:36:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:36:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:36:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:36:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:36:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:45 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:36:45 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:36:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=7256MB free_disk=25.343116760253906GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:36:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:36:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:36:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 769690c8-53c5-4057-88a5-fbdbcb930e32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:36:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ea68420b-8362-4df3-b710-cd1cf76adba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:36:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 08851ec4-6f71-4ec1-a092-42aab83ee87f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:36:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance bf2d1f14-2227-41d1-bd73-a05ab3149aba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:36:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 42e75a98-beb1-4688-a375-affc63b14252 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:36:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance b10328c7-3328-4c3c-8ebe-3dd282ece0c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:36:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 65b04144-3b1f-4975-8524-2c9f9660672a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:36:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance fd12a8f9-593d-4e48-97f8-64e210d46d77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:36:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance d2117837-5552-4ec3-9f9b-62629c1ff4cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:36:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 493a8db6-68da-4c4e-88e4-2d6d949020e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:36:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:36:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:36:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:36:45 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:36:45 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:36:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:36:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.553s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:36:46 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690914991.4847717, 7e5b12a0-6673-4e12-b23c-73141346dd83 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:36:46 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] VM Stopped (Lifecycle Event)
Aug 01 18:36:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-a8289aad-c680-4be1-adf7-3a017bd5871d None None] [instance: 7e5b12a0-6673-4e12-b23c-73141346dd83] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:36:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:46 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:36:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:36:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-42e75a98-beb1-4688-a375-affc63b14252" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:36:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-42e75a98-beb1-4688-a375-affc63b14252" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:36:46 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:36:47 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Updating instance_info_cache with network_info: [{"id": "10529340-a252-4604-accb-19f26670f125", "address": "fa:16:3e:56:f4:53", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10529340-a2", "ovs_interfaceid": "10529340-a252-4604-accb-19f26670f125", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:36:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-42e75a98-beb1-4688-a375-affc63b14252" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:36:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:36:47 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:36:47 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:36:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:36:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:49 user nova-compute[72150]: DEBUG nova.compute.manager [req-79138281-f883-4c1d-b601-24ecdd7f6ee7 req-05265f30-c506-4bee-a740-b3a9214237c7 service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Received event network-changed-9478d2ba-2463-48fc-a572-a162788e22c3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:36:49 user nova-compute[72150]: DEBUG nova.compute.manager [req-79138281-f883-4c1d-b601-24ecdd7f6ee7 req-05265f30-c506-4bee-a740-b3a9214237c7 service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Refreshing instance network info cache due to event network-changed-9478d2ba-2463-48fc-a572-a162788e22c3. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:36:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-79138281-f883-4c1d-b601-24ecdd7f6ee7 req-05265f30-c506-4bee-a740-b3a9214237c7 service nova] Acquiring lock "refresh_cache-fd12a8f9-593d-4e48-97f8-64e210d46d77" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:36:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-79138281-f883-4c1d-b601-24ecdd7f6ee7 req-05265f30-c506-4bee-a740-b3a9214237c7 service nova] Acquired lock "refresh_cache-fd12a8f9-593d-4e48-97f8-64e210d46d77" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:36:49 user nova-compute[72150]: DEBUG nova.network.neutron [req-79138281-f883-4c1d-b601-24ecdd7f6ee7 req-05265f30-c506-4bee-a740-b3a9214237c7 service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Refreshing network info cache for port 9478d2ba-2463-48fc-a572-a162788e22c3 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:36:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "fd12a8f9-593d-4e48-97f8-64e210d46d77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:36:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "fd12a8f9-593d-4e48-97f8-64e210d46d77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:36:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "fd12a8f9-593d-4e48-97f8-64e210d46d77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:36:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "fd12a8f9-593d-4e48-97f8-64e210d46d77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:36:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "fd12a8f9-593d-4e48-97f8-64e210d46d77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:36:50 user nova-compute[72150]: INFO nova.compute.manager [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Terminating instance
Aug 01 18:36:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:36:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:51 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Instance destroyed successfully.
Aug 01 18:36:51 user nova-compute[72150]: DEBUG nova.objects.instance [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lazy-loading 'resources' on Instance uuid fd12a8f9-593d-4e48-97f8-64e210d46d77 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:34:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2064079036',display_name='tempest-AttachVolumeNegativeTest-server-2064079036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2064079036',id=30,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBu0JOY2VhCFH2ZfZz3TVbtKO6Srcvjl6d8IR+3sF6wWYYTNOKGabCWVjf3bt/bpBeMz4RXWGsJcTA0j7QIJ36ZSvbzPr9921ZZlvaZL69wp9DflJHw6OW81OgmViCL1Bg==',key_name='tempest-keypair-230423268',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:35:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66bad8c4e2a74caf8d35ad98e7888266',ramdisk_id='',reservation_id='r-pwifie1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-504132593',owner_user_name='tempest-AttachVolumeNegativeTest-504132593-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:35:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f11bcc2f9cc048beb928fc0d3c30403e',uuid=fd12a8f9-593d-4e48-97f8-64e210d46d77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9478d2ba-2463-48fc-a572-a162788e22c3", "address": "fa:16:3e:38:92:c3", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9478d2ba-24", "ovs_interfaceid": "9478d2ba-2463-48fc-a572-a162788e22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converting VIF {"id": "9478d2ba-2463-48fc-a572-a162788e22c3", "address": "fa:16:3e:38:92:c3", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9478d2ba-24", "ovs_interfaceid": "9478d2ba-2463-48fc-a572-a162788e22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:92:c3,bridge_name='br-int',has_traffic_filtering=True,id=9478d2ba-2463-48fc-a572-a162788e22c3,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9478d2ba-24') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG os_vif [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:92:c3,bridge_name='br-int',has_traffic_filtering=True,id=9478d2ba-2463-48fc-a572-a162788e22c3,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9478d2ba-24') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9478d2ba-24, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:36:51 user nova-compute[72150]: INFO os_vif [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:92:c3,bridge_name='br-int',has_traffic_filtering=True,id=9478d2ba-2463-48fc-a572-a162788e22c3,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9478d2ba-24')
Aug 01 18:36:51 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Deleting instance files /opt/stack/data/nova/instances/fd12a8f9-593d-4e48-97f8-64e210d46d77_del
Aug 01 18:36:51 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Deletion of /opt/stack/data/nova/instances/fd12a8f9-593d-4e48-97f8-64e210d46d77_del complete
Aug 01 18:36:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG nova.network.neutron [req-79138281-f883-4c1d-b601-24ecdd7f6ee7 req-05265f30-c506-4bee-a740-b3a9214237c7 service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Updated VIF entry in instance network info cache for port 9478d2ba-2463-48fc-a572-a162788e22c3. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG nova.network.neutron [req-79138281-f883-4c1d-b601-24ecdd7f6ee7 req-05265f30-c506-4bee-a740-b3a9214237c7 service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Updating instance_info_cache with network_info: [{"id": "9478d2ba-2463-48fc-a572-a162788e22c3", "address": "fa:16:3e:38:92:c3", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9478d2ba-24", "ovs_interfaceid": "9478d2ba-2463-48fc-a572-a162788e22c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-79138281-f883-4c1d-b601-24ecdd7f6ee7 req-05265f30-c506-4bee-a740-b3a9214237c7 service nova] Releasing lock "refresh_cache-fd12a8f9-593d-4e48-97f8-64e210d46d77" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:36:51 user nova-compute[72150]: INFO nova.compute.manager [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 01 18:36:51 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-be0a4ca1-ed98-460f-8a8d-9c995926ff08 req-8f9c3217-743d-44fb-a101-17c132a2851e service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Received event network-vif-unplugged-9478d2ba-2463-48fc-a572-a162788e22c3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-be0a4ca1-ed98-460f-8a8d-9c995926ff08 req-8f9c3217-743d-44fb-a101-17c132a2851e service nova] Acquiring lock "fd12a8f9-593d-4e48-97f8-64e210d46d77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-be0a4ca1-ed98-460f-8a8d-9c995926ff08 req-8f9c3217-743d-44fb-a101-17c132a2851e service nova] Lock "fd12a8f9-593d-4e48-97f8-64e210d46d77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-be0a4ca1-ed98-460f-8a8d-9c995926ff08 req-8f9c3217-743d-44fb-a101-17c132a2851e service nova] Lock "fd12a8f9-593d-4e48-97f8-64e210d46d77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-be0a4ca1-ed98-460f-8a8d-9c995926ff08 req-8f9c3217-743d-44fb-a101-17c132a2851e service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] No waiting events found dispatching network-vif-unplugged-9478d2ba-2463-48fc-a572-a162788e22c3 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-be0a4ca1-ed98-460f-8a8d-9c995926ff08 req-8f9c3217-743d-44fb-a101-17c132a2851e service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Received event network-vif-unplugged-9478d2ba-2463-48fc-a572-a162788e22c3 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-be0a4ca1-ed98-460f-8a8d-9c995926ff08 req-8f9c3217-743d-44fb-a101-17c132a2851e service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Received event network-vif-plugged-9478d2ba-2463-48fc-a572-a162788e22c3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-be0a4ca1-ed98-460f-8a8d-9c995926ff08 req-8f9c3217-743d-44fb-a101-17c132a2851e service nova] Acquiring lock "fd12a8f9-593d-4e48-97f8-64e210d46d77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-be0a4ca1-ed98-460f-8a8d-9c995926ff08 req-8f9c3217-743d-44fb-a101-17c132a2851e service nova] Lock "fd12a8f9-593d-4e48-97f8-64e210d46d77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-be0a4ca1-ed98-460f-8a8d-9c995926ff08 req-8f9c3217-743d-44fb-a101-17c132a2851e service nova] Lock "fd12a8f9-593d-4e48-97f8-64e210d46d77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:36:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-be0a4ca1-ed98-460f-8a8d-9c995926ff08 req-8f9c3217-743d-44fb-a101-17c132a2851e service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] No waiting events found dispatching network-vif-plugged-9478d2ba-2463-48fc-a572-a162788e22c3 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:36:51 user nova-compute[72150]: WARNING nova.compute.manager [req-be0a4ca1-ed98-460f-8a8d-9c995926ff08 req-8f9c3217-743d-44fb-a101-17c132a2851e service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Received unexpected event network-vif-plugged-9478d2ba-2463-48fc-a572-a162788e22c3 for instance with vm_state active and task_state deleting.
Aug 01 18:36:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8169a9ba-fba9-4853-b3ca-b48163899956 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:36:52 user nova-compute[72150]: INFO nova.compute.manager [None req-8169a9ba-fba9-4853-b3ca-b48163899956 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] instance snapshotting
Aug 01 18:36:52 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-8169a9ba-fba9-4853-b3ca-b48163899956 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Beginning live snapshot process
Aug 01 18:36:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8169a9ba-fba9-4853-b3ca-b48163899956 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json -f qcow2 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8169a9ba-fba9-4853-b3ca-b48163899956 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json -f qcow2" returned: 0 in 0.157s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8169a9ba-fba9-4853-b3ca-b48163899956 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json -f qcow2 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:52 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:36:52 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Took 1.40 seconds to deallocate network for instance.
Aug 01 18:36:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8169a9ba-fba9-4853-b3ca-b48163899956 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8169a9ba-fba9-4853-b3ca-b48163899956 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:36:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:36:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8169a9ba-fba9-4853-b3ca-b48163899956 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.174s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8169a9ba-fba9-4853-b3ca-b48163899956 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpoynrdtlz/42a31f6829f3480abc4c5b71a889d8b4.delta 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8169a9ba-fba9-4853-b3ca-b48163899956 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpoynrdtlz/42a31f6829f3480abc4c5b71a889d8b4.delta 1073741824" returned: 0 in 0.054s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:52 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-8169a9ba-fba9-4853-b3ca-b48163899956 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 18:36:53 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:36:53 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:36:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.612s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:36:53 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Deleted allocations for instance fd12a8f9-593d-4e48-97f8-64e210d46d77
Aug 01 18:36:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d6dcc760-1da7-452e-8ff1-20dd115185e8 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "fd12a8f9-593d-4e48-97f8-64e210d46d77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.269s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:36:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-8169a9ba-fba9-4853-b3ca-b48163899956 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:36:53 user nova-compute[72150]: DEBUG nova.compute.manager [req-019cff9d-301c-4f9f-857e-9b9db41590bd req-e41d5948-1921-4fd5-91f8-df5dc5459517 service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Received event network-vif-plugged-9478d2ba-2463-48fc-a572-a162788e22c3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:36:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-019cff9d-301c-4f9f-857e-9b9db41590bd req-e41d5948-1921-4fd5-91f8-df5dc5459517 service nova] Acquiring lock "fd12a8f9-593d-4e48-97f8-64e210d46d77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:36:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-019cff9d-301c-4f9f-857e-9b9db41590bd req-e41d5948-1921-4fd5-91f8-df5dc5459517 service nova] Lock "fd12a8f9-593d-4e48-97f8-64e210d46d77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:36:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-019cff9d-301c-4f9f-857e-9b9db41590bd req-e41d5948-1921-4fd5-91f8-df5dc5459517 service nova] Lock "fd12a8f9-593d-4e48-97f8-64e210d46d77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:36:53 user nova-compute[72150]: DEBUG nova.compute.manager [req-019cff9d-301c-4f9f-857e-9b9db41590bd req-e41d5948-1921-4fd5-91f8-df5dc5459517 service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] No waiting events found dispatching network-vif-plugged-9478d2ba-2463-48fc-a572-a162788e22c3 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:36:53 user nova-compute[72150]: WARNING nova.compute.manager [req-019cff9d-301c-4f9f-857e-9b9db41590bd req-e41d5948-1921-4fd5-91f8-df5dc5459517 service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Received unexpected event network-vif-plugged-9478d2ba-2463-48fc-a572-a162788e22c3 for instance with vm_state deleted and task_state None.
Aug 01 18:36:53 user nova-compute[72150]: DEBUG nova.compute.manager [req-019cff9d-301c-4f9f-857e-9b9db41590bd req-e41d5948-1921-4fd5-91f8-df5dc5459517 service nova] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Received event network-vif-deleted-9478d2ba-2463-48fc-a572-a162788e22c3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:36:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-8169a9ba-fba9-4853-b3ca-b48163899956 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] COPY block job progress, current cursor: 14614528 final cursor: 75497472 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:36:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-8169a9ba-fba9-4853-b3ca-b48163899956 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:36:54 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-8169a9ba-fba9-4853-b3ca-b48163899956 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 18:36:54 user nova-compute[72150]: DEBUG nova.privsep.utils [None req-8169a9ba-fba9-4853-b3ca-b48163899956 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72150) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 18:36:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8169a9ba-fba9-4853-b3ca-b48163899956 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpoynrdtlz/42a31f6829f3480abc4c5b71a889d8b4.delta /opt/stack/data/nova/instances/snapshots/tmpoynrdtlz/42a31f6829f3480abc4c5b71a889d8b4 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:36:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-8169a9ba-fba9-4853-b3ca-b48163899956 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpoynrdtlz/42a31f6829f3480abc4c5b71a889d8b4.delta /opt/stack/data/nova/instances/snapshots/tmpoynrdtlz/42a31f6829f3480abc4c5b71a889d8b4" returned: 0 in 0.634s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:36:55 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-8169a9ba-fba9-4853-b3ca-b48163899956 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Snapshot extracted, beginning image upload
Aug 01 18:36:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:36:58 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-8169a9ba-fba9-4853-b3ca-b48163899956 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Snapshot image upload complete
Aug 01 18:36:58 user nova-compute[72150]: INFO nova.compute.manager [None req-8169a9ba-fba9-4853-b3ca-b48163899956 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Took 6.06 seconds to snapshot the instance on the hypervisor.
Aug 01 18:37:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Acquiring lock "737a8853-f9b9-4a0b-95a1-200d72c4d806" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "737a8853-f9b9-4a0b-95a1-200d72c4d806" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:05 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:37:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:05 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:37:05 user nova-compute[72150]: INFO nova.compute.claims [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Claim successful on node user
Aug 01 18:37:06 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915011.0301075, fd12a8f9-593d-4e48-97f8-64e210d46d77 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:37:06 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] VM Stopped (Lifecycle Event)
Aug 01 18:37:06 user nova-compute[72150]: DEBUG nova.compute.manager [None req-0a24c83b-4cff-4ebb-a7a5-f1cfa65c1165 None None] [instance: fd12a8f9-593d-4e48-97f8-64e210d46d77] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:37:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:06 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:37:06 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:37:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:06 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:37:06 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:37:06 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:37:06 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:37:06 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:37:06 user nova-compute[72150]: DEBUG nova.policy [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dccfa49288a945b9b0707c140b0b2cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871994ab4c4848dfbe070a8d9c8d1d4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:37:06 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:37:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:37:06 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Creating image(s)
Aug 01 18:37:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Acquiring lock "/opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "/opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "/opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:06 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:06 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.144s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:06 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk 1073741824" returned: 0 in 0.149s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.180s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:07 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Checking if we can resize image /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:37:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:07 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Cannot resize image /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:37:07 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lazy-loading 'migration_context' on Instance uuid 737a8853-f9b9-4a0b-95a1-200d72c4d806 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:37:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:37:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Ensure instance console log exists: /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:37:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:08 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Successfully created port: 67195cf7-c741-410b-9937-c55bc570631f {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:37:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:09 user nova-compute[72150]: DEBUG nova.compute.manager [req-537df008-022f-40ed-b8ca-e7a9afde3fc5 req-810a5fbb-17a2-414b-90de-16fbfe7d16e2 service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Received event network-changed-573fb408-5920-43c6-8e49-326b86965b0c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:37:09 user nova-compute[72150]: DEBUG nova.compute.manager [req-537df008-022f-40ed-b8ca-e7a9afde3fc5 req-810a5fbb-17a2-414b-90de-16fbfe7d16e2 service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Refreshing instance network info cache due to event network-changed-573fb408-5920-43c6-8e49-326b86965b0c. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:37:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-537df008-022f-40ed-b8ca-e7a9afde3fc5 req-810a5fbb-17a2-414b-90de-16fbfe7d16e2 service nova] Acquiring lock "refresh_cache-493a8db6-68da-4c4e-88e4-2d6d949020e8" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:37:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-537df008-022f-40ed-b8ca-e7a9afde3fc5 req-810a5fbb-17a2-414b-90de-16fbfe7d16e2 service nova] Acquired lock "refresh_cache-493a8db6-68da-4c4e-88e4-2d6d949020e8" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:37:09 user nova-compute[72150]: DEBUG nova.network.neutron [req-537df008-022f-40ed-b8ca-e7a9afde3fc5 req-810a5fbb-17a2-414b-90de-16fbfe7d16e2 service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Refreshing network info cache for port 573fb408-5920-43c6-8e49-326b86965b0c {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:37:09 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Successfully updated port: 67195cf7-c741-410b-9937-c55bc570631f {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:37:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Acquiring lock "refresh_cache-737a8853-f9b9-4a0b-95a1-200d72c4d806" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:37:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Acquired lock "refresh_cache-737a8853-f9b9-4a0b-95a1-200d72c4d806" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:37:09 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:37:09 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.network.neutron [req-537df008-022f-40ed-b8ca-e7a9afde3fc5 req-810a5fbb-17a2-414b-90de-16fbfe7d16e2 service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Updated VIF entry in instance network info cache for port 573fb408-5920-43c6-8e49-326b86965b0c. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.network.neutron [req-537df008-022f-40ed-b8ca-e7a9afde3fc5 req-810a5fbb-17a2-414b-90de-16fbfe7d16e2 service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Updating instance_info_cache with network_info: [{"id": "573fb408-5920-43c6-8e49-326b86965b0c", "address": "fa:16:3e:89:7e:2a", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap573fb408-59", "ovs_interfaceid": "573fb408-5920-43c6-8e49-326b86965b0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-537df008-022f-40ed-b8ca-e7a9afde3fc5 req-810a5fbb-17a2-414b-90de-16fbfe7d16e2 service nova] Releasing lock "refresh_cache-493a8db6-68da-4c4e-88e4-2d6d949020e8" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "493a8db6-68da-4c4e-88e4-2d6d949020e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "493a8db6-68da-4c4e-88e4-2d6d949020e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "493a8db6-68da-4c4e-88e4-2d6d949020e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "493a8db6-68da-4c4e-88e4-2d6d949020e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "493a8db6-68da-4c4e-88e4-2d6d949020e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:10 user nova-compute[72150]: INFO nova.compute.manager [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Terminating instance
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.compute.manager [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Updating instance_info_cache with network_info: [{"id": "67195cf7-c741-410b-9937-c55bc570631f", "address": "fa:16:3e:ae:2a:f2", "network": {"id": "c7354620-f943-40a7-a673-5e6e9103498d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205923950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871994ab4c4848dfbe070a8d9c8d1d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67195cf7-c7", "ovs_interfaceid": "67195cf7-c741-410b-9937-c55bc570631f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Releasing lock "refresh_cache-737a8853-f9b9-4a0b-95a1-200d72c4d806" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Instance network_info: |[{"id": "67195cf7-c741-410b-9937-c55bc570631f", "address": "fa:16:3e:ae:2a:f2", "network": {"id": "c7354620-f943-40a7-a673-5e6e9103498d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205923950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871994ab4c4848dfbe070a8d9c8d1d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67195cf7-c7", "ovs_interfaceid": "67195cf7-c741-410b-9937-c55bc570631f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Start _get_guest_xml network_info=[{"id": "67195cf7-c741-410b-9937-c55bc570631f", "address": "fa:16:3e:ae:2a:f2", "network": {"id": "c7354620-f943-40a7-a673-5e6e9103498d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205923950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871994ab4c4848dfbe070a8d9c8d1d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67195cf7-c7", "ovs_interfaceid": "67195cf7-c741-410b-9937-c55bc570631f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:37:10 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:37:10 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:37:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:37:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1874196053',display_name='tempest-ServersNegativeTestJSON-server-1874196053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1874196053',id=34,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='871994ab4c4848dfbe070a8d9c8d1d4e',ramdisk_id='',reservation_id='r-6744yyrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1642498340',owner_user_name='tempest-ServersNegativeTestJSON-1642498340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:37:07Z,user_data=None,user_id='dccfa49288a945b9b0707c140b0b2cbb',uuid=737a8853-f9b9-4a0b-95a1-200d72c4d806,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67195cf7-c741-410b-9937-c55bc570631f", "address": "fa:16:3e:ae:2a:f2", "network": {"id": "c7354620-f943-40a7-a673-5e6e9103498d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205923950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871994ab4c4848dfbe070a8d9c8d1d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67195cf7-c7", "ovs_interfaceid": "67195cf7-c741-410b-9937-c55bc570631f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Converting VIF {"id": "67195cf7-c741-410b-9937-c55bc570631f", "address": "fa:16:3e:ae:2a:f2", "network": {"id": "c7354620-f943-40a7-a673-5e6e9103498d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205923950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871994ab4c4848dfbe070a8d9c8d1d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67195cf7-c7", "ovs_interfaceid": "67195cf7-c741-410b-9937-c55bc570631f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2a:f2,bridge_name='br-int',has_traffic_filtering=True,id=67195cf7-c741-410b-9937-c55bc570631f,network=Network(c7354620-f943-40a7-a673-5e6e9103498d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67195cf7-c7') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lazy-loading 'pci_devices' on Instance uuid 737a8853-f9b9-4a0b-95a1-200d72c4d806 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:37:10 user nova-compute[72150]:   <uuid>737a8853-f9b9-4a0b-95a1-200d72c4d806</uuid>
Aug 01 18:37:10 user nova-compute[72150]:   <name>instance-00000022</name>
Aug 01 18:37:10 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:37:10 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:37:10 user nova-compute[72150]:   <metadata>
Aug 01 18:37:10 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:37:10 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:37:10 user nova-compute[72150]:       <nova:name>tempest-ServersNegativeTestJSON-server-1874196053</nova:name>
Aug 01 18:37:10 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:37:10</nova:creationTime>
Aug 01 18:37:10 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:37:10 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:37:10 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:37:10 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:37:10 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:37:10 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:37:10 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:37:10 user nova-compute[72150]:       <nova:owner>
Aug 01 18:37:10 user nova-compute[72150]:         <nova:user uuid="dccfa49288a945b9b0707c140b0b2cbb">tempest-ServersNegativeTestJSON-1642498340-project-member</nova:user>
Aug 01 18:37:10 user nova-compute[72150]:         <nova:project uuid="871994ab4c4848dfbe070a8d9c8d1d4e">tempest-ServersNegativeTestJSON-1642498340</nova:project>
Aug 01 18:37:10 user nova-compute[72150]:       </nova:owner>
Aug 01 18:37:10 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:37:10 user nova-compute[72150]:       <nova:ports>
Aug 01 18:37:10 user nova-compute[72150]:         <nova:port uuid="67195cf7-c741-410b-9937-c55bc570631f">
Aug 01 18:37:10 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 18:37:10 user nova-compute[72150]:         </nova:port>
Aug 01 18:37:10 user nova-compute[72150]:       </nova:ports>
Aug 01 18:37:10 user nova-compute[72150]:     </nova:instance>
Aug 01 18:37:10 user nova-compute[72150]:   </metadata>
Aug 01 18:37:10 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:37:10 user nova-compute[72150]:     <system>
Aug 01 18:37:10 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:37:10 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:37:10 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:37:10 user nova-compute[72150]:       <entry name="serial">737a8853-f9b9-4a0b-95a1-200d72c4d806</entry>
Aug 01 18:37:10 user nova-compute[72150]:       <entry name="uuid">737a8853-f9b9-4a0b-95a1-200d72c4d806</entry>
Aug 01 18:37:10 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:37:10 user nova-compute[72150]:     </system>
Aug 01 18:37:10 user nova-compute[72150]:   </sysinfo>
Aug 01 18:37:10 user nova-compute[72150]:   <os>
Aug 01 18:37:10 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:37:10 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:37:10 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:37:10 user nova-compute[72150]:   </os>
Aug 01 18:37:10 user nova-compute[72150]:   <features>
Aug 01 18:37:10 user nova-compute[72150]:     <acpi/>
Aug 01 18:37:10 user nova-compute[72150]:     <apic/>
Aug 01 18:37:10 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:37:10 user nova-compute[72150]:   </features>
Aug 01 18:37:10 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:37:10 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:37:10 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:37:10 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:37:10 user nova-compute[72150]:   </clock>
Aug 01 18:37:10 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:37:10 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:37:10 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:37:10 user nova-compute[72150]:   </cpu>
Aug 01 18:37:10 user nova-compute[72150]:   <devices>
Aug 01 18:37:10 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:37:10 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:37:10 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk"/>
Aug 01 18:37:10 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:37:10 user nova-compute[72150]:     </disk>
Aug 01 18:37:10 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:37:10 user nova-compute[72150]:       <mac address="fa:16:3e:ae:2a:f2"/>
Aug 01 18:37:10 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:37:10 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:37:10 user nova-compute[72150]:       <target dev="tap67195cf7-c7"/>
Aug 01 18:37:10 user nova-compute[72150]:     </interface>
Aug 01 18:37:10 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:37:10 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/console.log" append="off"/>
Aug 01 18:37:10 user nova-compute[72150]:     </serial>
Aug 01 18:37:10 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:37:10 user nova-compute[72150]:     <video>
Aug 01 18:37:10 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:37:10 user nova-compute[72150]:     </video>
Aug 01 18:37:10 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:37:10 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:37:10 user nova-compute[72150]:     </rng>
Aug 01 18:37:10 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:37:10 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:37:10 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:37:10 user nova-compute[72150]:     </memballoon>
Aug 01 18:37:10 user nova-compute[72150]:   </devices>
Aug 01 18:37:10 user nova-compute[72150]: </domain>
Aug 01 18:37:10 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:37:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1874196053',display_name='tempest-ServersNegativeTestJSON-server-1874196053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1874196053',id=34,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='871994ab4c4848dfbe070a8d9c8d1d4e',ramdisk_id='',reservation_id='r-6744yyrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1642498340',owner_user_name='tempest-ServersNegativeTestJSON-1642498340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:37:07Z,user_data=None,user_id='dccfa49288a945b9b0707c140b0b2cbb',uuid=737a8853-f9b9-4a0b-95a1-200d72c4d806,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67195cf7-c741-410b-9937-c55bc570631f", "address": "fa:16:3e:ae:2a:f2", "network": {"id": "c7354620-f943-40a7-a673-5e6e9103498d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205923950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871994ab4c4848dfbe070a8d9c8d1d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67195cf7-c7", "ovs_interfaceid": "67195cf7-c741-410b-9937-c55bc570631f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Converting VIF {"id": "67195cf7-c741-410b-9937-c55bc570631f", "address": "fa:16:3e:ae:2a:f2", "network": {"id": "c7354620-f943-40a7-a673-5e6e9103498d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205923950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871994ab4c4848dfbe070a8d9c8d1d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67195cf7-c7", "ovs_interfaceid": "67195cf7-c741-410b-9937-c55bc570631f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2a:f2,bridge_name='br-int',has_traffic_filtering=True,id=67195cf7-c741-410b-9937-c55bc570631f,network=Network(c7354620-f943-40a7-a673-5e6e9103498d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67195cf7-c7') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG os_vif [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2a:f2,bridge_name='br-int',has_traffic_filtering=True,id=67195cf7-c741-410b-9937-c55bc570631f,network=Network(c7354620-f943-40a7-a673-5e6e9103498d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67195cf7-c7') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67195cf7-c7, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67195cf7-c7, col_values=(('external_ids', {'iface-id': '67195cf7-c741-410b-9937-c55bc570631f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:2a:f2', 'vm-uuid': '737a8853-f9b9-4a0b-95a1-200d72c4d806'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:10 user nova-compute[72150]: INFO os_vif [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2a:f2,bridge_name='br-int',has_traffic_filtering=True,id=67195cf7-c741-410b-9937-c55bc570631f,network=Network(c7354620-f943-40a7-a673-5e6e9103498d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67195cf7-c7')
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] No VIF found with MAC fa:16:3e:ae:2a:f2, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-c66e2b96-aee6-446a-a84e-fda11f2ec3f2 req-7aa0e3c8-11fb-4dd0-b77b-e67341ba7067 service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Received event network-vif-unplugged-573fb408-5920-43c6-8e49-326b86965b0c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c66e2b96-aee6-446a-a84e-fda11f2ec3f2 req-7aa0e3c8-11fb-4dd0-b77b-e67341ba7067 service nova] Acquiring lock "493a8db6-68da-4c4e-88e4-2d6d949020e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c66e2b96-aee6-446a-a84e-fda11f2ec3f2 req-7aa0e3c8-11fb-4dd0-b77b-e67341ba7067 service nova] Lock "493a8db6-68da-4c4e-88e4-2d6d949020e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c66e2b96-aee6-446a-a84e-fda11f2ec3f2 req-7aa0e3c8-11fb-4dd0-b77b-e67341ba7067 service nova] Lock "493a8db6-68da-4c4e-88e4-2d6d949020e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-c66e2b96-aee6-446a-a84e-fda11f2ec3f2 req-7aa0e3c8-11fb-4dd0-b77b-e67341ba7067 service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] No waiting events found dispatching network-vif-unplugged-573fb408-5920-43c6-8e49-326b86965b0c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:37:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-c66e2b96-aee6-446a-a84e-fda11f2ec3f2 req-7aa0e3c8-11fb-4dd0-b77b-e67341ba7067 service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Received event network-vif-unplugged-573fb408-5920-43c6-8e49-326b86965b0c for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:37:11 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Instance destroyed successfully.
Aug 01 18:37:11 user nova-compute[72150]: DEBUG nova.objects.instance [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lazy-loading 'resources' on Instance uuid 493a8db6-68da-4c4e-88e4-2d6d949020e8 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:35:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2128942014',display_name='tempest-TestVolumeBootPattern-server-2128942014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2128942014',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVf3lHt050k356A8Gut9WieNqP8u9vIp5xdHm1rq7ONC5kHGtGA6mBo7SyXu2T5UgJrBcaDoeDkrLO73m2dxgj5g1F2RdpTy7mOLuxRD5SR618gGiTwTven5q6qp8rd8g==',key_name='tempest-TestVolumeBootPattern-35567601',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:35:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7ca44f23b114893afcfe57c52f693b1',ramdisk_id='',reservation_id='r-o9vk0fpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-295340968',owner_user_name='tempest-TestVolumeBootPattern-295340968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:35:30Z,user_data=None,user_id='92c7ef0ed6814f8880de76adb913a487',uuid=493a8db6-68da-4c4e-88e4-2d6d949020e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "573fb408-5920-43c6-8e49-326b86965b0c", "address": "fa:16:3e:89:7e:2a", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap573fb408-59", "ovs_interfaceid": "573fb408-5920-43c6-8e49-326b86965b0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converting VIF {"id": "573fb408-5920-43c6-8e49-326b86965b0c", "address": "fa:16:3e:89:7e:2a", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap573fb408-59", "ovs_interfaceid": "573fb408-5920-43c6-8e49-326b86965b0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:7e:2a,bridge_name='br-int',has_traffic_filtering=True,id=573fb408-5920-43c6-8e49-326b86965b0c,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap573fb408-59') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG os_vif [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:7e:2a,bridge_name='br-int',has_traffic_filtering=True,id=573fb408-5920-43c6-8e49-326b86965b0c,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap573fb408-59') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap573fb408-59, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:11 user nova-compute[72150]: INFO os_vif [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:7e:2a,bridge_name='br-int',has_traffic_filtering=True,id=573fb408-5920-43c6-8e49-326b86965b0c,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap573fb408-59')
Aug 01 18:37:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTkRwigS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:37:11 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:37:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b28b7fa-52e7-473c-9f65-19a3442a518e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab3259d-b3bd-49f9-875c-086d59ac917c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:37:11 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:37:11 user nova-compute[72150]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:37:11 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:37:11 user nova-compute[72150]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:37:11 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:37:11 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:37:11 user nova-compute[72150]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:37:11 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:37:11 user nova-compute[72150]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:37:11 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec44d120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052'): ({'sdd'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Removing single pathed devices sdd {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b0eb45-3f95-43fe-a194-ccb8b1665905]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4290aac9-6d9b-40e6-a467-efc99a058578]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Flushing IO for device /dev/sdd {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG nova.compute.manager [req-ea6160be-bd0a-414f-b59a-16463df74bcb req-88d7fb9d-eb7e-414d-a21d-cb31029ac551 service nova] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Received event network-changed-67195cf7-c741-410b-9937-c55bc570631f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG nova.compute.manager [req-ea6160be-bd0a-414f-b59a-16463df74bcb req-88d7fb9d-eb7e-414d-a21d-cb31029ac551 service nova] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Refreshing instance network info cache due to event network-changed-67195cf7-c741-410b-9937-c55bc570631f. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ea6160be-bd0a-414f-b59a-16463df74bcb req-88d7fb9d-eb7e-414d-a21d-cb31029ac551 service nova] Acquiring lock "refresh_cache-737a8853-f9b9-4a0b-95a1-200d72c4d806" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ea6160be-bd0a-414f-b59a-16463df74bcb req-88d7fb9d-eb7e-414d-a21d-cb31029ac551 service nova] Acquired lock "refresh_cache-737a8853-f9b9-4a0b-95a1-200d72c4d806" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG nova.network.neutron [req-ea6160be-bd0a-414f-b59a-16463df74bcb req-88d7fb9d-eb7e-414d-a21d-cb31029ac551 service nova] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Refreshing network info cache for port 67195cf7-c741-410b-9937-c55bc570631f {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[54530fb1-efc9-44b3-a80a-56b77fc331ab]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee798872-2125-45c1-9a3f-8b65f4efb249]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] SCSI volumes sdd have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[488170fa-73d0-45f6-bcfe-1f7386ef898d]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ca65d3-47db-4353-823b-54581571f24d]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052, portal: 172.16.0.220,3260]
Aug 01 18:37:11 user nova-compute[72150]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052, portal: 172.16.0.220,3260] successful.
Aug 01 18:37:11 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d7d850-01e4-453b-b0f0-7881d3867b22]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] <== disconnect_volume: return (334ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:37:11 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Deleting instance files /opt/stack/data/nova/instances/493a8db6-68da-4c4e-88e4-2d6d949020e8_del
Aug 01 18:37:11 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Deletion of /opt/stack/data/nova/instances/493a8db6-68da-4c4e-88e4-2d6d949020e8_del complete
Aug 01 18:37:11 user nova-compute[72150]: INFO nova.compute.manager [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Took 1.71 seconds to destroy the instance on the hypervisor.
Aug 01 18:37:11 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:37:11 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:37:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:12 user nova-compute[72150]: DEBUG nova.network.neutron [req-ea6160be-bd0a-414f-b59a-16463df74bcb req-88d7fb9d-eb7e-414d-a21d-cb31029ac551 service nova] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Updated VIF entry in instance network info cache for port 67195cf7-c741-410b-9937-c55bc570631f. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:37:12 user nova-compute[72150]: DEBUG nova.network.neutron [req-ea6160be-bd0a-414f-b59a-16463df74bcb req-88d7fb9d-eb7e-414d-a21d-cb31029ac551 service nova] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Updating instance_info_cache with network_info: [{"id": "67195cf7-c741-410b-9937-c55bc570631f", "address": "fa:16:3e:ae:2a:f2", "network": {"id": "c7354620-f943-40a7-a673-5e6e9103498d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205923950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871994ab4c4848dfbe070a8d9c8d1d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67195cf7-c7", "ovs_interfaceid": "67195cf7-c741-410b-9937-c55bc570631f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:37:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ea6160be-bd0a-414f-b59a-16463df74bcb req-88d7fb9d-eb7e-414d-a21d-cb31029ac551 service nova] Releasing lock "refresh_cache-737a8853-f9b9-4a0b-95a1-200d72c4d806" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:37:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:13 user nova-compute[72150]: DEBUG nova.compute.manager [req-86ea9cc9-7926-49ff-b892-babe112cc7b3 req-e5ae381e-64fe-4a10-9448-2829866625dc service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Received event network-vif-plugged-573fb408-5920-43c6-8e49-326b86965b0c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:37:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-86ea9cc9-7926-49ff-b892-babe112cc7b3 req-e5ae381e-64fe-4a10-9448-2829866625dc service nova] Acquiring lock "493a8db6-68da-4c4e-88e4-2d6d949020e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-86ea9cc9-7926-49ff-b892-babe112cc7b3 req-e5ae381e-64fe-4a10-9448-2829866625dc service nova] Lock "493a8db6-68da-4c4e-88e4-2d6d949020e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-86ea9cc9-7926-49ff-b892-babe112cc7b3 req-e5ae381e-64fe-4a10-9448-2829866625dc service nova] Lock "493a8db6-68da-4c4e-88e4-2d6d949020e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:13 user nova-compute[72150]: DEBUG nova.compute.manager [req-86ea9cc9-7926-49ff-b892-babe112cc7b3 req-e5ae381e-64fe-4a10-9448-2829866625dc service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] No waiting events found dispatching network-vif-plugged-573fb408-5920-43c6-8e49-326b86965b0c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:37:13 user nova-compute[72150]: WARNING nova.compute.manager [req-86ea9cc9-7926-49ff-b892-babe112cc7b3 req-e5ae381e-64fe-4a10-9448-2829866625dc service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Received unexpected event network-vif-plugged-573fb408-5920-43c6-8e49-326b86965b0c for instance with vm_state active and task_state deleting.
Aug 01 18:37:13 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:37:13 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Took 1.55 seconds to deallocate network for instance.
Aug 01 18:37:13 user nova-compute[72150]: DEBUG nova.compute.manager [req-a24dee0a-8b1f-453b-800e-f4f7921aef42 req-d5a764f9-33ec-4c51-af0b-0f87a218834f service nova] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Received event network-vif-plugged-67195cf7-c741-410b-9937-c55bc570631f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:37:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a24dee0a-8b1f-453b-800e-f4f7921aef42 req-d5a764f9-33ec-4c51-af0b-0f87a218834f service nova] Acquiring lock "737a8853-f9b9-4a0b-95a1-200d72c4d806-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a24dee0a-8b1f-453b-800e-f4f7921aef42 req-d5a764f9-33ec-4c51-af0b-0f87a218834f service nova] Lock "737a8853-f9b9-4a0b-95a1-200d72c4d806-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a24dee0a-8b1f-453b-800e-f4f7921aef42 req-d5a764f9-33ec-4c51-af0b-0f87a218834f service nova] Lock "737a8853-f9b9-4a0b-95a1-200d72c4d806-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:13 user nova-compute[72150]: DEBUG nova.compute.manager [req-a24dee0a-8b1f-453b-800e-f4f7921aef42 req-d5a764f9-33ec-4c51-af0b-0f87a218834f service nova] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] No waiting events found dispatching network-vif-plugged-67195cf7-c741-410b-9937-c55bc570631f {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:37:13 user nova-compute[72150]: WARNING nova.compute.manager [req-a24dee0a-8b1f-453b-800e-f4f7921aef42 req-d5a764f9-33ec-4c51-af0b-0f87a218834f service nova] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Received unexpected event network-vif-plugged-67195cf7-c741-410b-9937-c55bc570631f for instance with vm_state building and task_state spawning.
Aug 01 18:37:13 user nova-compute[72150]: DEBUG nova.compute.manager [req-a24dee0a-8b1f-453b-800e-f4f7921aef42 req-d5a764f9-33ec-4c51-af0b-0f87a218834f service nova] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Received event network-vif-plugged-67195cf7-c741-410b-9937-c55bc570631f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:37:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a24dee0a-8b1f-453b-800e-f4f7921aef42 req-d5a764f9-33ec-4c51-af0b-0f87a218834f service nova] Acquiring lock "737a8853-f9b9-4a0b-95a1-200d72c4d806-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a24dee0a-8b1f-453b-800e-f4f7921aef42 req-d5a764f9-33ec-4c51-af0b-0f87a218834f service nova] Lock "737a8853-f9b9-4a0b-95a1-200d72c4d806-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a24dee0a-8b1f-453b-800e-f4f7921aef42 req-d5a764f9-33ec-4c51-af0b-0f87a218834f service nova] Lock "737a8853-f9b9-4a0b-95a1-200d72c4d806-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:13 user nova-compute[72150]: DEBUG nova.compute.manager [req-a24dee0a-8b1f-453b-800e-f4f7921aef42 req-d5a764f9-33ec-4c51-af0b-0f87a218834f service nova] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] No waiting events found dispatching network-vif-plugged-67195cf7-c741-410b-9937-c55bc570631f {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:37:13 user nova-compute[72150]: WARNING nova.compute.manager [req-a24dee0a-8b1f-453b-800e-f4f7921aef42 req-d5a764f9-33ec-4c51-af0b-0f87a218834f service nova] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Received unexpected event network-vif-plugged-67195cf7-c741-410b-9937-c55bc570631f for instance with vm_state building and task_state spawning.
Aug 01 18:37:14 user nova-compute[72150]: INFO nova.compute.manager [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Took 0.82 seconds to detach 1 volumes for instance.
Aug 01 18:37:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:14 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:37:14 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:37:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:14 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Deleted allocations for instance 493a8db6-68da-4c4e-88e4-2d6d949020e8
Aug 01 18:37:14 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915034.8617575, 737a8853-f9b9-4a0b-95a1-200d72c4d806 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:37:14 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] VM Resumed (Lifecycle Event)
Aug 01 18:37:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:37:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:37:14 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Instance spawned successfully.
Aug 01 18:37:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:37:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:37:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:37:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:37:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:37:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:37:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:37:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:37:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:37:14 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:37:14 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915034.863139, 737a8853-f9b9-4a0b-95a1-200d72c4d806 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:37:14 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] VM Started (Lifecycle Event)
Aug 01 18:37:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:37:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:37:14 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:37:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c158e90c-fe39-4729-bfdd-d7d29d93b551 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "493a8db6-68da-4c4e-88e4-2d6d949020e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.727s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:14 user nova-compute[72150]: INFO nova.compute.manager [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Took 8.19 seconds to spawn the instance on the hypervisor.
Aug 01 18:37:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:37:15 user nova-compute[72150]: INFO nova.compute.manager [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Took 9.21 seconds to build instance.
Aug 01 18:37:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9b54d151-74b5-466a-8bb4-038793d26f7d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "737a8853-f9b9-4a0b-95a1-200d72c4d806" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.316s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:15 user nova-compute[72150]: DEBUG nova.compute.manager [req-e405e032-ae9c-41ec-b4bc-eea955dfb565 req-c45ec319-f233-4f7d-a281-041e0739ab1a service nova] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Received event network-vif-deleted-573fb408-5920-43c6-8e49-326b86965b0c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:37:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:23 user nova-compute[72150]: INFO nova.compute.manager [None req-587df716-4d9c-420e-bc83-b42b68b237a7 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Unrescuing
Aug 01 18:37:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-587df716-4d9c-420e-bc83-b42b68b237a7 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "refresh_cache-65b04144-3b1f-4975-8524-2c9f9660672a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:37:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-587df716-4d9c-420e-bc83-b42b68b237a7 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquired lock "refresh_cache-65b04144-3b1f-4975-8524-2c9f9660672a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:37:23 user nova-compute[72150]: DEBUG nova.network.neutron [None req-587df716-4d9c-420e-bc83-b42b68b237a7 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:37:24 user nova-compute[72150]: DEBUG nova.network.neutron [None req-587df716-4d9c-420e-bc83-b42b68b237a7 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Updating instance_info_cache with network_info: [{"id": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "address": "fa:16:3e:fd:8c:16", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1bb810-d0", "ovs_interfaceid": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:37:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-587df716-4d9c-420e-bc83-b42b68b237a7 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Releasing lock "refresh_cache-65b04144-3b1f-4975-8524-2c9f9660672a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:37:24 user nova-compute[72150]: DEBUG nova.objects.instance [None req-587df716-4d9c-420e-bc83-b42b68b237a7 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'flavor' on Instance uuid 65b04144-3b1f-4975-8524-2c9f9660672a {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:37:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:25 user nova-compute[72150]: DEBUG nova.compute.manager [req-f60e462c-ef08-4571-85d6-2ba7bff62591 req-e94f8c49-b768-44fc-9e42-39180f2bd6c3 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received event network-vif-unplugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:37:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f60e462c-ef08-4571-85d6-2ba7bff62591 req-e94f8c49-b768-44fc-9e42-39180f2bd6c3 service nova] Acquiring lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f60e462c-ef08-4571-85d6-2ba7bff62591 req-e94f8c49-b768-44fc-9e42-39180f2bd6c3 service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f60e462c-ef08-4571-85d6-2ba7bff62591 req-e94f8c49-b768-44fc-9e42-39180f2bd6c3 service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:25 user nova-compute[72150]: DEBUG nova.compute.manager [req-f60e462c-ef08-4571-85d6-2ba7bff62591 req-e94f8c49-b768-44fc-9e42-39180f2bd6c3 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] No waiting events found dispatching network-vif-unplugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:37:25 user nova-compute[72150]: WARNING nova.compute.manager [req-f60e462c-ef08-4571-85d6-2ba7bff62591 req-e94f8c49-b768-44fc-9e42-39180f2bd6c3 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received unexpected event network-vif-unplugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:37:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:25 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Instance destroyed successfully.
Aug 01 18:37:26 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915031.5202835, 493a8db6-68da-4c4e-88e4-2d6d949020e8 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:37:26 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] VM Stopped (Lifecycle Event)
Aug 01 18:37:26 user nova-compute[72150]: DEBUG nova.compute.manager [None req-a6377749-18ca-4639-b9b5-ecd0e0d615a7 None None] [instance: 493a8db6-68da-4c4e-88e4-2d6d949020e8] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:37:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:27 user nova-compute[72150]: DEBUG nova.compute.manager [req-bc624d5b-a541-4253-8075-826f37c421e1 req-3483468b-029a-4183-8bcf-2ed525ec4c07 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received event network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:37:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bc624d5b-a541-4253-8075-826f37c421e1 req-3483468b-029a-4183-8bcf-2ed525ec4c07 service nova] Acquiring lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bc624d5b-a541-4253-8075-826f37c421e1 req-3483468b-029a-4183-8bcf-2ed525ec4c07 service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bc624d5b-a541-4253-8075-826f37c421e1 req-3483468b-029a-4183-8bcf-2ed525ec4c07 service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:27 user nova-compute[72150]: DEBUG nova.compute.manager [req-bc624d5b-a541-4253-8075-826f37c421e1 req-3483468b-029a-4183-8bcf-2ed525ec4c07 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] No waiting events found dispatching network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:37:27 user nova-compute[72150]: WARNING nova.compute.manager [req-bc624d5b-a541-4253-8075-826f37c421e1 req-3483468b-029a-4183-8bcf-2ed525ec4c07 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received unexpected event network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:37:27 user nova-compute[72150]: DEBUG nova.compute.manager [req-bc624d5b-a541-4253-8075-826f37c421e1 req-3483468b-029a-4183-8bcf-2ed525ec4c07 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received event network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:37:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bc624d5b-a541-4253-8075-826f37c421e1 req-3483468b-029a-4183-8bcf-2ed525ec4c07 service nova] Acquiring lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bc624d5b-a541-4253-8075-826f37c421e1 req-3483468b-029a-4183-8bcf-2ed525ec4c07 service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bc624d5b-a541-4253-8075-826f37c421e1 req-3483468b-029a-4183-8bcf-2ed525ec4c07 service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:27 user nova-compute[72150]: DEBUG nova.compute.manager [req-bc624d5b-a541-4253-8075-826f37c421e1 req-3483468b-029a-4183-8bcf-2ed525ec4c07 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] No waiting events found dispatching network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:37:27 user nova-compute[72150]: WARNING nova.compute.manager [req-bc624d5b-a541-4253-8075-826f37c421e1 req-3483468b-029a-4183-8bcf-2ed525ec4c07 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received unexpected event network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:37:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-4de4a471-82a9-48a7-a5e5-6d146bcb0685 req-0c3c2018-62c5-4feb-861a-f97eb22c54a9 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received event network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:37:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4de4a471-82a9-48a7-a5e5-6d146bcb0685 req-0c3c2018-62c5-4feb-861a-f97eb22c54a9 service nova] Acquiring lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4de4a471-82a9-48a7-a5e5-6d146bcb0685 req-0c3c2018-62c5-4feb-861a-f97eb22c54a9 service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4de4a471-82a9-48a7-a5e5-6d146bcb0685 req-0c3c2018-62c5-4feb-861a-f97eb22c54a9 service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-4de4a471-82a9-48a7-a5e5-6d146bcb0685 req-0c3c2018-62c5-4feb-861a-f97eb22c54a9 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] No waiting events found dispatching network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:37:29 user nova-compute[72150]: WARNING nova.compute.manager [req-4de4a471-82a9-48a7-a5e5-6d146bcb0685 req-0c3c2018-62c5-4feb-861a-f97eb22c54a9 service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received unexpected event network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:37:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Removed pending event for 65b04144-3b1f-4975-8524-2c9f9660672a due to event {{(pid=72150) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 18:37:29 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915049.1655746, 65b04144-3b1f-4975-8524-2c9f9660672a => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:37:29 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] VM Resumed (Lifecycle Event)
Aug 01 18:37:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-587df716-4d9c-420e-bc83-b42b68b237a7 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:37:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:37:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:37:29 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 18:37:29 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915049.167141, 65b04144-3b1f-4975-8524-2c9f9660672a => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:37:29 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] VM Started (Lifecycle Event)
Aug 01 18:37:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:37:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:37:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:32 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:37:32 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72150) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 18:37:33 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:37:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:36 user nova-compute[72150]: DEBUG nova.compute.manager [req-2070af6a-4f4f-461f-95d6-7488d33ae2ba req-c308d319-815b-4c00-ad9e-f3a4720cc29f service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Received event network-changed-41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:37:36 user nova-compute[72150]: DEBUG nova.compute.manager [req-2070af6a-4f4f-461f-95d6-7488d33ae2ba req-c308d319-815b-4c00-ad9e-f3a4720cc29f service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Refreshing instance network info cache due to event network-changed-41eb682d-9c56-46b8-bd1d-b479d120b8a1. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:37:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2070af6a-4f4f-461f-95d6-7488d33ae2ba req-c308d319-815b-4c00-ad9e-f3a4720cc29f service nova] Acquiring lock "refresh_cache-bf2d1f14-2227-41d1-bd73-a05ab3149aba" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:37:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2070af6a-4f4f-461f-95d6-7488d33ae2ba req-c308d319-815b-4c00-ad9e-f3a4720cc29f service nova] Acquired lock "refresh_cache-bf2d1f14-2227-41d1-bd73-a05ab3149aba" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:37:36 user nova-compute[72150]: DEBUG nova.network.neutron [req-2070af6a-4f4f-461f-95d6-7488d33ae2ba req-c308d319-815b-4c00-ad9e-f3a4720cc29f service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Refreshing network info cache for port 41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:37:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:37 user nova-compute[72150]: DEBUG nova.network.neutron [req-2070af6a-4f4f-461f-95d6-7488d33ae2ba req-c308d319-815b-4c00-ad9e-f3a4720cc29f service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Updated VIF entry in instance network info cache for port 41eb682d-9c56-46b8-bd1d-b479d120b8a1. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:37:37 user nova-compute[72150]: DEBUG nova.network.neutron [req-2070af6a-4f4f-461f-95d6-7488d33ae2ba req-c308d319-815b-4c00-ad9e-f3a4720cc29f service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Updating instance_info_cache with network_info: [{"id": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "address": "fa:16:3e:63:c8:50", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41eb682d-9c", "ovs_interfaceid": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:37:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2070af6a-4f4f-461f-95d6-7488d33ae2ba req-c308d319-815b-4c00-ad9e-f3a4720cc29f service nova] Releasing lock "refresh_cache-bf2d1f14-2227-41d1-bd73-a05ab3149aba" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:37:38 user nova-compute[72150]: DEBUG nova.compute.manager [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Stashing vm_state: active {{(pid=72150) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 01 18:37:38 user nova-compute[72150]: DEBUG nova.compute.manager [req-852437b2-bd1f-4b0d-98a0-74b184cc3bd2 req-6a30633c-6995-47d0-aa5a-185b158b9ab6 service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Received event network-changed-8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:37:38 user nova-compute[72150]: DEBUG nova.compute.manager [req-852437b2-bd1f-4b0d-98a0-74b184cc3bd2 req-6a30633c-6995-47d0-aa5a-185b158b9ab6 service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Refreshing instance network info cache due to event network-changed-8839e09b-66e1-4465-88d2-19f19dc1b010. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:37:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-852437b2-bd1f-4b0d-98a0-74b184cc3bd2 req-6a30633c-6995-47d0-aa5a-185b158b9ab6 service nova] Acquiring lock "refresh_cache-54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:37:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-852437b2-bd1f-4b0d-98a0-74b184cc3bd2 req-6a30633c-6995-47d0-aa5a-185b158b9ab6 service nova] Acquired lock "refresh_cache-54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:37:38 user nova-compute[72150]: DEBUG nova.network.neutron [req-852437b2-bd1f-4b0d-98a0-74b184cc3bd2 req-6a30633c-6995-47d0-aa5a-185b158b9ab6 service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Refreshing network info cache for port 8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:37:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:38 user nova-compute[72150]: DEBUG nova.objects.instance [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lazy-loading 'pci_requests' on Instance uuid 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:37:38 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:37:38 user nova-compute[72150]: INFO nova.compute.claims [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Claim successful on node user
Aug 01 18:37:38 user nova-compute[72150]: DEBUG nova.objects.instance [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lazy-loading 'resources' on Instance uuid 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:37:38 user nova-compute[72150]: DEBUG nova.objects.instance [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lazy-loading 'pci_devices' on Instance uuid 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:37:39 user nova-compute[72150]: INFO nova.compute.resource_tracker [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Updating resource usage from migration 3de744ad-9181-4023-8bdc-93e18fae964d
Aug 01 18:37:39 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:37:39 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:37:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.615s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:39 user nova-compute[72150]: INFO nova.compute.manager [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Migrating
Aug 01 18:37:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "refresh_cache-54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:37:39 user nova-compute[72150]: DEBUG nova.network.neutron [req-852437b2-bd1f-4b0d-98a0-74b184cc3bd2 req-6a30633c-6995-47d0-aa5a-185b158b9ab6 service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Updated VIF entry in instance network info cache for port 8839e09b-66e1-4465-88d2-19f19dc1b010. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:37:39 user nova-compute[72150]: DEBUG nova.network.neutron [req-852437b2-bd1f-4b0d-98a0-74b184cc3bd2 req-6a30633c-6995-47d0-aa5a-185b158b9ab6 service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Updating instance_info_cache with network_info: [{"id": "8839e09b-66e1-4465-88d2-19f19dc1b010", "address": "fa:16:3e:69:a8:32", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8839e09b-66", "ovs_interfaceid": "8839e09b-66e1-4465-88d2-19f19dc1b010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:37:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-852437b2-bd1f-4b0d-98a0-74b184cc3bd2 req-6a30633c-6995-47d0-aa5a-185b158b9ab6 service nova] Releasing lock "refresh_cache-54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:37:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquired lock "refresh_cache-54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:37:39 user nova-compute[72150]: DEBUG nova.network.neutron [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:37:39 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:37:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:40 user nova-compute[72150]: DEBUG nova.network.neutron [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Updating instance_info_cache with network_info: [{"id": "8839e09b-66e1-4465-88d2-19f19dc1b010", "address": "fa:16:3e:69:a8:32", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8839e09b-66", "ovs_interfaceid": "8839e09b-66e1-4465-88d2-19f19dc1b010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:37:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Releasing lock "refresh_cache-54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:37:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Starting migrate_disk_and_power_off {{(pid=72150) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 01 18:37:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:40 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:37:40 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:37:40 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:37:40 user nova-compute[72150]: DEBUG nova.compute.manager [req-e11c2114-d470-49ca-adf3-73caf5b2633c req-5f9311dd-294f-4e86-981c-607296b6ea99 service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Received event network-vif-unplugged-8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:37:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e11c2114-d470-49ca-adf3-73caf5b2633c req-5f9311dd-294f-4e86-981c-607296b6ea99 service nova] Acquiring lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e11c2114-d470-49ca-adf3-73caf5b2633c req-5f9311dd-294f-4e86-981c-607296b6ea99 service nova] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e11c2114-d470-49ca-adf3-73caf5b2633c req-5f9311dd-294f-4e86-981c-607296b6ea99 service nova] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:40 user nova-compute[72150]: DEBUG nova.compute.manager [req-e11c2114-d470-49ca-adf3-73caf5b2633c req-5f9311dd-294f-4e86-981c-607296b6ea99 service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] No waiting events found dispatching network-vif-unplugged-8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:37:40 user nova-compute[72150]: WARNING nova.compute.manager [req-e11c2114-d470-49ca-adf3-73caf5b2633c req-5f9311dd-294f-4e86-981c-607296b6ea99 service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Received unexpected event network-vif-unplugged-8839e09b-66e1-4465-88d2-19f19dc1b010 for instance with vm_state active and task_state resize_migrating.
Aug 01 18:37:40 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Instance destroyed successfully.
Aug 01 18:37:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:35:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-205787336',display_name='tempest-ServerActionsTestOtherA-server-205787336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-205787336',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJY2FlDJuzmLBeUAuDA5wUSU2UHRGDTZlkebFFQy7IaCc3RvIIFGPPP6kDQA5KkLRYt2dsIc0CUwBhPl2TFzcR9udfpfPek2FdJAmKOoaMyPBsGZqlWc4+qDiA+nCRd2Q==',key_name='tempest-keypair-605536790',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:36:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1c393fdc0b774cd8a6208200011ba16b',ramdisk_id='',reservation_id='r-40eismfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-993571413',owner_user_name='tempest-ServerActionsTestOtherA-993571413-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:37:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9470bee775394bf5a3368d27b64911cb',uuid=54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8839e09b-66e1-4465-88d2-19f19dc1b010", "address": "fa:16:3e:69:a8:32", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-258752565-network", "vif_mac": "fa:16:3e:69:a8:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8839e09b-66", "ovs_interfaceid": "8839e09b-66e1-4465-88d2-19f19dc1b010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:37:40 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converting VIF {"id": "8839e09b-66e1-4465-88d2-19f19dc1b010", "address": "fa:16:3e:69:a8:32", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-258752565-network", "vif_mac": "fa:16:3e:69:a8:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8839e09b-66", "ovs_interfaceid": "8839e09b-66e1-4465-88d2-19f19dc1b010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:37:40 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:a8:32,bridge_name='br-int',has_traffic_filtering=True,id=8839e09b-66e1-4465-88d2-19f19dc1b010,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8839e09b-66') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:37:40 user nova-compute[72150]: DEBUG os_vif [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:a8:32,bridge_name='br-int',has_traffic_filtering=True,id=8839e09b-66e1-4465-88d2-19f19dc1b010,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8839e09b-66') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:37:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8839e09b-66, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:41 user nova-compute[72150]: INFO os_vif [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:a8:32,bridge_name='br-int',has_traffic_filtering=True,id=8839e09b-66e1-4465-88d2-19f19dc1b010,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8839e09b-66')
Aug 01 18:37:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KzEQLnfT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:37:41 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:37:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3512e4-2f55-4238-ace4-62137587abb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5895180-5cfc-4590-a430-996f8da9c0f2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:37:41 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:37:41 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:37:41 user nova-compute[72150]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:37:41 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:37:41 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:37:41 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:37:41 user nova-compute[72150]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:37:41 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec39a0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9'): ({'sdg'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Removing single pathed devices sdg {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[257ef98d-ff25-4d05-813f-470d2742fa1d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2646748-ace8-4d27-b239-fa0c34871d78]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Flushing IO for device /dev/sdg {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d38ab13-2b60-4668-9d86-6be5b70c9977]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1a51dd-bc68-4e82-b92f-7e88067cddce]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] SCSI volumes sdg have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3d97d586', '/dev/disk/by-id/scsi-1SCST_BIO3d97d586-783b4765381d4d63', '/dev/disk/by-id/scsi-23738336234373635') {{(pid=82940) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae5beb8-45ef-4556-9f75-74c5334d7c6f]: (4, None) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bf77d5-cad0-4239-b269-8d454cad738f]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5eb5db-5be3-4172-bfbc-9016d42bba3c]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9, portal: 172.16.0.220,3260]
Aug 01 18:37:41 user nova-compute[72150]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9, portal: 172.16.0.220,3260] successful.
Aug 01 18:37:41 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6ac5b2-90f6-41b7-bf60-82e74ceedbb7]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] <== disconnect_volume: return (337ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:37:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:37:42 user nova-compute[72150]: DEBUG nova.network.neutron [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Port 8839e09b-66e1-4465-88d2-19f19dc1b010 binding to destination host user is already ACTIVE {{(pid=72150) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 18:37:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:42 user nova-compute[72150]: INFO nova.compute.manager [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Detaching volume 489f01df-bee5-47d2-a63a-8f1445b81f73
Aug 01 18:37:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:42 user nova-compute[72150]: INFO nova.virt.block_device [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Attempting to driver detach volume 489f01df-bee5-47d2-a63a-8f1445b81f73 from mountpoint /dev/vdb
Aug 01 18:37:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Attempting to detach device vdb from instance b10328c7-3328-4c3c-8ebe-3dd282ece0c9 from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:37:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:37:42 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:37:42 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 18:37:42 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:37:42 user nova-compute[72150]:   <serial>489f01df-bee5-47d2-a63a-8f1445b81f73</serial>
Aug 01 18:37:42 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:37:42 user nova-compute[72150]: </disk>
Aug 01 18:37:42 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:37:42 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Successfully detached device vdb from instance b10328c7-3328-4c3c-8ebe-3dd282ece0c9 from the persistent domain config.
Aug 01 18:37:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b10328c7-3328-4c3c-8ebe-3dd282ece0c9 from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:37:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:37:42 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:37:42 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 18:37:42 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:37:42 user nova-compute[72150]:   <serial>489f01df-bee5-47d2-a63a-8f1445b81f73</serial>
Aug 01 18:37:42 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:37:42 user nova-compute[72150]: </disk>
Aug 01 18:37:42 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:37:42 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:37:42 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:37:42 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Didn't find any instances for network info cache update. {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 18:37:42 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:37:42 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:37:42 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:37:42 user nova-compute[72150]: DEBUG nova.compute.manager [req-1897ff78-9307-4080-b21e-666abff366b5 req-1dba3b5c-aacc-47b6-8c15-24a601d5119c service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Received event network-vif-plugged-8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:37:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1897ff78-9307-4080-b21e-666abff366b5 req-1dba3b5c-aacc-47b6-8c15-24a601d5119c service nova] Acquiring lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1897ff78-9307-4080-b21e-666abff366b5 req-1dba3b5c-aacc-47b6-8c15-24a601d5119c service nova] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1897ff78-9307-4080-b21e-666abff366b5 req-1dba3b5c-aacc-47b6-8c15-24a601d5119c service nova] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:42 user nova-compute[72150]: DEBUG nova.compute.manager [req-1897ff78-9307-4080-b21e-666abff366b5 req-1dba3b5c-aacc-47b6-8c15-24a601d5119c service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] No waiting events found dispatching network-vif-plugged-8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:37:42 user nova-compute[72150]: WARNING nova.compute.manager [req-1897ff78-9307-4080-b21e-666abff366b5 req-1dba3b5c-aacc-47b6-8c15-24a601d5119c service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Received unexpected event network-vif-plugged-8839e09b-66e1-4465-88d2-19f19dc1b010 for instance with vm_state active and task_state resize_migrated.
Aug 01 18:37:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:42 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690915063.2662137, b10328c7-3328-4c3c-8ebe-3dd282ece0c9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b10328c7-3328-4c3c-8ebe-3dd282ece0c9 {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:37:43 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Successfully detached device vdb from instance b10328c7-3328-4c3c-8ebe-3dd282ece0c9 from the live domain config.
Aug 01 18:37:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKrXQAyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:37:43 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:37:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a53f0bf-56c7-48e5-a090-1dd288556ef2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f0fa4b-a9d7-4ca0-8a36-2a7c7fc4346c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:37:43 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:37:43 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:37:43 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:37:43 user nova-compute[72150]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 (non-flash)
Aug 01 18:37:43 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:37:43 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c3c1090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73'): ({'sdb'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Removing single pathed devices sdb {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7a02d1-c0df-4a7a-81e1-169cedb12779]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "refresh_cache-54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquired lock "refresh_cache-54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG nova.network.neutron [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2e26ae-34fc-4b30-a200-a3920e9b4cad]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Flushing IO for device /dev/sdb {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ba3582-5ed9-46ae-8a26-b191e58581ad]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae9052c-f734-4c2c-ad1c-0580b376aa87]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c3842e-509d-484c-8c2b-aab585be2b34]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5e614e-a55f-4f8e-86d9-891af528da84]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73, portal: 172.16.0.220,3260]
Aug 01 18:37:43 user nova-compute[72150]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73, portal: 172.16.0.220,3260] successful.
Aug 01 18:37:43 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:489f01df-bee5-47d2-a63a-8f1445b81f73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed93edb8-1fb0-49d0-8306-91ff0eee590e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] <== disconnect_volume: return (347ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG nova.network.neutron [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Updating instance_info_cache with network_info: [{"id": "8839e09b-66e1-4465-88d2-19f19dc1b010", "address": "fa:16:3e:69:a8:32", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8839e09b-66", "ovs_interfaceid": "8839e09b-66e1-4465-88d2-19f19dc1b010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Releasing lock "refresh_cache-54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG os_brick.utils [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab5c167-cc26-4c85-a983-04443a0f24ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[467950e7-be38-440d-8bc4-c6f7583eb1ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e62851-401f-4f09-97f6-319fe3f094ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb4aaa1-db4c-44a1-b63f-eda5364fb92b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:37:44 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9e8fbe-0ca8-4200-b927-e3a6a5074aac]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG os_brick.utils [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG nova.objects.instance [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lazy-loading 'flavor' on Instance uuid b10328c7-3328-4c3c-8ebe-3dd282ece0c9 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-07de31c0-3cf9-4f5f-a4bf-74cc0bc4e202 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.030s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:37:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:37:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:47 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:37:47 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:37:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=7678MB free_disk=25.278457641601562GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Applying migration context for instance 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 as it has an incoming, in-progress migration 3de744ad-9181-4023-8bdc-93e18fae964d. Migration status is post-migrating {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 18:37:47 user nova-compute[72150]: INFO nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Updating resource usage from migration 3de744ad-9181-4023-8bdc-93e18fae964d
Aug 01 18:37:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 769690c8-53c5-4057-88a5-fbdbcb930e32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ea68420b-8362-4df3-b710-cd1cf76adba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 08851ec4-6f71-4ec1-a092-42aab83ee87f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance bf2d1f14-2227-41d1-bd73-a05ab3149aba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 42e75a98-beb1-4688-a375-affc63b14252 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance b10328c7-3328-4c3c-8ebe-3dd282ece0c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 65b04144-3b1f-4975-8524-2c9f9660672a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance d2117837-5552-4ec3-9f9b-62629c1ff4cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 737a8853-f9b9-4a0b-95a1-200d72c4d806 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Migration 3de744ad-9181-4023-8bdc-93e18fae964d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.592s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Cleaning up deleted instances {{(pid=72150) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] There are 0 instances to clean {{(pid=72150) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:37:47 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:37:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Starting finish_migration {{(pid=72150) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Instance directory exists: not creating {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 18:37:52 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Creating image(s)
Aug 01 18:37:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Did not create local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Ensure instance console log exists: /opt/stack/data/nova/instances/54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Start _get_guest_xml network_info=[{"id": "8839e09b-66e1-4465-88d2-19f19dc1b010", "address": "fa:16:3e:69:a8:32", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-258752565-network", "vif_mac": "fa:16:3e:69:a8:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8839e09b-66", "ovs_interfaceid": "8839e09b-66e1-4465-88d2-19f19dc1b010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2f1aaa4f-d265-45d9-a42a-30751da3dd31', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KzEQLnfT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89', 'attached_at': '2023-08-01T18:37:53.000000', 'detached_at': '', 'volume_id': '194b3ab3-36b4-4099-99ce-e23a428c23b9', 'serial': '194b3ab3-36b4-4099-99ce-e23a428c23b9'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:37:52 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:37:52 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:37:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:37:52 user nova-compute[72150]: DEBUG nova.objects.instance [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lazy-loading 'vcpu_model' on Instance uuid 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KzEQLnfT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:37:53 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:37:53 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:37:53 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5993c9e4-a8b5-4338-906d-94a6030ea851]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:37:53 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de0b5aa-771e-414b-abce-cb95c7a15fbb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9] added
Aug 01 18:37:53 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e139e70-9ccb-4a50-89ed-87b16c78644e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c1d8f8-6887-447f-8e7f-64486c626cfb]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KzEQLnfT {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KzEQLnfT" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ae8ead-b573-4d38-b045-ce9753fbbe74]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KzEQLnfT'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d202d285-a2ef-49d7-a593-70aa895becdd]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d2a6ad-0a41-4d4e-afaf-051e801700ff]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:37:53 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:37:53 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:37:53 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:37:53 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c2181d-5d31-461d-a41a-96dd06eacf3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9, portal: 172.16.0.220,3260]
Aug 01 18:37:53 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9, portal: 172.16.0.220,3260] successful.
Aug 01 18:37:53 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[186e48c9-f136-4685-a77a-ef3bce2d9885]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7160cb4-2dc6-4540-aa80-3683988658db]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:37:53 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:37:53 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:37:53 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:37:53 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:37:53 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:37:53 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cd1049-8dad-41d1-b126-55616b2f936d]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:37:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KzEQLnfT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:37:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:37:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23738336234373635', 'path': '/dev/sdb'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:37:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738336234373635', 'path': '/dev/sdb'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:37:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:35:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-205787336',display_name='tempest-ServerActionsTestOtherA-server-205787336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-205787336',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJY2FlDJuzmLBeUAuDA5wUSU2UHRGDTZlkebFFQy7IaCc3RvIIFGPPP6kDQA5KkLRYt2dsIc0CUwBhPl2TFzcR9udfpfPek2FdJAmKOoaMyPBsGZqlWc4+qDiA+nCRd2Q==',key_name='tempest-keypair-605536790',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:36:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1c393fdc0b774cd8a6208200011ba16b',ramdisk_id='',reservation_id='r-40eismfe',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-993571413',owner_user_name='tempest-ServerActionsTestOtherA-993571413-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:37:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9470bee775394bf5a3368d27b64911cb',uuid=54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8839e09b-66e1-4465-88d2-19f19dc1b010", "address": "fa:16:3e:69:a8:32", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-258752565-network", "vif_mac": "fa:16:3e:69:a8:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8839e09b-66", "ovs_interfaceid": "8839e09b-66e1-4465-88d2-19f19dc1b010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:37:54 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converting VIF {"id": "8839e09b-66e1-4465-88d2-19f19dc1b010", "address": "fa:16:3e:69:a8:32", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-258752565-network", "vif_mac": "fa:16:3e:69:a8:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8839e09b-66", "ovs_interfaceid": "8839e09b-66e1-4465-88d2-19f19dc1b010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:37:54 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:a8:32,bridge_name='br-int',has_traffic_filtering=True,id=8839e09b-66e1-4465-88d2-19f19dc1b010,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8839e09b-66') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:37:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:37:54 user nova-compute[72150]:   <uuid>54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89</uuid>
Aug 01 18:37:54 user nova-compute[72150]:   <name>instance-00000021</name>
Aug 01 18:37:54 user nova-compute[72150]:   <memory>2097152</memory>
Aug 01 18:37:54 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:37:54 user nova-compute[72150]:   <metadata>
Aug 01 18:37:54 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:37:54 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:37:54 user nova-compute[72150]:       <nova:name>tempest-ServerActionsTestOtherA-server-205787336</nova:name>
Aug 01 18:37:54 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:37:52</nova:creationTime>
Aug 01 18:37:54 user nova-compute[72150]:       <nova:flavor name="m1.small">
Aug 01 18:37:54 user nova-compute[72150]:         <nova:memory>2048</nova:memory>
Aug 01 18:37:54 user nova-compute[72150]:         <nova:disk>20</nova:disk>
Aug 01 18:37:54 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:37:54 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:37:54 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:37:54 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:37:54 user nova-compute[72150]:       <nova:owner>
Aug 01 18:37:54 user nova-compute[72150]:         <nova:user uuid="9470bee775394bf5a3368d27b64911cb">tempest-ServerActionsTestOtherA-993571413-project-member</nova:user>
Aug 01 18:37:54 user nova-compute[72150]:         <nova:project uuid="1c393fdc0b774cd8a6208200011ba16b">tempest-ServerActionsTestOtherA-993571413</nova:project>
Aug 01 18:37:54 user nova-compute[72150]:       </nova:owner>
Aug 01 18:37:54 user nova-compute[72150]:       <nova:ports>
Aug 01 18:37:54 user nova-compute[72150]:         <nova:port uuid="8839e09b-66e1-4465-88d2-19f19dc1b010">
Aug 01 18:37:54 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 18:37:54 user nova-compute[72150]:         </nova:port>
Aug 01 18:37:54 user nova-compute[72150]:       </nova:ports>
Aug 01 18:37:54 user nova-compute[72150]:     </nova:instance>
Aug 01 18:37:54 user nova-compute[72150]:   </metadata>
Aug 01 18:37:54 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:37:54 user nova-compute[72150]:     <system>
Aug 01 18:37:54 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:37:54 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:37:54 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:37:54 user nova-compute[72150]:       <entry name="serial">54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89</entry>
Aug 01 18:37:54 user nova-compute[72150]:       <entry name="uuid">54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89</entry>
Aug 01 18:37:54 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:37:54 user nova-compute[72150]:     </system>
Aug 01 18:37:54 user nova-compute[72150]:   </sysinfo>
Aug 01 18:37:54 user nova-compute[72150]:   <os>
Aug 01 18:37:54 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:37:54 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:37:54 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:37:54 user nova-compute[72150]:   </os>
Aug 01 18:37:54 user nova-compute[72150]:   <features>
Aug 01 18:37:54 user nova-compute[72150]:     <acpi/>
Aug 01 18:37:54 user nova-compute[72150]:     <apic/>
Aug 01 18:37:54 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:37:54 user nova-compute[72150]:   </features>
Aug 01 18:37:54 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:37:54 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:37:54 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:37:54 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:37:54 user nova-compute[72150]:   </clock>
Aug 01 18:37:54 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:37:54 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:37:54 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:37:54 user nova-compute[72150]:   </cpu>
Aug 01 18:37:54 user nova-compute[72150]:   <devices>
Aug 01 18:37:54 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:37:54 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:37:54 user nova-compute[72150]:       <source dev="/dev/sdb"/>
Aug 01 18:37:54 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:37:54 user nova-compute[72150]:       <serial>194b3ab3-36b4-4099-99ce-e23a428c23b9</serial>
Aug 01 18:37:54 user nova-compute[72150]:     </disk>
Aug 01 18:37:54 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:37:54 user nova-compute[72150]:       <mac address="fa:16:3e:69:a8:32"/>
Aug 01 18:37:54 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:37:54 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:37:54 user nova-compute[72150]:       <target dev="tap8839e09b-66"/>
Aug 01 18:37:54 user nova-compute[72150]:     </interface>
Aug 01 18:37:54 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:37:54 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89/console.log" append="off"/>
Aug 01 18:37:54 user nova-compute[72150]:     </serial>
Aug 01 18:37:54 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:37:54 user nova-compute[72150]:     <video>
Aug 01 18:37:54 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:37:54 user nova-compute[72150]:     </video>
Aug 01 18:37:54 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:37:54 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:37:54 user nova-compute[72150]:     </rng>
Aug 01 18:37:54 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:37:54 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:37:54 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:37:54 user nova-compute[72150]:     </memballoon>
Aug 01 18:37:54 user nova-compute[72150]:   </devices>
Aug 01 18:37:54 user nova-compute[72150]: </domain>
Aug 01 18:37:54 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:37:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:35:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-205787336',display_name='tempest-ServerActionsTestOtherA-server-205787336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-205787336',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJY2FlDJuzmLBeUAuDA5wUSU2UHRGDTZlkebFFQy7IaCc3RvIIFGPPP6kDQA5KkLRYt2dsIc0CUwBhPl2TFzcR9udfpfPek2FdJAmKOoaMyPBsGZqlWc4+qDiA+nCRd2Q==',key_name='tempest-keypair-605536790',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:36:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1c393fdc0b774cd8a6208200011ba16b',ramdisk_id='',reservation_id='r-40eismfe',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-993571413',owner_user_name='tempest-ServerActionsTestOtherA-993571413-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:37:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9470bee775394bf5a3368d27b64911cb',uuid=54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8839e09b-66e1-4465-88d2-19f19dc1b010", "address": "fa:16:3e:69:a8:32", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-258752565-network", "vif_mac": "fa:16:3e:69:a8:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8839e09b-66", "ovs_interfaceid": "8839e09b-66e1-4465-88d2-19f19dc1b010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:37:54 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converting VIF {"id": "8839e09b-66e1-4465-88d2-19f19dc1b010", "address": "fa:16:3e:69:a8:32", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-258752565-network", "vif_mac": "fa:16:3e:69:a8:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8839e09b-66", "ovs_interfaceid": "8839e09b-66e1-4465-88d2-19f19dc1b010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:37:54 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:a8:32,bridge_name='br-int',has_traffic_filtering=True,id=8839e09b-66e1-4465-88d2-19f19dc1b010,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8839e09b-66') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:37:54 user nova-compute[72150]: DEBUG os_vif [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a8:32,bridge_name='br-int',has_traffic_filtering=True,id=8839e09b-66e1-4465-88d2-19f19dc1b010,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8839e09b-66') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:37:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:37:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:37:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8839e09b-66, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:37:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8839e09b-66, col_values=(('external_ids', {'iface-id': '8839e09b-66e1-4465-88d2-19f19dc1b010', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:a8:32', 'vm-uuid': '54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:37:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:37:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:54 user nova-compute[72150]: INFO os_vif [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a8:32,bridge_name='br-int',has_traffic_filtering=True,id=8839e09b-66e1-4465-88d2-19f19dc1b010,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8839e09b-66')
Aug 01 18:37:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:37:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] No VIF found with MAC fa:16:3e:69:a8:32, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:37:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:55 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915060.9868739, 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:37:55 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] VM Stopped (Lifecycle Event)
Aug 01 18:37:56 user nova-compute[72150]: DEBUG nova.compute.manager [None req-a139eea4-c5a3-464a-9951-abb103d93cec None None] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:37:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-77d5f685-48fc-44ed-9142-390f6298e73b req-6bff959b-5087-4bc7-92a0-c4b606199431 service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Received event network-vif-plugged-8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:37:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-77d5f685-48fc-44ed-9142-390f6298e73b req-6bff959b-5087-4bc7-92a0-c4b606199431 service nova] Acquiring lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-77d5f685-48fc-44ed-9142-390f6298e73b req-6bff959b-5087-4bc7-92a0-c4b606199431 service nova] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-77d5f685-48fc-44ed-9142-390f6298e73b req-6bff959b-5087-4bc7-92a0-c4b606199431 service nova] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-77d5f685-48fc-44ed-9142-390f6298e73b req-6bff959b-5087-4bc7-92a0-c4b606199431 service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] No waiting events found dispatching network-vif-plugged-8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:37:56 user nova-compute[72150]: WARNING nova.compute.manager [req-77d5f685-48fc-44ed-9142-390f6298e73b req-6bff959b-5087-4bc7-92a0-c4b606199431 service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Received unexpected event network-vif-plugged-8839e09b-66e1-4465-88d2-19f19dc1b010 for instance with vm_state active and task_state resize_finish.
Aug 01 18:37:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquiring lock "07213597-fa7a-4422-956a-1b02737cc647" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "07213597-fa7a-4422-956a-1b02737cc647" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:37:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:57 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:37:57 user nova-compute[72150]: INFO nova.compute.claims [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Claim successful on node user
Aug 01 18:37:57 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915077.9834704, 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:37:57 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] VM Resumed (Lifecycle Event)
Aug 01 18:37:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:37:57 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Instance running successfully.
Aug 01 18:37:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Failed to set time: agent not configured {{(pid=72150) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 01 18:37:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-255cd90c-f48b-4e9b-89d8-cace26986c92 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] finish_migration finished successfully. {{(pid=72150) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:37:58 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 18:37:58 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915077.9842713, 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:37:58 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] VM Started (Lifecycle Event)
Aug 01 18:37:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:37:58 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 18:37:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-366dead3-7176-428e-9523-019c77a964ae req-8c447ab2-72a9-4ebd-87a6-0fcce27f6f94 service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Received event network-vif-plugged-8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-366dead3-7176-428e-9523-019c77a964ae req-8c447ab2-72a9-4ebd-87a6-0fcce27f6f94 service nova] Acquiring lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-366dead3-7176-428e-9523-019c77a964ae req-8c447ab2-72a9-4ebd-87a6-0fcce27f6f94 service nova] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-366dead3-7176-428e-9523-019c77a964ae req-8c447ab2-72a9-4ebd-87a6-0fcce27f6f94 service nova] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-366dead3-7176-428e-9523-019c77a964ae req-8c447ab2-72a9-4ebd-87a6-0fcce27f6f94 service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] No waiting events found dispatching network-vif-plugged-8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:37:58 user nova-compute[72150]: WARNING nova.compute.manager [req-366dead3-7176-428e-9523-019c77a964ae req-8c447ab2-72a9-4ebd-87a6-0fcce27f6f94 service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Received unexpected event network-vif-plugged-8839e09b-66e1-4465-88d2-19f19dc1b010 for instance with vm_state active and task_state resize_finish.
Aug 01 18:37:58 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG nova.network.neutron [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:37:58 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:37:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:37:58 user nova-compute[72150]: INFO nova.virt.block_device [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Booting with volume c747e83a-c5db-4737-a028-fd1e6024fe77 at /dev/vda
Aug 01 18:37:58 user nova-compute[72150]: DEBUG nova.policy [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e19b7bbe9bf473f8ce8d121dcaf5e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ebdfa1a1d744989c2ae19afba252a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG os_brick.utils [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3aa152-30f4-481c-8d5e-5b80c7918928]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09a099c-d293-4f17-ac3c-e27125947300]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[99136bd3-7e48-4f9f-af74-c2238b618218]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3107777-c80f-4e7c-95a1-dc1233d4c904]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:37:58 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:37:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[874a5b0c-b791-4dec-80b5-fcdfd60848c6]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG os_brick.utils [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:37:58 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Updating existing volume attachment record: 403c8c41-a919-42f5-afb3-267cc4648540 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG nova.network.neutron [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Successfully created port: b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:37:59 user nova-compute[72150]: WARNING nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Aug 01 18:37:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid 769690c8-53c5-4057-88a5-fbdbcb930e32 {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid ea68420b-8362-4df3-b710-cd1cf76adba0 {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid 08851ec4-6f71-4ec1-a092-42aab83ee87f {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid 42e75a98-beb1-4688-a375-affc63b14252 {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid b10328c7-3328-4c3c-8ebe-3dd282ece0c9 {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid 65b04144-3b1f-4975-8524-2c9f9660672a {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid d2117837-5552-4ec3-9f9b-62629c1ff4cb {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid 737a8853-f9b9-4a0b-95a1-200d72c4d806 {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid 07213597-fa7a-4422-956a-1b02737cc647 {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid bf2d1f14-2227-41d1-bd73-a05ab3149aba {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "769690c8-53c5-4057-88a5-fbdbcb930e32" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "ea68420b-8362-4df3-b710-cd1cf76adba0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "08851ec4-6f71-4ec1-a092-42aab83ee87f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "08851ec4-6f71-4ec1-a092-42aab83ee87f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "42e75a98-beb1-4688-a375-affc63b14252" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "42e75a98-beb1-4688-a375-affc63b14252" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "65b04144-3b1f-4975-8524-2c9f9660672a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "65b04144-3b1f-4975-8524-2c9f9660672a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "737a8853-f9b9-4a0b-95a1-200d72c4d806" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "737a8853-f9b9-4a0b-95a1-200d72c4d806" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "07213597-fa7a-4422-956a-1b02737cc647" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:37:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "65b04144-3b1f-4975-8524-2c9f9660672a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "08851ec4-6f71-4ec1-a092-42aab83ee87f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "737a8853-f9b9-4a0b-95a1-200d72c4d806" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG nova.network.neutron [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Successfully updated port: b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "42e75a98-beb1-4688-a375-affc63b14252" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquiring lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquired lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG nova.network.neutron [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG nova.compute.manager [req-7a8d8e94-6520-4c3d-b35a-bb801a307a38 req-4df038aa-5225-4331-9a4b-e47161a0ad14 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Received event network-changed-b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG nova.compute.manager [req-7a8d8e94-6520-4c3d-b35a-bb801a307a38 req-4df038aa-5225-4331-9a4b-e47161a0ad14 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Refreshing instance network info cache due to event network-changed-b9e510dc-94be-4362-b3a8-4d68f1f769f3. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7a8d8e94-6520-4c3d-b35a-bb801a307a38 req-4df038aa-5225-4331-9a4b-e47161a0ad14 service nova] Acquiring lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG nova.network.neutron [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "316953c9-42a9-4598-9385-0c138415ea6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "316953c9-42a9-4598-9385-0c138415ea6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG nova.compute.manager [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:38:00 user nova-compute[72150]: INFO nova.compute.claims [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Claim successful on node user
Aug 01 18:38:00 user nova-compute[72150]: DEBUG nova.network.neutron [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Updating instance_info_cache with network_info: [{"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e510dc-94", "ovs_interfaceid": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Releasing lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG nova.compute.manager [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Instance network_info: |[{"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e510dc-94", "ovs_interfaceid": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7a8d8e94-6520-4c3d-b35a-bb801a307a38 req-4df038aa-5225-4331-9a4b-e47161a0ad14 service nova] Acquired lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:38:00 user nova-compute[72150]: DEBUG nova.network.neutron [req-7a8d8e94-6520-4c3d-b35a-bb801a307a38 req-4df038aa-5225-4331-9a4b-e47161a0ad14 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Refreshing network info cache for port b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:38:01 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:38:01 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:38:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.917s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:01 user nova-compute[72150]: DEBUG nova.compute.manager [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:38:01 user nova-compute[72150]: DEBUG nova.compute.manager [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:38:01 user nova-compute[72150]: DEBUG nova.network.neutron [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:38:01 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:38:01 user nova-compute[72150]: DEBUG nova.network.neutron [req-7a8d8e94-6520-4c3d-b35a-bb801a307a38 req-4df038aa-5225-4331-9a4b-e47161a0ad14 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Updated VIF entry in instance network info cache for port b9e510dc-94be-4362-b3a8-4d68f1f769f3. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:38:01 user nova-compute[72150]: DEBUG nova.network.neutron [req-7a8d8e94-6520-4c3d-b35a-bb801a307a38 req-4df038aa-5225-4331-9a4b-e47161a0ad14 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Updating instance_info_cache with network_info: [{"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e510dc-94", "ovs_interfaceid": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:38:01 user nova-compute[72150]: DEBUG nova.compute.manager [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:38:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7a8d8e94-6520-4c3d-b35a-bb801a307a38 req-4df038aa-5225-4331-9a4b-e47161a0ad14 service nova] Releasing lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:38:01 user nova-compute[72150]: INFO nova.virt.block_device [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Booting with volume-backed-image dbc6b740-0555-4041-80f6-323ecd1d67db at /dev/vda
Aug 01 18:38:01 user nova-compute[72150]: DEBUG nova.policy [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc00b9006f5842c6b875c5d25538b718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad8ef64d051424e9fe644a1fb40fcb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:38:02 user nova-compute[72150]: DEBUG nova.network.neutron [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Successfully created port: ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:38:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "5dbd0cf2-7aa9-452a-9322-a58c23d7cc52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "5dbd0cf2-7aa9-452a-9322-a58c23d7cc52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:02 user nova-compute[72150]: DEBUG nova.compute.manager [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:38:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:02 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:38:02 user nova-compute[72150]: INFO nova.compute.claims [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Claim successful on node user
Aug 01 18:38:03 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.757s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG nova.compute.manager [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG nova.compute.manager [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG nova.network.neutron [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:38:03 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:38:03 user nova-compute[72150]: DEBUG nova.compute.manager [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG nova.network.neutron [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Successfully updated port: ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "refresh_cache-316953c9-42a9-4598-9385-0c138415ea6f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquired lock "refresh_cache-316953c9-42a9-4598-9385-0c138415ea6f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG nova.network.neutron [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:38:03 user nova-compute[72150]: INFO nova.virt.block_device [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Booting with volume 134cfd38-e4a8-46fc-a35e-4c37a1e4a052 at /dev/vda
Aug 01 18:38:03 user nova-compute[72150]: DEBUG nova.policy [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92c7ef0ed6814f8880de76adb913a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ca44f23b114893afcfe57c52f693b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG nova.network.neutron [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG nova.compute.manager [req-f3dce5fc-31ce-40ea-ad87-136953dc2335 req-c0545f32-fcf9-410a-86eb-f257525d70dd service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received event network-changed-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG nova.compute.manager [req-f3dce5fc-31ce-40ea-ad87-136953dc2335 req-c0545f32-fcf9-410a-86eb-f257525d70dd service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Refreshing instance network info cache due to event network-changed-ed51a469-3095-4679-b038-c18153c8f95e. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f3dce5fc-31ce-40ea-ad87-136953dc2335 req-c0545f32-fcf9-410a-86eb-f257525d70dd service nova] Acquiring lock "refresh_cache-316953c9-42a9-4598-9385-0c138415ea6f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG os_brick.utils [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b14a4ef-94a7-45f6-80a5-2ed638eb7ead]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c6f824-1647-4948-8860-99c49de7be69]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56c4354-a143-403d-8e3b-59ba2ad02c8e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e16309-2c9f-461b-b8e3-113d07486b05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:38:03 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:38:03 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0b92bd-f047-40a9-9857-dc0aaa84ae2f]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG os_brick.utils [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Updating existing volume attachment record: b55ab4c5-1e77-40d5-9f7c-22011cd9b34c {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG nova.network.neutron [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Updating instance_info_cache with network_info: [{"id": "ed51a469-3095-4679-b038-c18153c8f95e", "address": "fa:16:3e:13:9f:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped51a469-30", "ovs_interfaceid": "ed51a469-3095-4679-b038-c18153c8f95e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Releasing lock "refresh_cache-316953c9-42a9-4598-9385-0c138415ea6f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG nova.compute.manager [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Instance network_info: |[{"id": "ed51a469-3095-4679-b038-c18153c8f95e", "address": "fa:16:3e:13:9f:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped51a469-30", "ovs_interfaceid": "ed51a469-3095-4679-b038-c18153c8f95e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f3dce5fc-31ce-40ea-ad87-136953dc2335 req-c0545f32-fcf9-410a-86eb-f257525d70dd service nova] Acquired lock "refresh_cache-316953c9-42a9-4598-9385-0c138415ea6f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:38:03 user nova-compute[72150]: DEBUG nova.network.neutron [req-f3dce5fc-31ce-40ea-ad87-136953dc2335 req-c0545f32-fcf9-410a-86eb-f257525d70dd service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Refreshing network info cache for port ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:38:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:04 user nova-compute[72150]: DEBUG nova.network.neutron [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Successfully created port: c4fe7e1b-47aa-495a-9f09-2780827d1f41 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:38:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:04 user nova-compute[72150]: DEBUG nova.network.neutron [req-f3dce5fc-31ce-40ea-ad87-136953dc2335 req-c0545f32-fcf9-410a-86eb-f257525d70dd service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Updated VIF entry in instance network info cache for port ed51a469-3095-4679-b038-c18153c8f95e. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:38:04 user nova-compute[72150]: DEBUG nova.network.neutron [req-f3dce5fc-31ce-40ea-ad87-136953dc2335 req-c0545f32-fcf9-410a-86eb-f257525d70dd service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Updating instance_info_cache with network_info: [{"id": "ed51a469-3095-4679-b038-c18153c8f95e", "address": "fa:16:3e:13:9f:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped51a469-30", "ovs_interfaceid": "ed51a469-3095-4679-b038-c18153c8f95e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:38:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f3dce5fc-31ce-40ea-ad87-136953dc2335 req-c0545f32-fcf9-410a-86eb-f257525d70dd service nova] Releasing lock "refresh_cache-316953c9-42a9-4598-9385-0c138415ea6f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:38:05 user nova-compute[72150]: DEBUG nova.network.neutron [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Successfully updated port: c4fe7e1b-47aa-495a-9f09-2780827d1f41 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:38:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "refresh_cache-5dbd0cf2-7aa9-452a-9322-a58c23d7cc52" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:38:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquired lock "refresh_cache-5dbd0cf2-7aa9-452a-9322-a58c23d7cc52" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:38:05 user nova-compute[72150]: DEBUG nova.network.neutron [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:38:05 user nova-compute[72150]: DEBUG nova.compute.manager [req-8343ff59-90dd-47ed-ba32-d4e06dec95a9 req-abe3396a-ef17-4c4b-b52e-53b0def1e73a service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Received event network-changed-c4fe7e1b-47aa-495a-9f09-2780827d1f41 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:38:05 user nova-compute[72150]: DEBUG nova.compute.manager [req-8343ff59-90dd-47ed-ba32-d4e06dec95a9 req-abe3396a-ef17-4c4b-b52e-53b0def1e73a service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Refreshing instance network info cache due to event network-changed-c4fe7e1b-47aa-495a-9f09-2780827d1f41. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:38:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8343ff59-90dd-47ed-ba32-d4e06dec95a9 req-abe3396a-ef17-4c4b-b52e-53b0def1e73a service nova] Acquiring lock "refresh_cache-5dbd0cf2-7aa9-452a-9322-a58c23d7cc52" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:38:05 user nova-compute[72150]: DEBUG nova.network.neutron [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:38:05 user nova-compute[72150]: DEBUG nova.network.neutron [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Updating instance_info_cache with network_info: [{"id": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "address": "fa:16:3e:c8:34:35", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fe7e1b-47", "ovs_interfaceid": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:38:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Releasing lock "refresh_cache-5dbd0cf2-7aa9-452a-9322-a58c23d7cc52" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:38:05 user nova-compute[72150]: DEBUG nova.compute.manager [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Instance network_info: |[{"id": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "address": "fa:16:3e:c8:34:35", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fe7e1b-47", "ovs_interfaceid": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:38:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8343ff59-90dd-47ed-ba32-d4e06dec95a9 req-abe3396a-ef17-4c4b-b52e-53b0def1e73a service nova] Acquired lock "refresh_cache-5dbd0cf2-7aa9-452a-9322-a58c23d7cc52" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:38:05 user nova-compute[72150]: DEBUG nova.network.neutron [req-8343ff59-90dd-47ed-ba32-d4e06dec95a9 req-abe3396a-ef17-4c4b-b52e-53b0def1e73a service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Refreshing network info cache for port c4fe7e1b-47aa-495a-9f09-2780827d1f41 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:38:06 user nova-compute[72150]: DEBUG nova.network.neutron [req-8343ff59-90dd-47ed-ba32-d4e06dec95a9 req-abe3396a-ef17-4c4b-b52e-53b0def1e73a service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Updated VIF entry in instance network info cache for port c4fe7e1b-47aa-495a-9f09-2780827d1f41. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:38:06 user nova-compute[72150]: DEBUG nova.network.neutron [req-8343ff59-90dd-47ed-ba32-d4e06dec95a9 req-abe3396a-ef17-4c4b-b52e-53b0def1e73a service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Updating instance_info_cache with network_info: [{"id": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "address": "fa:16:3e:c8:34:35", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fe7e1b-47", "ovs_interfaceid": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:38:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8343ff59-90dd-47ed-ba32-d4e06dec95a9 req-abe3396a-ef17-4c4b-b52e-53b0def1e73a service nova] Releasing lock "refresh_cache-5dbd0cf2-7aa9-452a-9322-a58c23d7cc52" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG nova.compute.manager [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:38:07 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Creating image(s)
Aug 01 18:38:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Did not create local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Ensure instance console log exists: /opt/stack/data/nova/instances/07213597-fa7a-4422-956a-1b02737cc647/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Start _get_guest_xml network_info=[{"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e510dc-94", "ovs_interfaceid": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '403c8c41-a919-42f5-afb3-267cc4648540', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdAEYcHK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '07213597-fa7a-4422-956a-1b02737cc647', 'attached_at': '', 'detached_at': '', 'volume_id': 'c747e83a-c5db-4737-a028-fd1e6024fe77', 'serial': 'c747e83a-c5db-4737-a028-fd1e6024fe77'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:38:07 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:38:07 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:38:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdAEYcHK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:38:07 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:38:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:38:07 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:38:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:38:07 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:38:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbb0afb-3be8-45d4-9b59-881bea3284fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:38:07 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9def7359-fa14-4c13-bbd8-e17222fcaaee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77] added
Aug 01 18:38:07 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a1fb7f-69f7-4134-857c-2b9da75ab2a1]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[43600efb-516d-491f-a13e-33ee6343f8cf]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IdAEYcHK {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IdAEYcHK" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[21319ab1-ceb6-4c34-8aae-58506e8ec4bd]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IdAEYcHK'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[38275a05-7882-497e-9b9d-5077ecf26aa9]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f624a5a-b7d4-4b24-869c-a6d67cebbaa9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:38:08 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:38:08 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:38:08 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:38:08 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:38:08 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:38:08 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef146a04-ef3f-485c-a560-ea82e5fc0d0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77, portal: 172.16.0.220,3260]
Aug 01 18:38:08 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77, portal: 172.16.0.220,3260] successful.
Aug 01 18:38:08 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3b5d04-4777-48a1-9d2f-ee78c93f28d6]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf8cca4-507c-4a65-b1e9-eae65bc0e85c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:38:08 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:38:08 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:38:08 user nova-compute[72150]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:38:08 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:38:08 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:38:08 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:38:08 user nova-compute[72150]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:38:08 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96a6ac5-311e-4ea5-9586-5bd8e276f38d]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:38:08 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdAEYcHK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23663656665363663', 'path': '/dev/sdd'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663656665363663', 'path': '/dev/sdd'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-691830454',display_name='tempest-TestShelveInstance-server-691830454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-691830454',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyoTrCOpTYRiMQpfxAHrmgEh2IuXfKFd05eInP4gONn7Z6yLSlklJvNu/KixD0APbHlXD8tsKWypMmSvEXNQ7HC+5Bl+96BWCjszExqbYWAuUU70+cSHaxQ4fZmIre9ag==',key_name='tempest-TestShelveInstance-873495065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96ebdfa1a1d744989c2ae19afba252a2',ramdisk_id='',reservation_id='r-0wlnrl2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-359406348',owner_user_name='tempest-TestShelveInstance-359406348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:37:58Z,user_data=None,user_id='3e19b7bbe9bf473f8ce8d121dcaf5e35',uuid=07213597-fa7a-4422-956a-1b02737cc647,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e510dc-94", "ovs_interfaceid": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Converting VIF {"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e510dc-94", "ovs_interfaceid": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:2f:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9e510dc-94be-4362-b3a8-4d68f1f769f3,network=Network(ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e510dc-94') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG nova.objects.instance [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lazy-loading 'pci_devices' on Instance uuid 07213597-fa7a-4422-956a-1b02737cc647 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:38:09 user nova-compute[72150]:   <uuid>07213597-fa7a-4422-956a-1b02737cc647</uuid>
Aug 01 18:38:09 user nova-compute[72150]:   <name>instance-00000023</name>
Aug 01 18:38:09 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:38:09 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:38:09 user nova-compute[72150]:   <metadata>
Aug 01 18:38:09 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:38:09 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:38:09 user nova-compute[72150]:       <nova:name>tempest-TestShelveInstance-server-691830454</nova:name>
Aug 01 18:38:09 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:38:07</nova:creationTime>
Aug 01 18:38:09 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:38:09 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:38:09 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:38:09 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:38:09 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:38:09 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:38:09 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:38:09 user nova-compute[72150]:       <nova:owner>
Aug 01 18:38:09 user nova-compute[72150]:         <nova:user uuid="3e19b7bbe9bf473f8ce8d121dcaf5e35">tempest-TestShelveInstance-359406348-project-member</nova:user>
Aug 01 18:38:09 user nova-compute[72150]:         <nova:project uuid="96ebdfa1a1d744989c2ae19afba252a2">tempest-TestShelveInstance-359406348</nova:project>
Aug 01 18:38:09 user nova-compute[72150]:       </nova:owner>
Aug 01 18:38:09 user nova-compute[72150]:       <nova:ports>
Aug 01 18:38:09 user nova-compute[72150]:         <nova:port uuid="b9e510dc-94be-4362-b3a8-4d68f1f769f3">
Aug 01 18:38:09 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 18:38:09 user nova-compute[72150]:         </nova:port>
Aug 01 18:38:09 user nova-compute[72150]:       </nova:ports>
Aug 01 18:38:09 user nova-compute[72150]:     </nova:instance>
Aug 01 18:38:09 user nova-compute[72150]:   </metadata>
Aug 01 18:38:09 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:38:09 user nova-compute[72150]:     <system>
Aug 01 18:38:09 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:38:09 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:38:09 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:38:09 user nova-compute[72150]:       <entry name="serial">07213597-fa7a-4422-956a-1b02737cc647</entry>
Aug 01 18:38:09 user nova-compute[72150]:       <entry name="uuid">07213597-fa7a-4422-956a-1b02737cc647</entry>
Aug 01 18:38:09 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:38:09 user nova-compute[72150]:     </system>
Aug 01 18:38:09 user nova-compute[72150]:   </sysinfo>
Aug 01 18:38:09 user nova-compute[72150]:   <os>
Aug 01 18:38:09 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:38:09 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:38:09 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:38:09 user nova-compute[72150]:   </os>
Aug 01 18:38:09 user nova-compute[72150]:   <features>
Aug 01 18:38:09 user nova-compute[72150]:     <acpi/>
Aug 01 18:38:09 user nova-compute[72150]:     <apic/>
Aug 01 18:38:09 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:38:09 user nova-compute[72150]:   </features>
Aug 01 18:38:09 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:38:09 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:38:09 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:38:09 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:38:09 user nova-compute[72150]:   </clock>
Aug 01 18:38:09 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:38:09 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:38:09 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:38:09 user nova-compute[72150]:   </cpu>
Aug 01 18:38:09 user nova-compute[72150]:   <devices>
Aug 01 18:38:09 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:38:09 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:38:09 user nova-compute[72150]:       <source dev="/dev/sdd"/>
Aug 01 18:38:09 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:38:09 user nova-compute[72150]:       <serial>c747e83a-c5db-4737-a028-fd1e6024fe77</serial>
Aug 01 18:38:09 user nova-compute[72150]:     </disk>
Aug 01 18:38:09 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:38:09 user nova-compute[72150]:       <mac address="fa:16:3e:3c:2f:8e"/>
Aug 01 18:38:09 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:38:09 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:38:09 user nova-compute[72150]:       <target dev="tapb9e510dc-94"/>
Aug 01 18:38:09 user nova-compute[72150]:     </interface>
Aug 01 18:38:09 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:38:09 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/07213597-fa7a-4422-956a-1b02737cc647/console.log" append="off"/>
Aug 01 18:38:09 user nova-compute[72150]:     </serial>
Aug 01 18:38:09 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:38:09 user nova-compute[72150]:     <video>
Aug 01 18:38:09 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:38:09 user nova-compute[72150]:     </video>
Aug 01 18:38:09 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:38:09 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:38:09 user nova-compute[72150]:     </rng>
Aug 01 18:38:09 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:38:09 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:38:09 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:38:09 user nova-compute[72150]:     </memballoon>
Aug 01 18:38:09 user nova-compute[72150]:   </devices>
Aug 01 18:38:09 user nova-compute[72150]: </domain>
Aug 01 18:38:09 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-691830454',display_name='tempest-TestShelveInstance-server-691830454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-691830454',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyoTrCOpTYRiMQpfxAHrmgEh2IuXfKFd05eInP4gONn7Z6yLSlklJvNu/KixD0APbHlXD8tsKWypMmSvEXNQ7HC+5Bl+96BWCjszExqbYWAuUU70+cSHaxQ4fZmIre9ag==',key_name='tempest-TestShelveInstance-873495065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96ebdfa1a1d744989c2ae19afba252a2',ramdisk_id='',reservation_id='r-0wlnrl2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-359406348',owner_user_name='tempest-TestShelveInstance-359406348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:37:58Z,user_data=None,user_id='3e19b7bbe9bf473f8ce8d121dcaf5e35',uuid=07213597-fa7a-4422-956a-1b02737cc647,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e510dc-94", "ovs_interfaceid": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Converting VIF {"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e510dc-94", "ovs_interfaceid": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:2f:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9e510dc-94be-4362-b3a8-4d68f1f769f3,network=Network(ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e510dc-94') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG os_vif [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:2f:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9e510dc-94be-4362-b3a8-4d68f1f769f3,network=Network(ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e510dc-94') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9e510dc-94, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb9e510dc-94, col_values=(('external_ids', {'iface-id': 'b9e510dc-94be-4362-b3a8-4d68f1f769f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:2f:8e', 'vm-uuid': '07213597-fa7a-4422-956a-1b02737cc647'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:09 user nova-compute[72150]: INFO os_vif [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:2f:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9e510dc-94be-4362-b3a8-4d68f1f769f3,network=Network(ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e510dc-94')
Aug 01 18:38:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] No VIF found with MAC fa:16:3e:3c:2f:8e, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:38:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-b40a27b3-0904-4ff4-926c-bcd9a9c225ab req-a543157b-3c54-4f29-80c3-1d5a37aa0618 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Received event network-vif-plugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:38:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b40a27b3-0904-4ff4-926c-bcd9a9c225ab req-a543157b-3c54-4f29-80c3-1d5a37aa0618 service nova] Acquiring lock "07213597-fa7a-4422-956a-1b02737cc647-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b40a27b3-0904-4ff4-926c-bcd9a9c225ab req-a543157b-3c54-4f29-80c3-1d5a37aa0618 service nova] Lock "07213597-fa7a-4422-956a-1b02737cc647-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b40a27b3-0904-4ff4-926c-bcd9a9c225ab req-a543157b-3c54-4f29-80c3-1d5a37aa0618 service nova] Lock "07213597-fa7a-4422-956a-1b02737cc647-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-b40a27b3-0904-4ff4-926c-bcd9a9c225ab req-a543157b-3c54-4f29-80c3-1d5a37aa0618 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] No waiting events found dispatching network-vif-plugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:38:10 user nova-compute[72150]: WARNING nova.compute.manager [req-b40a27b3-0904-4ff4-926c-bcd9a9c225ab req-a543157b-3c54-4f29-80c3-1d5a37aa0618 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Received unexpected event network-vif-plugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 for instance with vm_state building and task_state spawning.
Aug 01 18:38:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG os_brick.utils [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76f90a0-594e-4571-9d12-675474144d16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[82406b49-35d4-401b-8afe-3bbf922b9d68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19b9bf2-6fb9-4e1b-9868-76e98365aac9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca52290-15c1-4456-ae2d-16e1e0b6c777]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.compute.manager [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:38:12 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Creating image(s)
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Did not create local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Ensure instance console log exists: /opt/stack/data/nova/instances/5dbd0cf2-7aa9-452a-9322-a58c23d7cc52/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Start _get_guest_xml network_info=[{"id": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "address": "fa:16:3e:c8:34:35", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fe7e1b-47", "ovs_interfaceid": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b55ab4c5-1e77-40d5-9f7c-22011cd9b34c', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTkRwigS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5dbd0cf2-7aa9-452a-9322-a58c23d7cc52', 'attached_at': '', 'detached_at': '', 'volume_id': '134cfd38-e4a8-46fc-a35e-4c37a1e4a052', 'serial': '134cfd38-e4a8-46fc-a35e-4c37a1e4a052'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:38:12 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bf45b8-a577-4b03-8e25-d18e73a3974c]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG os_brick.utils [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Updating existing volume attachment record: d697df91-a93a-4b65-be6e-52bfda49a963 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:38:12 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:38:12 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTkRwigS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:38:12 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:38:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:38:12 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:38:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:38:12 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[878222d3-0256-4921-b03c-e065afde938c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:38:12 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad933d59-cdad-482c-b9d8-6e284c5b763d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052] added
Aug 01 18:38:12 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee4621a-717a-4ad3-818d-5a00f5f44129]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fcd900-7292-4173-b58d-e89582677bb1]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YTkRwigS {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YTkRwigS" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2784a2f-0d48-46e5-9210-9f13a14f5241]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YTkRwigS'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa4371a-7328-4533-a844-ce1211359eef]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05d70b0-0a53-45a3-8d6e-e03d7f41d1a6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:38:12 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:38:12 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:38:12 user nova-compute[72150]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:38:12 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:38:12 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:38:12 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:38:12 user nova-compute[72150]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:38:12 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:38:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3355c4-c2cd-4463-a5f3-937cad3f0766]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052, portal: 172.16.0.220,3260]
Aug 01 18:38:13 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052, portal: 172.16.0.220,3260] successful.
Aug 01 18:38:13 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915093.0154035, 07213597-fa7a-4422-956a-1b02737cc647 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:38:13 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 07213597-fa7a-4422-956a-1b02737cc647] VM Resumed (Lifecycle Event)
Aug 01 18:38:13 user nova-compute[72150]: DEBUG nova.compute.manager [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:38:13 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Instance spawned successfully.
Aug 01 18:38:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b278b7-c144-40ca-bdd6-6f2fa0dd4826]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6056272e-2ee5-414e-b706-c4cbdb6dbe45]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:38:13 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:38:13 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:38:13 user nova-compute[72150]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:38:13 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:38:13 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:38:13 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:38:13 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:38:13 user nova-compute[72150]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:38:13 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:38:13 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] HCTL ('37', '-', '-', 0) found on session 42 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:38:13 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 07213597-fa7a-4422-956a-1b02737cc647] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:38:13 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915093.0230975, 07213597-fa7a-4422-956a-1b02737cc647 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:38:13 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 07213597-fa7a-4422-956a-1b02737cc647] VM Started (Lifecycle Event)
Aug 01 18:38:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45ff7db-7a39-4937-b69d-dfbc205ac665]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTkRwigS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:38:13 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 07213597-fa7a-4422-956a-1b02737cc647] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:38:13 user nova-compute[72150]: INFO nova.compute.manager [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Took 5.39 seconds to spawn the instance on the hypervisor.
Aug 01 18:38:13 user nova-compute[72150]: DEBUG nova.compute.manager [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG nova.compute.manager [req-3dc0e935-2876-467e-8a51-5b4cbcc69ed7 req-6af13d5b-9924-4d5e-b388-e4264ae426fd service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Received event network-vif-plugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3dc0e935-2876-467e-8a51-5b4cbcc69ed7 req-6af13d5b-9924-4d5e-b388-e4264ae426fd service nova] Acquiring lock "07213597-fa7a-4422-956a-1b02737cc647-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3dc0e935-2876-467e-8a51-5b4cbcc69ed7 req-6af13d5b-9924-4d5e-b388-e4264ae426fd service nova] Lock "07213597-fa7a-4422-956a-1b02737cc647-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3dc0e935-2876-467e-8a51-5b4cbcc69ed7 req-6af13d5b-9924-4d5e-b388-e4264ae426fd service nova] Lock "07213597-fa7a-4422-956a-1b02737cc647-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG nova.compute.manager [req-3dc0e935-2876-467e-8a51-5b4cbcc69ed7 req-6af13d5b-9924-4d5e-b388-e4264ae426fd service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] No waiting events found dispatching network-vif-plugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:38:13 user nova-compute[72150]: WARNING nova.compute.manager [req-3dc0e935-2876-467e-8a51-5b4cbcc69ed7 req-6af13d5b-9924-4d5e-b388-e4264ae426fd service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Received unexpected event network-vif-plugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 for instance with vm_state building and task_state spawning.
Aug 01 18:38:13 user nova-compute[72150]: INFO nova.compute.manager [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Took 15.59 seconds to build instance.
Aug 01 18:38:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-63d52924-19e0-40b4-b9eb-da1024380014 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "07213597-fa7a-4422-956a-1b02737cc647" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.702s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "07213597-fa7a-4422-956a-1b02737cc647" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 13.459s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:13 user nova-compute[72150]: INFO nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 07213597-fa7a-4422-956a-1b02737cc647] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 01 18:38:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "07213597-fa7a-4422-956a-1b02737cc647" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26339313664346631', 'path': '/dev/sdf'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339313664346631', 'path': '/dev/sdf'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:38:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-751874109',display_name='tempest-TestVolumeBootPattern-server-751874109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-751874109',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVf3lHt050k356A8Gut9WieNqP8u9vIp5xdHm1rq7ONC5kHGtGA6mBo7SyXu2T5UgJrBcaDoeDkrLO73m2dxgj5g1F2RdpTy7mOLuxRD5SR618gGiTwTven5q6qp8rd8g==',key_name='tempest-TestVolumeBootPattern-35567601',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7ca44f23b114893afcfe57c52f693b1',ramdisk_id='',reservation_id='r-jpirbdib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-295340968',owner_user_name='tempest-TestVolumeBootPattern-295340968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:38:03Z,user_data=None,user_id='92c7ef0ed6814f8880de76adb913a487',uuid=5dbd0cf2-7aa9-452a-9322-a58c23d7cc52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "address": "fa:16:3e:c8:34:35", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fe7e1b-47", "ovs_interfaceid": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converting VIF {"id": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "address": "fa:16:3e:c8:34:35", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fe7e1b-47", "ovs_interfaceid": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:34:35,bridge_name='br-int',has_traffic_filtering=True,id=c4fe7e1b-47aa-495a-9f09-2780827d1f41,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4fe7e1b-47') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG nova.objects.instance [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lazy-loading 'pci_devices' on Instance uuid 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:38:14 user nova-compute[72150]:   <uuid>5dbd0cf2-7aa9-452a-9322-a58c23d7cc52</uuid>
Aug 01 18:38:14 user nova-compute[72150]:   <name>instance-00000025</name>
Aug 01 18:38:14 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:38:14 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:38:14 user nova-compute[72150]:   <metadata>
Aug 01 18:38:14 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:38:14 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:38:14 user nova-compute[72150]:       <nova:name>tempest-TestVolumeBootPattern-server-751874109</nova:name>
Aug 01 18:38:14 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:38:12</nova:creationTime>
Aug 01 18:38:14 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:38:14 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:38:14 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:38:14 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:38:14 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:38:14 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:38:14 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:38:14 user nova-compute[72150]:       <nova:owner>
Aug 01 18:38:14 user nova-compute[72150]:         <nova:user uuid="92c7ef0ed6814f8880de76adb913a487">tempest-TestVolumeBootPattern-295340968-project-member</nova:user>
Aug 01 18:38:14 user nova-compute[72150]:         <nova:project uuid="e7ca44f23b114893afcfe57c52f693b1">tempest-TestVolumeBootPattern-295340968</nova:project>
Aug 01 18:38:14 user nova-compute[72150]:       </nova:owner>
Aug 01 18:38:14 user nova-compute[72150]:       <nova:ports>
Aug 01 18:38:14 user nova-compute[72150]:         <nova:port uuid="c4fe7e1b-47aa-495a-9f09-2780827d1f41">
Aug 01 18:38:14 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 18:38:14 user nova-compute[72150]:         </nova:port>
Aug 01 18:38:14 user nova-compute[72150]:       </nova:ports>
Aug 01 18:38:14 user nova-compute[72150]:     </nova:instance>
Aug 01 18:38:14 user nova-compute[72150]:   </metadata>
Aug 01 18:38:14 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:38:14 user nova-compute[72150]:     <system>
Aug 01 18:38:14 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:38:14 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:38:14 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:38:14 user nova-compute[72150]:       <entry name="serial">5dbd0cf2-7aa9-452a-9322-a58c23d7cc52</entry>
Aug 01 18:38:14 user nova-compute[72150]:       <entry name="uuid">5dbd0cf2-7aa9-452a-9322-a58c23d7cc52</entry>
Aug 01 18:38:14 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:38:14 user nova-compute[72150]:     </system>
Aug 01 18:38:14 user nova-compute[72150]:   </sysinfo>
Aug 01 18:38:14 user nova-compute[72150]:   <os>
Aug 01 18:38:14 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:38:14 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:38:14 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:38:14 user nova-compute[72150]:   </os>
Aug 01 18:38:14 user nova-compute[72150]:   <features>
Aug 01 18:38:14 user nova-compute[72150]:     <acpi/>
Aug 01 18:38:14 user nova-compute[72150]:     <apic/>
Aug 01 18:38:14 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:38:14 user nova-compute[72150]:   </features>
Aug 01 18:38:14 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:38:14 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:38:14 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:38:14 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:38:14 user nova-compute[72150]:   </clock>
Aug 01 18:38:14 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:38:14 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:38:14 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:38:14 user nova-compute[72150]:   </cpu>
Aug 01 18:38:14 user nova-compute[72150]:   <devices>
Aug 01 18:38:14 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:38:14 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:38:14 user nova-compute[72150]:       <source dev="/dev/sdf"/>
Aug 01 18:38:14 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:38:14 user nova-compute[72150]:       <serial>134cfd38-e4a8-46fc-a35e-4c37a1e4a052</serial>
Aug 01 18:38:14 user nova-compute[72150]:     </disk>
Aug 01 18:38:14 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:38:14 user nova-compute[72150]:       <mac address="fa:16:3e:c8:34:35"/>
Aug 01 18:38:14 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:38:14 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:38:14 user nova-compute[72150]:       <target dev="tapc4fe7e1b-47"/>
Aug 01 18:38:14 user nova-compute[72150]:     </interface>
Aug 01 18:38:14 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:38:14 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/5dbd0cf2-7aa9-452a-9322-a58c23d7cc52/console.log" append="off"/>
Aug 01 18:38:14 user nova-compute[72150]:     </serial>
Aug 01 18:38:14 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:38:14 user nova-compute[72150]:     <video>
Aug 01 18:38:14 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:38:14 user nova-compute[72150]:     </video>
Aug 01 18:38:14 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:38:14 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:38:14 user nova-compute[72150]:     </rng>
Aug 01 18:38:14 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:38:14 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:38:14 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:38:14 user nova-compute[72150]:     </memballoon>
Aug 01 18:38:14 user nova-compute[72150]:   </devices>
Aug 01 18:38:14 user nova-compute[72150]: </domain>
Aug 01 18:38:14 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:38:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-751874109',display_name='tempest-TestVolumeBootPattern-server-751874109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-751874109',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVf3lHt050k356A8Gut9WieNqP8u9vIp5xdHm1rq7ONC5kHGtGA6mBo7SyXu2T5UgJrBcaDoeDkrLO73m2dxgj5g1F2RdpTy7mOLuxRD5SR618gGiTwTven5q6qp8rd8g==',key_name='tempest-TestVolumeBootPattern-35567601',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7ca44f23b114893afcfe57c52f693b1',ramdisk_id='',reservation_id='r-jpirbdib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-295340968',owner_user_name='tempest-TestVolumeBootPattern-295340968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:38:03Z,user_data=None,user_id='92c7ef0ed6814f8880de76adb913a487',uuid=5dbd0cf2-7aa9-452a-9322-a58c23d7cc52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "address": "fa:16:3e:c8:34:35", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fe7e1b-47", "ovs_interfaceid": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converting VIF {"id": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "address": "fa:16:3e:c8:34:35", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fe7e1b-47", "ovs_interfaceid": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:34:35,bridge_name='br-int',has_traffic_filtering=True,id=c4fe7e1b-47aa-495a-9f09-2780827d1f41,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4fe7e1b-47') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG os_vif [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:34:35,bridge_name='br-int',has_traffic_filtering=True,id=c4fe7e1b-47aa-495a-9f09-2780827d1f41,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4fe7e1b-47') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4fe7e1b-47, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc4fe7e1b-47, col_values=(('external_ids', {'iface-id': 'c4fe7e1b-47aa-495a-9f09-2780827d1f41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:34:35', 'vm-uuid': '5dbd0cf2-7aa9-452a-9322-a58c23d7cc52'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:14 user nova-compute[72150]: INFO os_vif [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:34:35,bridge_name='br-int',has_traffic_filtering=True,id=c4fe7e1b-47aa-495a-9f09-2780827d1f41,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4fe7e1b-47')
Aug 01 18:38:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] No VIF found with MAC fa:16:3e:c8:34:35, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:38:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:15 user nova-compute[72150]: DEBUG nova.compute.manager [req-f257ce4e-37cf-4e2f-8b67-69d7ca86c0ac req-8326a997-aaa0-4a2d-97f2-1c83fd17607e service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Received event network-vif-plugged-c4fe7e1b-47aa-495a-9f09-2780827d1f41 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:38:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f257ce4e-37cf-4e2f-8b67-69d7ca86c0ac req-8326a997-aaa0-4a2d-97f2-1c83fd17607e service nova] Acquiring lock "5dbd0cf2-7aa9-452a-9322-a58c23d7cc52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f257ce4e-37cf-4e2f-8b67-69d7ca86c0ac req-8326a997-aaa0-4a2d-97f2-1c83fd17607e service nova] Lock "5dbd0cf2-7aa9-452a-9322-a58c23d7cc52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f257ce4e-37cf-4e2f-8b67-69d7ca86c0ac req-8326a997-aaa0-4a2d-97f2-1c83fd17607e service nova] Lock "5dbd0cf2-7aa9-452a-9322-a58c23d7cc52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:15 user nova-compute[72150]: DEBUG nova.compute.manager [req-f257ce4e-37cf-4e2f-8b67-69d7ca86c0ac req-8326a997-aaa0-4a2d-97f2-1c83fd17607e service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] No waiting events found dispatching network-vif-plugged-c4fe7e1b-47aa-495a-9f09-2780827d1f41 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:38:15 user nova-compute[72150]: WARNING nova.compute.manager [req-f257ce4e-37cf-4e2f-8b67-69d7ca86c0ac req-8326a997-aaa0-4a2d-97f2-1c83fd17607e service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Received unexpected event network-vif-plugged-c4fe7e1b-47aa-495a-9f09-2780827d1f41 for instance with vm_state building and task_state spawning.
Aug 01 18:38:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:17 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915097.9378152, 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:38:17 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] VM Resumed (Lifecycle Event)
Aug 01 18:38:17 user nova-compute[72150]: DEBUG nova.compute.manager [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:38:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:38:17 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Instance spawned successfully.
Aug 01 18:38:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:38:17 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:38:17 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:38:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:38:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:38:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:38:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:38:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:38:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:38:17 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:38:17 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915097.9389079, 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:38:17 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] VM Started (Lifecycle Event)
Aug 01 18:38:18 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:38:18 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:38:18 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:38:18 user nova-compute[72150]: DEBUG nova.compute.manager [req-6c62c97c-19bc-4983-a3c1-e218f04a318d req-e7b770a1-6143-4a37-9e57-da78179913e2 service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Received event network-vif-plugged-c4fe7e1b-47aa-495a-9f09-2780827d1f41 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:38:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6c62c97c-19bc-4983-a3c1-e218f04a318d req-e7b770a1-6143-4a37-9e57-da78179913e2 service nova] Acquiring lock "5dbd0cf2-7aa9-452a-9322-a58c23d7cc52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6c62c97c-19bc-4983-a3c1-e218f04a318d req-e7b770a1-6143-4a37-9e57-da78179913e2 service nova] Lock "5dbd0cf2-7aa9-452a-9322-a58c23d7cc52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6c62c97c-19bc-4983-a3c1-e218f04a318d req-e7b770a1-6143-4a37-9e57-da78179913e2 service nova] Lock "5dbd0cf2-7aa9-452a-9322-a58c23d7cc52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:18 user nova-compute[72150]: DEBUG nova.compute.manager [req-6c62c97c-19bc-4983-a3c1-e218f04a318d req-e7b770a1-6143-4a37-9e57-da78179913e2 service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] No waiting events found dispatching network-vif-plugged-c4fe7e1b-47aa-495a-9f09-2780827d1f41 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:38:18 user nova-compute[72150]: WARNING nova.compute.manager [req-6c62c97c-19bc-4983-a3c1-e218f04a318d req-e7b770a1-6143-4a37-9e57-da78179913e2 service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Received unexpected event network-vif-plugged-c4fe7e1b-47aa-495a-9f09-2780827d1f41 for instance with vm_state building and task_state spawning.
Aug 01 18:38:18 user nova-compute[72150]: INFO nova.compute.manager [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Took 5.43 seconds to spawn the instance on the hypervisor.
Aug 01 18:38:18 user nova-compute[72150]: DEBUG nova.compute.manager [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:38:18 user nova-compute[72150]: INFO nova.compute.manager [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Took 15.73 seconds to build instance.
Aug 01 18:38:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-50846c0a-4ba3-4ee2-8e37-dc555b296872 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "5dbd0cf2-7aa9-452a-9322-a58c23d7cc52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.870s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG nova.compute.manager [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:38:21 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Creating image(s)
Aug 01 18:38:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Did not create local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Ensure instance console log exists: /opt/stack/data/nova/instances/316953c9-42a9-4598-9385-0c138415ea6f/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Start _get_guest_xml network_info=[{"id": "ed51a469-3095-4679-b038-c18153c8f95e", "address": "fa:16:3e:13:9f:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped51a469-30", "ovs_interfaceid": "ed51a469-3095-4679-b038-c18153c8f95e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd697df91-a93a-4b65-be6e-52bfda49a963', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oOkAyqjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '316953c9-42a9-4598-9385-0c138415ea6f', 'attached_at': '', 'detached_at': '', 'volume_id': '39b8b189-c5f4-4c2a-a973-ee3f807ea688', 'serial': '39b8b189-c5f4-4c2a-a973-ee3f807ea688'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:38:21 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:38:21 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:38:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oOkAyqjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:38:21 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:38:21 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:38:21 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c25c7e9-a440-44b7-ba57-6c352a0ce9f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:38:21 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e42422-8981-4bba-ad56-c5c661dc5203]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688] added
Aug 01 18:38:21 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c72471-b27a-4bdd-afe1-4fa72f16ead6]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a7bad4-fb5b-437a-8d3b-06e79b37fdd9]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oOkAyqjD {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oOkAyqjD" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd63ea9-6d46-42d2-8a7c-f65f544afd2f]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oOkAyqjD'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4214a391-8a10-43a1-8f64-0682423c79c2]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22b40c3-e68d-43a0-a8c9-179d339b9814]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:38:21 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:38:21 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:38:21 user nova-compute[72150]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:38:21 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:38:21 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:38:21 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:38:21 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:38:21 user nova-compute[72150]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:38:21 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:38:21 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0f8333-6b67-48b5-a1ff-a07a1942bf0c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688, portal: 172.16.0.220,3260]
Aug 01 18:38:21 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688, portal: 172.16.0.220,3260] successful.
Aug 01 18:38:21 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6af377b-08c7-410c-91e8-b814012112d3]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d90875-5e76-44a1-8301-672b51636d1c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:38:21 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:38:21 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:38:21 user nova-compute[72150]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:38:21 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:38:21 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:38:21 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:38:21 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:38:21 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:38:21 user nova-compute[72150]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:38:21 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:38:21 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:38:21 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] HCTL ('38', '-', '-', 0) found on session 43 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fa1cb2-72fc-4a6c-873c-8902bcf22e0f]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Searching for a device in session 43 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:38:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oOkAyqjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:38:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:38:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23434656432363939', 'path': '/dev/sdg'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:38:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434656432363939', 'path': '/dev/sdg'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:38:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:37:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-441711796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-441711796',id=36,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ad8ef64d051424e9fe644a1fb40fcb4',ramdisk_id='',reservation_id='r-cwbwup3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-23372548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:38:01Z,user_data=None,user_id='cc00b9006f5842c6b875c5d25538b718',uuid=316953c9-42a9-4598-9385-0c138415ea6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed51a469-3095-4679-b038-c18153c8f95e", "address": "fa:16:3e:13:9f:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped51a469-30", "ovs_interfaceid": "ed51a469-3095-4679-b038-c18153c8f95e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:38:22 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converting VIF {"id": "ed51a469-3095-4679-b038-c18153c8f95e", "address": "fa:16:3e:13:9f:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped51a469-30", "ovs_interfaceid": "ed51a469-3095-4679-b038-c18153c8f95e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:38:22 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:9f:5a,bridge_name='br-int',has_traffic_filtering=True,id=ed51a469-3095-4679-b038-c18153c8f95e,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped51a469-30') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:38:22 user nova-compute[72150]: DEBUG nova.objects.instance [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'pci_devices' on Instance uuid 316953c9-42a9-4598-9385-0c138415ea6f {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:38:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:38:22 user nova-compute[72150]:   <uuid>316953c9-42a9-4598-9385-0c138415ea6f</uuid>
Aug 01 18:38:22 user nova-compute[72150]:   <name>instance-00000024</name>
Aug 01 18:38:22 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:38:22 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:38:22 user nova-compute[72150]:   <metadata>
Aug 01 18:38:22 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:38:22 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:38:22 user nova-compute[72150]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-441711796</nova:name>
Aug 01 18:38:22 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:38:21</nova:creationTime>
Aug 01 18:38:22 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:38:22 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:38:22 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:38:22 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:38:22 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:38:22 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:38:22 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:38:22 user nova-compute[72150]:       <nova:owner>
Aug 01 18:38:22 user nova-compute[72150]:         <nova:user uuid="cc00b9006f5842c6b875c5d25538b718">tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member</nova:user>
Aug 01 18:38:22 user nova-compute[72150]:         <nova:project uuid="5ad8ef64d051424e9fe644a1fb40fcb4">tempest-ServerBootFromVolumeStableRescueTest-23372548</nova:project>
Aug 01 18:38:22 user nova-compute[72150]:       </nova:owner>
Aug 01 18:38:22 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:38:22 user nova-compute[72150]:       <nova:ports>
Aug 01 18:38:22 user nova-compute[72150]:         <nova:port uuid="ed51a469-3095-4679-b038-c18153c8f95e">
Aug 01 18:38:22 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 18:38:22 user nova-compute[72150]:         </nova:port>
Aug 01 18:38:22 user nova-compute[72150]:       </nova:ports>
Aug 01 18:38:22 user nova-compute[72150]:     </nova:instance>
Aug 01 18:38:22 user nova-compute[72150]:   </metadata>
Aug 01 18:38:22 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:38:22 user nova-compute[72150]:     <system>
Aug 01 18:38:22 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:38:22 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:38:22 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:38:22 user nova-compute[72150]:       <entry name="serial">316953c9-42a9-4598-9385-0c138415ea6f</entry>
Aug 01 18:38:22 user nova-compute[72150]:       <entry name="uuid">316953c9-42a9-4598-9385-0c138415ea6f</entry>
Aug 01 18:38:22 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:38:22 user nova-compute[72150]:     </system>
Aug 01 18:38:22 user nova-compute[72150]:   </sysinfo>
Aug 01 18:38:22 user nova-compute[72150]:   <os>
Aug 01 18:38:22 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:38:22 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:38:22 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:38:22 user nova-compute[72150]:   </os>
Aug 01 18:38:22 user nova-compute[72150]:   <features>
Aug 01 18:38:22 user nova-compute[72150]:     <acpi/>
Aug 01 18:38:22 user nova-compute[72150]:     <apic/>
Aug 01 18:38:22 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:38:22 user nova-compute[72150]:   </features>
Aug 01 18:38:22 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:38:22 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:38:22 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:38:22 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:38:22 user nova-compute[72150]:   </clock>
Aug 01 18:38:22 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:38:22 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:38:22 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:38:22 user nova-compute[72150]:   </cpu>
Aug 01 18:38:22 user nova-compute[72150]:   <devices>
Aug 01 18:38:22 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:38:22 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:38:22 user nova-compute[72150]:       <source dev="/dev/sdg"/>
Aug 01 18:38:22 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:38:22 user nova-compute[72150]:       <serial>39b8b189-c5f4-4c2a-a973-ee3f807ea688</serial>
Aug 01 18:38:22 user nova-compute[72150]:     </disk>
Aug 01 18:38:22 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:38:22 user nova-compute[72150]:       <mac address="fa:16:3e:13:9f:5a"/>
Aug 01 18:38:22 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:38:22 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:38:22 user nova-compute[72150]:       <target dev="taped51a469-30"/>
Aug 01 18:38:22 user nova-compute[72150]:     </interface>
Aug 01 18:38:22 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:38:22 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/316953c9-42a9-4598-9385-0c138415ea6f/console.log" append="off"/>
Aug 01 18:38:22 user nova-compute[72150]:     </serial>
Aug 01 18:38:22 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:38:22 user nova-compute[72150]:     <video>
Aug 01 18:38:22 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:38:22 user nova-compute[72150]:     </video>
Aug 01 18:38:22 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:38:22 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:38:22 user nova-compute[72150]:     </rng>
Aug 01 18:38:22 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:38:22 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:38:22 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:38:22 user nova-compute[72150]:     </memballoon>
Aug 01 18:38:22 user nova-compute[72150]:   </devices>
Aug 01 18:38:22 user nova-compute[72150]: </domain>
Aug 01 18:38:22 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:38:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:37:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-441711796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-441711796',id=36,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ad8ef64d051424e9fe644a1fb40fcb4',ramdisk_id='',reservation_id='r-cwbwup3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-23372548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:38:01Z,user_data=None,user_id='cc00b9006f5842c6b875c5d25538b718',uuid=316953c9-42a9-4598-9385-0c138415ea6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed51a469-3095-4679-b038-c18153c8f95e", "address": "fa:16:3e:13:9f:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped51a469-30", "ovs_interfaceid": "ed51a469-3095-4679-b038-c18153c8f95e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:38:22 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converting VIF {"id": "ed51a469-3095-4679-b038-c18153c8f95e", "address": "fa:16:3e:13:9f:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped51a469-30", "ovs_interfaceid": "ed51a469-3095-4679-b038-c18153c8f95e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:38:22 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:9f:5a,bridge_name='br-int',has_traffic_filtering=True,id=ed51a469-3095-4679-b038-c18153c8f95e,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped51a469-30') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:38:22 user nova-compute[72150]: DEBUG os_vif [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:9f:5a,bridge_name='br-int',has_traffic_filtering=True,id=ed51a469-3095-4679-b038-c18153c8f95e,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped51a469-30') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:38:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:38:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:38:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped51a469-30, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:38:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped51a469-30, col_values=(('external_ids', {'iface-id': 'ed51a469-3095-4679-b038-c18153c8f95e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:9f:5a', 'vm-uuid': '316953c9-42a9-4598-9385-0c138415ea6f'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:38:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:38:22 user nova-compute[72150]: INFO os_vif [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:9f:5a,bridge_name='br-int',has_traffic_filtering=True,id=ed51a469-3095-4679-b038-c18153c8f95e,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped51a469-30')
Aug 01 18:38:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:38:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] No VIF found with MAC fa:16:3e:13:9f:5a, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:38:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:24 user nova-compute[72150]: DEBUG nova.compute.manager [req-c8bc0e99-9a3d-4bee-bb51-b1e0c561edc1 req-7efe2582-5aea-43b5-929d-751c4e08038d service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:38:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c8bc0e99-9a3d-4bee-bb51-b1e0c561edc1 req-7efe2582-5aea-43b5-929d-751c4e08038d service nova] Acquiring lock "316953c9-42a9-4598-9385-0c138415ea6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c8bc0e99-9a3d-4bee-bb51-b1e0c561edc1 req-7efe2582-5aea-43b5-929d-751c4e08038d service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c8bc0e99-9a3d-4bee-bb51-b1e0c561edc1 req-7efe2582-5aea-43b5-929d-751c4e08038d service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:24 user nova-compute[72150]: DEBUG nova.compute.manager [req-c8bc0e99-9a3d-4bee-bb51-b1e0c561edc1 req-7efe2582-5aea-43b5-929d-751c4e08038d service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] No waiting events found dispatching network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:38:24 user nova-compute[72150]: WARNING nova.compute.manager [req-c8bc0e99-9a3d-4bee-bb51-b1e0c561edc1 req-7efe2582-5aea-43b5-929d-751c4e08038d service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received unexpected event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e for instance with vm_state building and task_state spawning.
Aug 01 18:38:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:26 user nova-compute[72150]: DEBUG nova.compute.manager [req-e683848f-f850-43ff-b2e9-8242330c8ada req-0cce21e8-0334-48cc-a171-88fc36bd21cf service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:38:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e683848f-f850-43ff-b2e9-8242330c8ada req-0cce21e8-0334-48cc-a171-88fc36bd21cf service nova] Acquiring lock "316953c9-42a9-4598-9385-0c138415ea6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e683848f-f850-43ff-b2e9-8242330c8ada req-0cce21e8-0334-48cc-a171-88fc36bd21cf service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e683848f-f850-43ff-b2e9-8242330c8ada req-0cce21e8-0334-48cc-a171-88fc36bd21cf service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:26 user nova-compute[72150]: DEBUG nova.compute.manager [req-e683848f-f850-43ff-b2e9-8242330c8ada req-0cce21e8-0334-48cc-a171-88fc36bd21cf service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] No waiting events found dispatching network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:38:26 user nova-compute[72150]: WARNING nova.compute.manager [req-e683848f-f850-43ff-b2e9-8242330c8ada req-0cce21e8-0334-48cc-a171-88fc36bd21cf service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received unexpected event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e for instance with vm_state building and task_state spawning.
Aug 01 18:38:26 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915106.4544947, 316953c9-42a9-4598-9385-0c138415ea6f => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:38:26 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] VM Resumed (Lifecycle Event)
Aug 01 18:38:26 user nova-compute[72150]: DEBUG nova.compute.manager [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:38:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:38:26 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Instance spawned successfully.
Aug 01 18:38:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:38:26 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:38:26 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:38:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:38:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:38:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:38:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:38:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:38:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:38:26 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:38:26 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915106.45694, 316953c9-42a9-4598-9385-0c138415ea6f => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:38:26 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] VM Started (Lifecycle Event)
Aug 01 18:38:26 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:38:26 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:38:26 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:38:26 user nova-compute[72150]: INFO nova.compute.manager [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Took 5.57 seconds to spawn the instance on the hypervisor.
Aug 01 18:38:26 user nova-compute[72150]: DEBUG nova.compute.manager [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:38:26 user nova-compute[72150]: INFO nova.compute.manager [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Took 26.65 seconds to build instance.
Aug 01 18:38:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b3bcd7d2-301c-45c0-b314-ca3b82e5a0d4 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "316953c9-42a9-4598-9385-0c138415ea6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.746s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:33 user nova-compute[72150]: INFO nova.compute.manager [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Terminating instance
Aug 01 18:38:33 user nova-compute[72150]: DEBUG nova.compute.manager [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG nova.compute.manager [req-c94b4450-ba65-4829-95ae-3bb8519ce7a3 req-274b9d54-2cf9-4b60-b266-bf70a3377c84 service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Received event network-vif-unplugged-0558e7ef-e6d8-48fa-a27a-910bd9535e71 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c94b4450-ba65-4829-95ae-3bb8519ce7a3 req-274b9d54-2cf9-4b60-b266-bf70a3377c84 service nova] Acquiring lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c94b4450-ba65-4829-95ae-3bb8519ce7a3 req-274b9d54-2cf9-4b60-b266-bf70a3377c84 service nova] Lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c94b4450-ba65-4829-95ae-3bb8519ce7a3 req-274b9d54-2cf9-4b60-b266-bf70a3377c84 service nova] Lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG nova.compute.manager [req-c94b4450-ba65-4829-95ae-3bb8519ce7a3 req-274b9d54-2cf9-4b60-b266-bf70a3377c84 service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] No waiting events found dispatching network-vif-unplugged-0558e7ef-e6d8-48fa-a27a-910bd9535e71 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG nova.compute.manager [req-c94b4450-ba65-4829-95ae-3bb8519ce7a3 req-274b9d54-2cf9-4b60-b266-bf70a3377c84 service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Received event network-vif-unplugged-0558e7ef-e6d8-48fa-a27a-910bd9535e71 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:38:33 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Instance destroyed successfully.
Aug 01 18:38:33 user nova-compute[72150]: DEBUG nova.objects.instance [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lazy-loading 'resources' on Instance uuid b10328c7-3328-4c3c-8ebe-3dd282ece0c9 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:32:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1581745707',display_name='tempest-AttachVolumeNegativeTest-server-1581745707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1581745707',id=27,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7gmptPh60Dx3ME8Qo8sFkf44Fg+2FHWtxkTYxwet9R8ZyQuD8jL3IFmhxppu58jWwHPNnmeT4alKtnTBqxDCCXQTFfPVCm0Nl8GkqVOqFHYo9jz+bn15zxFGoUYSNJMQ==',key_name='tempest-keypair-767620536',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:32:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66bad8c4e2a74caf8d35ad98e7888266',ramdisk_id='',reservation_id='r-k4afbu2h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-504132593',owner_user_name='tempest-AttachVolumeNegativeTest-504132593-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:32:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f11bcc2f9cc048beb928fc0d3c30403e',uuid=b10328c7-3328-4c3c-8ebe-3dd282ece0c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0558e7ef-e6d8-48fa-a27a-910bd9535e71", "address": "fa:16:3e:f6:d1:22", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0558e7ef-e6", "ovs_interfaceid": "0558e7ef-e6d8-48fa-a27a-910bd9535e71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converting VIF {"id": "0558e7ef-e6d8-48fa-a27a-910bd9535e71", "address": "fa:16:3e:f6:d1:22", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0558e7ef-e6", "ovs_interfaceid": "0558e7ef-e6d8-48fa-a27a-910bd9535e71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:d1:22,bridge_name='br-int',has_traffic_filtering=True,id=0558e7ef-e6d8-48fa-a27a-910bd9535e71,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0558e7ef-e6') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG os_vif [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:d1:22,bridge_name='br-int',has_traffic_filtering=True,id=0558e7ef-e6d8-48fa-a27a-910bd9535e71,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0558e7ef-e6') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0558e7ef-e6, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:33 user nova-compute[72150]: INFO os_vif [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:d1:22,bridge_name='br-int',has_traffic_filtering=True,id=0558e7ef-e6d8-48fa-a27a-910bd9535e71,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0558e7ef-e6')
Aug 01 18:38:33 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Deleting instance files /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9_del
Aug 01 18:38:33 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Deletion of /opt/stack/data/nova/instances/b10328c7-3328-4c3c-8ebe-3dd282ece0c9_del complete
Aug 01 18:38:34 user nova-compute[72150]: INFO nova.compute.manager [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 01 18:38:34 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:38:34 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:38:34 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:38:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:35 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:38:35 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Took 0.96 seconds to deallocate network for instance.
Aug 01 18:38:35 user nova-compute[72150]: DEBUG nova.compute.manager [req-68f38fa6-982e-407a-9eef-a34b7361fc0e req-a8e1a27f-3b4c-4c57-ba30-508d0da1aa74 service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Received event network-vif-deleted-0558e7ef-e6d8-48fa-a27a-910bd9535e71 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:38:35 user nova-compute[72150]: INFO nova.compute.manager [req-68f38fa6-982e-407a-9eef-a34b7361fc0e req-a8e1a27f-3b4c-4c57-ba30-508d0da1aa74 service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Neutron deleted interface 0558e7ef-e6d8-48fa-a27a-910bd9535e71; detaching it from the instance and deleting it from the info cache
Aug 01 18:38:35 user nova-compute[72150]: DEBUG nova.network.neutron [req-68f38fa6-982e-407a-9eef-a34b7361fc0e req-a8e1a27f-3b4c-4c57-ba30-508d0da1aa74 service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:38:35 user nova-compute[72150]: DEBUG nova.compute.manager [req-68f38fa6-982e-407a-9eef-a34b7361fc0e req-a8e1a27f-3b4c-4c57-ba30-508d0da1aa74 service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Detach interface failed, port_id=0558e7ef-e6d8-48fa-a27a-910bd9535e71, reason: Instance b10328c7-3328-4c3c-8ebe-3dd282ece0c9 could not be found. {{(pid=72150) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 18:38:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:35 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Refreshing inventories for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 18:38:35 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Updating ProviderTree inventory for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 18:38:35 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Updating inventory in ProviderTree for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 18:38:35 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Refreshing aggregate associations for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479, aggregates: None {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 18:38:35 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Refreshing trait associations for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 18:38:35 user nova-compute[72150]: DEBUG nova.compute.manager [req-851c6129-4ccf-4a2a-a0d9-a6a35dcbc986 req-6691055f-1a35-41f6-8d9b-b1d03a9ff2a9 service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Received event network-vif-plugged-0558e7ef-e6d8-48fa-a27a-910bd9535e71 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:38:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-851c6129-4ccf-4a2a-a0d9-a6a35dcbc986 req-6691055f-1a35-41f6-8d9b-b1d03a9ff2a9 service nova] Acquiring lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-851c6129-4ccf-4a2a-a0d9-a6a35dcbc986 req-6691055f-1a35-41f6-8d9b-b1d03a9ff2a9 service nova] Lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-851c6129-4ccf-4a2a-a0d9-a6a35dcbc986 req-6691055f-1a35-41f6-8d9b-b1d03a9ff2a9 service nova] Lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:35 user nova-compute[72150]: DEBUG nova.compute.manager [req-851c6129-4ccf-4a2a-a0d9-a6a35dcbc986 req-6691055f-1a35-41f6-8d9b-b1d03a9ff2a9 service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] No waiting events found dispatching network-vif-plugged-0558e7ef-e6d8-48fa-a27a-910bd9535e71 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:38:35 user nova-compute[72150]: WARNING nova.compute.manager [req-851c6129-4ccf-4a2a-a0d9-a6a35dcbc986 req-6691055f-1a35-41f6-8d9b-b1d03a9ff2a9 service nova] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Received unexpected event network-vif-plugged-0558e7ef-e6d8-48fa-a27a-910bd9535e71 for instance with vm_state deleted and task_state None.
Aug 01 18:38:35 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:38:35 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:38:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.685s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:35 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Deleted allocations for instance b10328c7-3328-4c3c-8ebe-3dd282ece0c9
Aug 01 18:38:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-64bfb1f9-a536-4684-977e-6fb60711736f tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "b10328c7-3328-4c3c-8ebe-3dd282ece0c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.852s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:39 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:38:40 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:38:42 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:38:42 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:38:42 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:38:42 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:38:43 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:38:43 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:38:43 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 18:38:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-769690c8-53c5-4057-88a5-fbdbcb930e32" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:38:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-769690c8-53c5-4057-88a5-fbdbcb930e32" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:38:43 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:38:43 user nova-compute[72150]: DEBUG nova.objects.instance [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lazy-loading 'info_cache' on Instance uuid 769690c8-53c5-4057-88a5-fbdbcb930e32 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:38:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:44 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Updating instance_info_cache with network_info: [{"id": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "address": "fa:16:3e:8e:d7:75", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2596e33-c1", "ovs_interfaceid": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:38:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-769690c8-53c5-4057-88a5-fbdbcb930e32" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:38:44 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:38:44 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:38:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:44 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:38:44 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:38:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:38:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:38:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:38:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:38:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:38:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:48 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:38:48 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:38:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=7048MB free_disk=25.29928207397461GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Applying migration context for instance 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 as it has an incoming, in-progress migration 3de744ad-9181-4023-8bdc-93e18fae964d. Migration status is finished {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 18:38:48 user nova-compute[72150]: INFO nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Updating resource usage from migration 3de744ad-9181-4023-8bdc-93e18fae964d
Aug 01 18:38:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 769690c8-53c5-4057-88a5-fbdbcb930e32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ea68420b-8362-4df3-b710-cd1cf76adba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 08851ec4-6f71-4ec1-a092-42aab83ee87f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance bf2d1f14-2227-41d1-bd73-a05ab3149aba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 42e75a98-beb1-4688-a375-affc63b14252 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 65b04144-3b1f-4975-8524-2c9f9660672a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance d2117837-5552-4ec3-9f9b-62629c1ff4cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 737a8853-f9b9-4a0b-95a1-200d72c4d806 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Migration 3de744ad-9181-4023-8bdc-93e18fae964d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 07213597-fa7a-4422-956a-1b02737cc647 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 316953c9-42a9-4598-9385-0c138415ea6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.621s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915113.9255936, b10328c7-3328-4c3c-8ebe-3dd282ece0c9 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:38:48 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] VM Stopped (Lifecycle Event)
Aug 01 18:38:48 user nova-compute[72150]: DEBUG nova.compute.manager [None req-db3f7cab-b6be-4f5f-a43d-045890a8cb60 None None] [instance: b10328c7-3328-4c3c-8ebe-3dd282ece0c9] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:48 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:38:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Acquiring lock "9d402a88-3a51-48af-8bc9-53a2040f8634" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "9d402a88-3a51-48af-8bc9-53a2040f8634" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:38:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:57 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:38:57 user nova-compute[72150]: INFO nova.compute.claims [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Claim successful on node user
Aug 01 18:38:58 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG nova.network.neutron [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:38:58 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:38:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG nova.policy [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dccfa49288a945b9b0707c140b0b2cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871994ab4c4848dfbe070a8d9c8d1d4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:38:58 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Creating image(s)
Aug 01 18:38:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d402a88-3a51-48af-8bc9-53a2040f8634/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "/opt/stack/data/nova/instances/9d402a88-3a51-48af-8bc9-53a2040f8634/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "/opt/stack/data/nova/instances/9d402a88-3a51-48af-8bc9-53a2040f8634/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.132s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/9d402a88-3a51-48af-8bc9-53a2040f8634/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/9d402a88-3a51-48af-8bc9-53a2040f8634/disk 1073741824" returned: 0 in 0.055s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.156s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d402a88-3a51-48af-8bc9-53a2040f8634/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d402a88-3a51-48af-8bc9-53a2040f8634/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d402a88-3a51-48af-8bc9-53a2040f8634/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Cannot resize image /opt/stack/data/nova/instances/9d402a88-3a51-48af-8bc9-53a2040f8634/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG nova.objects.instance [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lazy-loading 'migration_context' on Instance uuid 9d402a88-3a51-48af-8bc9-53a2040f8634 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Ensure instance console log exists: /opt/stack/data/nova/instances/9d402a88-3a51-48af-8bc9-53a2040f8634/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:38:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:38:59 user nova-compute[72150]: DEBUG nova.network.neutron [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Successfully created port: e80b9f9f-0b9c-4388-90e7-d36d277cc846 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:38:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.network.neutron [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Successfully updated port: e80b9f9f-0b9c-4388-90e7-d36d277cc846 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Acquiring lock "refresh_cache-9d402a88-3a51-48af-8bc9-53a2040f8634" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Acquired lock "refresh_cache-9d402a88-3a51-48af-8bc9-53a2040f8634" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.network.neutron [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.compute.manager [req-6593979b-81d7-45da-b4f6-3551b35b049d req-b4ebca3e-e669-4bb2-b97b-0eb5c914fcde service nova] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Received event network-changed-e80b9f9f-0b9c-4388-90e7-d36d277cc846 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.compute.manager [req-6593979b-81d7-45da-b4f6-3551b35b049d req-b4ebca3e-e669-4bb2-b97b-0eb5c914fcde service nova] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Refreshing instance network info cache due to event network-changed-e80b9f9f-0b9c-4388-90e7-d36d277cc846. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6593979b-81d7-45da-b4f6-3551b35b049d req-b4ebca3e-e669-4bb2-b97b-0eb5c914fcde service nova] Acquiring lock "refresh_cache-9d402a88-3a51-48af-8bc9-53a2040f8634" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.network.neutron [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.network.neutron [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Updating instance_info_cache with network_info: [{"id": "e80b9f9f-0b9c-4388-90e7-d36d277cc846", "address": "fa:16:3e:11:7e:32", "network": {"id": "c7354620-f943-40a7-a673-5e6e9103498d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205923950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871994ab4c4848dfbe070a8d9c8d1d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape80b9f9f-0b", "ovs_interfaceid": "e80b9f9f-0b9c-4388-90e7-d36d277cc846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Releasing lock "refresh_cache-9d402a88-3a51-48af-8bc9-53a2040f8634" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.compute.manager [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Instance network_info: |[{"id": "e80b9f9f-0b9c-4388-90e7-d36d277cc846", "address": "fa:16:3e:11:7e:32", "network": {"id": "c7354620-f943-40a7-a673-5e6e9103498d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205923950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871994ab4c4848dfbe070a8d9c8d1d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape80b9f9f-0b", "ovs_interfaceid": "e80b9f9f-0b9c-4388-90e7-d36d277cc846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6593979b-81d7-45da-b4f6-3551b35b049d req-b4ebca3e-e669-4bb2-b97b-0eb5c914fcde service nova] Acquired lock "refresh_cache-9d402a88-3a51-48af-8bc9-53a2040f8634" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.network.neutron [req-6593979b-81d7-45da-b4f6-3551b35b049d req-b4ebca3e-e669-4bb2-b97b-0eb5c914fcde service nova] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Refreshing network info cache for port e80b9f9f-0b9c-4388-90e7-d36d277cc846 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Start _get_guest_xml network_info=[{"id": "e80b9f9f-0b9c-4388-90e7-d36d277cc846", "address": "fa:16:3e:11:7e:32", "network": {"id": "c7354620-f943-40a7-a673-5e6e9103498d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205923950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871994ab4c4848dfbe070a8d9c8d1d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape80b9f9f-0b", "ovs_interfaceid": "e80b9f9f-0b9c-4388-90e7-d36d277cc846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:39:00 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:39:00 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1868345466',display_name='tempest-ServersNegativeTestJSON-server-1868345466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1868345466',id=38,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='871994ab4c4848dfbe070a8d9c8d1d4e',ramdisk_id='',reservation_id='r-2m5aqx30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1642498340',owner_user_name='tempest-ServersNegativeTestJSON-1642498340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:38:58Z,user_data=None,user_id='dccfa49288a945b9b0707c140b0b2cbb',uuid=9d402a88-3a51-48af-8bc9-53a2040f8634,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e80b9f9f-0b9c-4388-90e7-d36d277cc846", "address": "fa:16:3e:11:7e:32", "network": {"id": "c7354620-f943-40a7-a673-5e6e9103498d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205923950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871994ab4c4848dfbe070a8d9c8d1d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape80b9f9f-0b", "ovs_interfaceid": "e80b9f9f-0b9c-4388-90e7-d36d277cc846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Converting VIF {"id": "e80b9f9f-0b9c-4388-90e7-d36d277cc846", "address": "fa:16:3e:11:7e:32", "network": {"id": "c7354620-f943-40a7-a673-5e6e9103498d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205923950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871994ab4c4848dfbe070a8d9c8d1d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape80b9f9f-0b", "ovs_interfaceid": "e80b9f9f-0b9c-4388-90e7-d36d277cc846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:7e:32,bridge_name='br-int',has_traffic_filtering=True,id=e80b9f9f-0b9c-4388-90e7-d36d277cc846,network=Network(c7354620-f943-40a7-a673-5e6e9103498d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape80b9f9f-0b') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.objects.instance [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d402a88-3a51-48af-8bc9-53a2040f8634 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:39:00 user nova-compute[72150]:   <uuid>9d402a88-3a51-48af-8bc9-53a2040f8634</uuid>
Aug 01 18:39:00 user nova-compute[72150]:   <name>instance-00000026</name>
Aug 01 18:39:00 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:39:00 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:39:00 user nova-compute[72150]:   <metadata>
Aug 01 18:39:00 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:39:00 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:39:00 user nova-compute[72150]:       <nova:name>tempest-ServersNegativeTestJSON-server-1868345466</nova:name>
Aug 01 18:39:00 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:39:00</nova:creationTime>
Aug 01 18:39:00 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:39:00 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:39:00 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:39:00 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:39:00 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:39:00 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:39:00 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:39:00 user nova-compute[72150]:       <nova:owner>
Aug 01 18:39:00 user nova-compute[72150]:         <nova:user uuid="dccfa49288a945b9b0707c140b0b2cbb">tempest-ServersNegativeTestJSON-1642498340-project-member</nova:user>
Aug 01 18:39:00 user nova-compute[72150]:         <nova:project uuid="871994ab4c4848dfbe070a8d9c8d1d4e">tempest-ServersNegativeTestJSON-1642498340</nova:project>
Aug 01 18:39:00 user nova-compute[72150]:       </nova:owner>
Aug 01 18:39:00 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:39:00 user nova-compute[72150]:       <nova:ports>
Aug 01 18:39:00 user nova-compute[72150]:         <nova:port uuid="e80b9f9f-0b9c-4388-90e7-d36d277cc846">
Aug 01 18:39:00 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 18:39:00 user nova-compute[72150]:         </nova:port>
Aug 01 18:39:00 user nova-compute[72150]:       </nova:ports>
Aug 01 18:39:00 user nova-compute[72150]:     </nova:instance>
Aug 01 18:39:00 user nova-compute[72150]:   </metadata>
Aug 01 18:39:00 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:39:00 user nova-compute[72150]:     <system>
Aug 01 18:39:00 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:39:00 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:39:00 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:39:00 user nova-compute[72150]:       <entry name="serial">9d402a88-3a51-48af-8bc9-53a2040f8634</entry>
Aug 01 18:39:00 user nova-compute[72150]:       <entry name="uuid">9d402a88-3a51-48af-8bc9-53a2040f8634</entry>
Aug 01 18:39:00 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:39:00 user nova-compute[72150]:     </system>
Aug 01 18:39:00 user nova-compute[72150]:   </sysinfo>
Aug 01 18:39:00 user nova-compute[72150]:   <os>
Aug 01 18:39:00 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:39:00 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:39:00 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:39:00 user nova-compute[72150]:   </os>
Aug 01 18:39:00 user nova-compute[72150]:   <features>
Aug 01 18:39:00 user nova-compute[72150]:     <acpi/>
Aug 01 18:39:00 user nova-compute[72150]:     <apic/>
Aug 01 18:39:00 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:39:00 user nova-compute[72150]:   </features>
Aug 01 18:39:00 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:39:00 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:39:00 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:39:00 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:39:00 user nova-compute[72150]:   </clock>
Aug 01 18:39:00 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:39:00 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:39:00 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:39:00 user nova-compute[72150]:   </cpu>
Aug 01 18:39:00 user nova-compute[72150]:   <devices>
Aug 01 18:39:00 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:39:00 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:39:00 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/9d402a88-3a51-48af-8bc9-53a2040f8634/disk"/>
Aug 01 18:39:00 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:39:00 user nova-compute[72150]:     </disk>
Aug 01 18:39:00 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:39:00 user nova-compute[72150]:       <mac address="fa:16:3e:11:7e:32"/>
Aug 01 18:39:00 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:39:00 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:39:00 user nova-compute[72150]:       <target dev="tape80b9f9f-0b"/>
Aug 01 18:39:00 user nova-compute[72150]:     </interface>
Aug 01 18:39:00 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:39:00 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/9d402a88-3a51-48af-8bc9-53a2040f8634/console.log" append="off"/>
Aug 01 18:39:00 user nova-compute[72150]:     </serial>
Aug 01 18:39:00 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:39:00 user nova-compute[72150]:     <video>
Aug 01 18:39:00 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:39:00 user nova-compute[72150]:     </video>
Aug 01 18:39:00 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:39:00 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:39:00 user nova-compute[72150]:     </rng>
Aug 01 18:39:00 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:39:00 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:39:00 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:39:00 user nova-compute[72150]:     </memballoon>
Aug 01 18:39:00 user nova-compute[72150]:   </devices>
Aug 01 18:39:00 user nova-compute[72150]: </domain>
Aug 01 18:39:00 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1868345466',display_name='tempest-ServersNegativeTestJSON-server-1868345466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1868345466',id=38,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='871994ab4c4848dfbe070a8d9c8d1d4e',ramdisk_id='',reservation_id='r-2m5aqx30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1642498340',owner_user_name='tempest-ServersNegativeTestJSON-1642498340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:38:58Z,user_data=None,user_id='dccfa49288a945b9b0707c140b0b2cbb',uuid=9d402a88-3a51-48af-8bc9-53a2040f8634,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e80b9f9f-0b9c-4388-90e7-d36d277cc846", "address": "fa:16:3e:11:7e:32", "network": {"id": "c7354620-f943-40a7-a673-5e6e9103498d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205923950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871994ab4c4848dfbe070a8d9c8d1d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape80b9f9f-0b", "ovs_interfaceid": "e80b9f9f-0b9c-4388-90e7-d36d277cc846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Converting VIF {"id": "e80b9f9f-0b9c-4388-90e7-d36d277cc846", "address": "fa:16:3e:11:7e:32", "network": {"id": "c7354620-f943-40a7-a673-5e6e9103498d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205923950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871994ab4c4848dfbe070a8d9c8d1d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape80b9f9f-0b", "ovs_interfaceid": "e80b9f9f-0b9c-4388-90e7-d36d277cc846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:7e:32,bridge_name='br-int',has_traffic_filtering=True,id=e80b9f9f-0b9c-4388-90e7-d36d277cc846,network=Network(c7354620-f943-40a7-a673-5e6e9103498d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape80b9f9f-0b') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG os_vif [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:7e:32,bridge_name='br-int',has_traffic_filtering=True,id=e80b9f9f-0b9c-4388-90e7-d36d277cc846,network=Network(c7354620-f943-40a7-a673-5e6e9103498d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape80b9f9f-0b') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape80b9f9f-0b, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape80b9f9f-0b, col_values=(('external_ids', {'iface-id': 'e80b9f9f-0b9c-4388-90e7-d36d277cc846', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:7e:32', 'vm-uuid': '9d402a88-3a51-48af-8bc9-53a2040f8634'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:00 user nova-compute[72150]: INFO os_vif [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:7e:32,bridge_name='br-int',has_traffic_filtering=True,id=e80b9f9f-0b9c-4388-90e7-d36d277cc846,network=Network(c7354620-f943-40a7-a673-5e6e9103498d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape80b9f9f-0b')
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:39:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] No VIF found with MAC fa:16:3e:11:7e:32, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:39:01 user nova-compute[72150]: DEBUG nova.network.neutron [req-6593979b-81d7-45da-b4f6-3551b35b049d req-b4ebca3e-e669-4bb2-b97b-0eb5c914fcde service nova] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Updated VIF entry in instance network info cache for port e80b9f9f-0b9c-4388-90e7-d36d277cc846. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:39:01 user nova-compute[72150]: DEBUG nova.network.neutron [req-6593979b-81d7-45da-b4f6-3551b35b049d req-b4ebca3e-e669-4bb2-b97b-0eb5c914fcde service nova] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Updating instance_info_cache with network_info: [{"id": "e80b9f9f-0b9c-4388-90e7-d36d277cc846", "address": "fa:16:3e:11:7e:32", "network": {"id": "c7354620-f943-40a7-a673-5e6e9103498d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205923950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871994ab4c4848dfbe070a8d9c8d1d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape80b9f9f-0b", "ovs_interfaceid": "e80b9f9f-0b9c-4388-90e7-d36d277cc846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:39:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6593979b-81d7-45da-b4f6-3551b35b049d req-b4ebca3e-e669-4bb2-b97b-0eb5c914fcde service nova] Releasing lock "refresh_cache-9d402a88-3a51-48af-8bc9-53a2040f8634" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:39:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:03 user nova-compute[72150]: DEBUG nova.compute.manager [req-1aa742a3-76ca-4d66-8bf7-1e417ed5f52b req-bb7bc742-9d20-4774-84cf-34d2981cfa52 service nova] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Received event network-vif-plugged-e80b9f9f-0b9c-4388-90e7-d36d277cc846 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:39:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1aa742a3-76ca-4d66-8bf7-1e417ed5f52b req-bb7bc742-9d20-4774-84cf-34d2981cfa52 service nova] Acquiring lock "9d402a88-3a51-48af-8bc9-53a2040f8634-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1aa742a3-76ca-4d66-8bf7-1e417ed5f52b req-bb7bc742-9d20-4774-84cf-34d2981cfa52 service nova] Lock "9d402a88-3a51-48af-8bc9-53a2040f8634-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1aa742a3-76ca-4d66-8bf7-1e417ed5f52b req-bb7bc742-9d20-4774-84cf-34d2981cfa52 service nova] Lock "9d402a88-3a51-48af-8bc9-53a2040f8634-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:03 user nova-compute[72150]: DEBUG nova.compute.manager [req-1aa742a3-76ca-4d66-8bf7-1e417ed5f52b req-bb7bc742-9d20-4774-84cf-34d2981cfa52 service nova] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] No waiting events found dispatching network-vif-plugged-e80b9f9f-0b9c-4388-90e7-d36d277cc846 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:39:03 user nova-compute[72150]: WARNING nova.compute.manager [req-1aa742a3-76ca-4d66-8bf7-1e417ed5f52b req-bb7bc742-9d20-4774-84cf-34d2981cfa52 service nova] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Received unexpected event network-vif-plugged-e80b9f9f-0b9c-4388-90e7-d36d277cc846 for instance with vm_state building and task_state spawning.
Aug 01 18:39:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:04 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915144.8271234, 9d402a88-3a51-48af-8bc9-53a2040f8634 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:39:04 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] VM Resumed (Lifecycle Event)
Aug 01 18:39:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:39:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:39:04 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Instance spawned successfully.
Aug 01 18:39:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:39:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:39:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:39:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:39:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:39:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:39:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:39:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:39:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:39:04 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:39:04 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915144.8287094, 9d402a88-3a51-48af-8bc9-53a2040f8634 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:39:04 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] VM Started (Lifecycle Event)
Aug 01 18:39:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:39:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:39:04 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:39:04 user nova-compute[72150]: INFO nova.compute.manager [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Took 6.63 seconds to spawn the instance on the hypervisor.
Aug 01 18:39:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:39:04 user nova-compute[72150]: DEBUG nova.compute.manager [req-82416792-2865-47d8-909a-1a205eb3a99a req-3bbd80cb-5af8-4883-99bb-620a9f38d373 service nova] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Received event network-vif-plugged-e80b9f9f-0b9c-4388-90e7-d36d277cc846 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:39:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-82416792-2865-47d8-909a-1a205eb3a99a req-3bbd80cb-5af8-4883-99bb-620a9f38d373 service nova] Acquiring lock "9d402a88-3a51-48af-8bc9-53a2040f8634-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-82416792-2865-47d8-909a-1a205eb3a99a req-3bbd80cb-5af8-4883-99bb-620a9f38d373 service nova] Lock "9d402a88-3a51-48af-8bc9-53a2040f8634-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-82416792-2865-47d8-909a-1a205eb3a99a req-3bbd80cb-5af8-4883-99bb-620a9f38d373 service nova] Lock "9d402a88-3a51-48af-8bc9-53a2040f8634-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:04 user nova-compute[72150]: DEBUG nova.compute.manager [req-82416792-2865-47d8-909a-1a205eb3a99a req-3bbd80cb-5af8-4883-99bb-620a9f38d373 service nova] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] No waiting events found dispatching network-vif-plugged-e80b9f9f-0b9c-4388-90e7-d36d277cc846 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:39:04 user nova-compute[72150]: WARNING nova.compute.manager [req-82416792-2865-47d8-909a-1a205eb3a99a req-3bbd80cb-5af8-4883-99bb-620a9f38d373 service nova] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Received unexpected event network-vif-plugged-e80b9f9f-0b9c-4388-90e7-d36d277cc846 for instance with vm_state building and task_state spawning.
Aug 01 18:39:05 user nova-compute[72150]: INFO nova.compute.manager [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Took 7.49 seconds to build instance.
Aug 01 18:39:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-780eea61-b1b0-4acb-8db8-58a11cdf5d5d tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "9d402a88-3a51-48af-8bc9-53a2040f8634" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.604s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:15 user nova-compute[72150]: DEBUG nova.compute.manager [req-3f2bdd02-757d-438c-acfb-6be9b01c088f req-5ece017c-f221-4551-953b-77dc2f7bd3bc service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received event network-changed-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:39:15 user nova-compute[72150]: DEBUG nova.compute.manager [req-3f2bdd02-757d-438c-acfb-6be9b01c088f req-5ece017c-f221-4551-953b-77dc2f7bd3bc service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Refreshing instance network info cache due to event network-changed-7f1bb810-d0cc-4f82-98c4-48abef3008b2. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:39:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3f2bdd02-757d-438c-acfb-6be9b01c088f req-5ece017c-f221-4551-953b-77dc2f7bd3bc service nova] Acquiring lock "refresh_cache-65b04144-3b1f-4975-8524-2c9f9660672a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:39:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3f2bdd02-757d-438c-acfb-6be9b01c088f req-5ece017c-f221-4551-953b-77dc2f7bd3bc service nova] Acquired lock "refresh_cache-65b04144-3b1f-4975-8524-2c9f9660672a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:39:15 user nova-compute[72150]: DEBUG nova.network.neutron [req-3f2bdd02-757d-438c-acfb-6be9b01c088f req-5ece017c-f221-4551-953b-77dc2f7bd3bc service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Refreshing network info cache for port 7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:39:16 user nova-compute[72150]: DEBUG nova.network.neutron [req-3f2bdd02-757d-438c-acfb-6be9b01c088f req-5ece017c-f221-4551-953b-77dc2f7bd3bc service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Updated VIF entry in instance network info cache for port 7f1bb810-d0cc-4f82-98c4-48abef3008b2. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:39:16 user nova-compute[72150]: DEBUG nova.network.neutron [req-3f2bdd02-757d-438c-acfb-6be9b01c088f req-5ece017c-f221-4551-953b-77dc2f7bd3bc service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Updating instance_info_cache with network_info: [{"id": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "address": "fa:16:3e:fd:8c:16", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1bb810-d0", "ovs_interfaceid": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:39:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3f2bdd02-757d-438c-acfb-6be9b01c088f req-5ece017c-f221-4551-953b-77dc2f7bd3bc service nova] Releasing lock "refresh_cache-65b04144-3b1f-4975-8524-2c9f9660672a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:39:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "65b04144-3b1f-4975-8524-2c9f9660672a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "65b04144-3b1f-4975-8524-2c9f9660672a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:16 user nova-compute[72150]: INFO nova.compute.manager [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Detaching volume d6c42960-8ac9-4b2b-8716-21565e5c0923
Aug 01 18:39:16 user nova-compute[72150]: INFO nova.virt.block_device [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Attempting to driver detach volume d6c42960-8ac9-4b2b-8716-21565e5c0923 from mountpoint /dev/vdb
Aug 01 18:39:16 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Attempting to detach device vdb from instance 65b04144-3b1f-4975-8524-2c9f9660672a from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:39:16 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:39:16 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:39:16 user nova-compute[72150]:   <source dev="/dev/sde"/>
Aug 01 18:39:16 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:39:16 user nova-compute[72150]:   <serial>d6c42960-8ac9-4b2b-8716-21565e5c0923</serial>
Aug 01 18:39:16 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:39:16 user nova-compute[72150]: </disk>
Aug 01 18:39:16 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:39:16 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Successfully detached device vdb from instance 65b04144-3b1f-4975-8524-2c9f9660672a from the persistent domain config.
Aug 01 18:39:16 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 65b04144-3b1f-4975-8524-2c9f9660672a from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:39:16 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:39:16 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:39:16 user nova-compute[72150]:   <source dev="/dev/sde"/>
Aug 01 18:39:16 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:39:16 user nova-compute[72150]:   <serial>d6c42960-8ac9-4b2b-8716-21565e5c0923</serial>
Aug 01 18:39:16 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:39:16 user nova-compute[72150]: </disk>
Aug 01 18:39:16 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:39:16 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690915156.9895792, 65b04144-3b1f-4975-8524-2c9f9660672a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:39:16 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 65b04144-3b1f-4975-8524-2c9f9660672a {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:39:16 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Successfully detached device vdb from instance 65b04144-3b1f-4975-8524-2c9f9660672a from the live domain config.
Aug 01 18:39:16 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:39:16 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZxvRiyJW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:39:17 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:39:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c75056-542e-4334-b965-ad248445bdff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[03aa91ca-613d-4e55-84af-11b3ab79509e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:39:17 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:39:17 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:39:17 user nova-compute[72150]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:39:17 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:39:17 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:39:17 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:39:17 user nova-compute[72150]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 (non-flash)
Aug 01 18:39:17 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:39:17 user nova-compute[72150]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:39:17 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:39:17 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:39:17 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec5f1d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923'): ({'sde'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Removing single pathed devices sde {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c350ee-3510-4ac1-abed-a16b06bbc522]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67bf322-114e-4f56-a06b-837d7033b7f1]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Flushing IO for device /dev/sde {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[012f0448-aadd-4960-9ca1-5226cb26c887]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9207a04-1b28-4082-82c4-78e7d548034a]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] SCSI volumes sde have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15b41e4-ee0b-4a5e-9147-cea960654513]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60c748d-fbdf-4d5a-92dc-f85d18e8a093]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923, portal: 172.16.0.220,3260]
Aug 01 18:39:17 user nova-compute[72150]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923, portal: 172.16.0.220,3260] successful.
Aug 01 18:39:17 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c42960-8ac9-4b2b-8716-21565e5c0923 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[014b5c33-be19-475a-bc64-052813a06fc2]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] <== disconnect_volume: return (315ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG nova.compute.manager [req-e89a70d0-5a6b-4d52-b9b8-a275f57dc38b req-0ab3532a-e87c-4af5-9e87-32e7f4acb96b service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received event network-changed-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG nova.compute.manager [req-e89a70d0-5a6b-4d52-b9b8-a275f57dc38b req-0ab3532a-e87c-4af5-9e87-32e7f4acb96b service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Refreshing instance network info cache due to event network-changed-7f1bb810-d0cc-4f82-98c4-48abef3008b2. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e89a70d0-5a6b-4d52-b9b8-a275f57dc38b req-0ab3532a-e87c-4af5-9e87-32e7f4acb96b service nova] Acquiring lock "refresh_cache-65b04144-3b1f-4975-8524-2c9f9660672a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e89a70d0-5a6b-4d52-b9b8-a275f57dc38b req-0ab3532a-e87c-4af5-9e87-32e7f4acb96b service nova] Acquired lock "refresh_cache-65b04144-3b1f-4975-8524-2c9f9660672a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:39:17 user nova-compute[72150]: DEBUG nova.network.neutron [req-e89a70d0-5a6b-4d52-b9b8-a275f57dc38b req-0ab3532a-e87c-4af5-9e87-32e7f4acb96b service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Refreshing network info cache for port 7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:39:18 user nova-compute[72150]: DEBUG nova.objects.instance [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'flavor' on Instance uuid 65b04144-3b1f-4975-8524-2c9f9660672a {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:39:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-5255967c-f359-4231-adc3-6533a2750714 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "65b04144-3b1f-4975-8524-2c9f9660672a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.843s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:18 user nova-compute[72150]: DEBUG nova.network.neutron [req-e89a70d0-5a6b-4d52-b9b8-a275f57dc38b req-0ab3532a-e87c-4af5-9e87-32e7f4acb96b service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Updated VIF entry in instance network info cache for port 7f1bb810-d0cc-4f82-98c4-48abef3008b2. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:39:18 user nova-compute[72150]: DEBUG nova.network.neutron [req-e89a70d0-5a6b-4d52-b9b8-a275f57dc38b req-0ab3532a-e87c-4af5-9e87-32e7f4acb96b service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Updating instance_info_cache with network_info: [{"id": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "address": "fa:16:3e:fd:8c:16", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1bb810-d0", "ovs_interfaceid": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:39:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e89a70d0-5a6b-4d52-b9b8-a275f57dc38b req-0ab3532a-e87c-4af5-9e87-32e7f4acb96b service nova] Releasing lock "refresh_cache-65b04144-3b1f-4975-8524-2c9f9660672a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:39:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "0c6f0595-d475-48c9-8726-cffcdb047b2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "0c6f0595-d475-48c9-8726-cffcdb047b2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:27 user nova-compute[72150]: DEBUG nova.compute.manager [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:39:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:27 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:39:27 user nova-compute[72150]: INFO nova.compute.claims [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Claim successful on node user
Aug 01 18:39:27 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:39:27 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:39:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:27 user nova-compute[72150]: DEBUG nova.compute.manager [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:39:27 user nova-compute[72150]: DEBUG nova.compute.manager [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:39:27 user nova-compute[72150]: DEBUG nova.network.neutron [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:39:27 user nova-compute[72150]: DEBUG nova.policy [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f11bcc2f9cc048beb928fc0d3c30403e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bad8c4e2a74caf8d35ad98e7888266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:39:27 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:39:27 user nova-compute[72150]: DEBUG nova.compute.manager [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:39:28 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Creating image(s)
Aug 01 18:39:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "/opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "/opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/disk 1073741824" returned: 0 in 0.057s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG nova.network.neutron [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Successfully created port: fc7d8e56-f828-4324-afaa-123405c9f968 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Cannot resize image /opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG nova.objects.instance [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lazy-loading 'migration_context' on Instance uuid 0c6f0595-d475-48c9-8726-cffcdb047b2d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Ensure instance console log exists: /opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:29 user nova-compute[72150]: DEBUG nova.network.neutron [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Successfully updated port: fc7d8e56-f828-4324-afaa-123405c9f968 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:39:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-6532959d-3a6b-422e-8c86-66c5d7167678 req-9f3f3937-1c89-4162-9628-c726934cdd9d service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Received event network-changed-fc7d8e56-f828-4324-afaa-123405c9f968 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:39:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-6532959d-3a6b-422e-8c86-66c5d7167678 req-9f3f3937-1c89-4162-9628-c726934cdd9d service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Refreshing instance network info cache due to event network-changed-fc7d8e56-f828-4324-afaa-123405c9f968. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:39:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6532959d-3a6b-422e-8c86-66c5d7167678 req-9f3f3937-1c89-4162-9628-c726934cdd9d service nova] Acquiring lock "refresh_cache-0c6f0595-d475-48c9-8726-cffcdb047b2d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:39:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6532959d-3a6b-422e-8c86-66c5d7167678 req-9f3f3937-1c89-4162-9628-c726934cdd9d service nova] Acquired lock "refresh_cache-0c6f0595-d475-48c9-8726-cffcdb047b2d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:39:29 user nova-compute[72150]: DEBUG nova.network.neutron [req-6532959d-3a6b-422e-8c86-66c5d7167678 req-9f3f3937-1c89-4162-9628-c726934cdd9d service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Refreshing network info cache for port fc7d8e56-f828-4324-afaa-123405c9f968 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:39:29 user nova-compute[72150]: DEBUG nova.network.neutron [req-6532959d-3a6b-422e-8c86-66c5d7167678 req-9f3f3937-1c89-4162-9628-c726934cdd9d service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:39:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "refresh_cache-0c6f0595-d475-48c9-8726-cffcdb047b2d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:39:29 user nova-compute[72150]: DEBUG nova.network.neutron [req-6532959d-3a6b-422e-8c86-66c5d7167678 req-9f3f3937-1c89-4162-9628-c726934cdd9d service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:39:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6532959d-3a6b-422e-8c86-66c5d7167678 req-9f3f3937-1c89-4162-9628-c726934cdd9d service nova] Releasing lock "refresh_cache-0c6f0595-d475-48c9-8726-cffcdb047b2d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:39:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquired lock "refresh_cache-0c6f0595-d475-48c9-8726-cffcdb047b2d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:39:29 user nova-compute[72150]: DEBUG nova.network.neutron [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:39:29 user nova-compute[72150]: DEBUG nova.network.neutron [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:39:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0982b87d-c9fe-417c-a258-b39e41b558f3 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0982b87d-c9fe-417c-a258-b39e41b558f3 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-0982b87d-c9fe-417c-a258-b39e41b558f3 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Going to confirm migration 2 {{(pid=72150) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 01 18:39:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0982b87d-c9fe-417c-a258-b39e41b558f3 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "refresh_cache-54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:39:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0982b87d-c9fe-417c-a258-b39e41b558f3 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquired lock "refresh_cache-54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:39:29 user nova-compute[72150]: DEBUG nova.network.neutron [None req-0982b87d-c9fe-417c-a258-b39e41b558f3 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:39:29 user nova-compute[72150]: DEBUG nova.objects.instance [None req-0982b87d-c9fe-417c-a258-b39e41b558f3 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lazy-loading 'info_cache' on Instance uuid 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.network.neutron [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Updating instance_info_cache with network_info: [{"id": "fc7d8e56-f828-4324-afaa-123405c9f968", "address": "fa:16:3e:76:17:26", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc7d8e56-f8", "ovs_interfaceid": "fc7d8e56-f828-4324-afaa-123405c9f968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Releasing lock "refresh_cache-0c6f0595-d475-48c9-8726-cffcdb047b2d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.compute.manager [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Instance network_info: |[{"id": "fc7d8e56-f828-4324-afaa-123405c9f968", "address": "fa:16:3e:76:17:26", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc7d8e56-f8", "ovs_interfaceid": "fc7d8e56-f828-4324-afaa-123405c9f968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Start _get_guest_xml network_info=[{"id": "fc7d8e56-f828-4324-afaa-123405c9f968", "address": "fa:16:3e:76:17:26", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc7d8e56-f8", "ovs_interfaceid": "fc7d8e56-f828-4324-afaa-123405c9f968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:39:30 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:39:30 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:39:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-527022266',display_name='tempest-AttachVolumeNegativeTest-server-527022266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-527022266',id=39,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQP0a4apKyrs1Lou0TfJauuMwG/EkLMFOHmyGtjK5JE0aFi8mG/FLtlfmo+LvuRohARnJ1vUkGIe+HveA89vytiEyj51LUXeCsz66gdRo6tF275p5RenrW+98hsrGWcCQ==',key_name='tempest-keypair-1845805441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66bad8c4e2a74caf8d35ad98e7888266',ramdisk_id='',reservation_id='r-zdoi45y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-504132593',owner_user_name='tempest-AttachVolumeNegativeTest-504132593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:39:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f11bcc2f9cc048beb928fc0d3c30403e',uuid=0c6f0595-d475-48c9-8726-cffcdb047b2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc7d8e56-f828-4324-afaa-123405c9f968", "address": "fa:16:3e:76:17:26", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc7d8e56-f8", "ovs_interfaceid": "fc7d8e56-f828-4324-afaa-123405c9f968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converting VIF {"id": "fc7d8e56-f828-4324-afaa-123405c9f968", "address": "fa:16:3e:76:17:26", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc7d8e56-f8", "ovs_interfaceid": "fc7d8e56-f828-4324-afaa-123405c9f968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:17:26,bridge_name='br-int',has_traffic_filtering=True,id=fc7d8e56-f828-4324-afaa-123405c9f968,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc7d8e56-f8') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.objects.instance [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c6f0595-d475-48c9-8726-cffcdb047b2d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:39:30 user nova-compute[72150]:   <uuid>0c6f0595-d475-48c9-8726-cffcdb047b2d</uuid>
Aug 01 18:39:30 user nova-compute[72150]:   <name>instance-00000027</name>
Aug 01 18:39:30 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:39:30 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:39:30 user nova-compute[72150]:   <metadata>
Aug 01 18:39:30 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:39:30 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:39:30 user nova-compute[72150]:       <nova:name>tempest-AttachVolumeNegativeTest-server-527022266</nova:name>
Aug 01 18:39:30 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:39:30</nova:creationTime>
Aug 01 18:39:30 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:39:30 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:39:30 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:39:30 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:39:30 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:39:30 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:39:30 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:39:30 user nova-compute[72150]:       <nova:owner>
Aug 01 18:39:30 user nova-compute[72150]:         <nova:user uuid="f11bcc2f9cc048beb928fc0d3c30403e">tempest-AttachVolumeNegativeTest-504132593-project-member</nova:user>
Aug 01 18:39:30 user nova-compute[72150]:         <nova:project uuid="66bad8c4e2a74caf8d35ad98e7888266">tempest-AttachVolumeNegativeTest-504132593</nova:project>
Aug 01 18:39:30 user nova-compute[72150]:       </nova:owner>
Aug 01 18:39:30 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:39:30 user nova-compute[72150]:       <nova:ports>
Aug 01 18:39:30 user nova-compute[72150]:         <nova:port uuid="fc7d8e56-f828-4324-afaa-123405c9f968">
Aug 01 18:39:30 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 18:39:30 user nova-compute[72150]:         </nova:port>
Aug 01 18:39:30 user nova-compute[72150]:       </nova:ports>
Aug 01 18:39:30 user nova-compute[72150]:     </nova:instance>
Aug 01 18:39:30 user nova-compute[72150]:   </metadata>
Aug 01 18:39:30 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:39:30 user nova-compute[72150]:     <system>
Aug 01 18:39:30 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:39:30 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:39:30 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:39:30 user nova-compute[72150]:       <entry name="serial">0c6f0595-d475-48c9-8726-cffcdb047b2d</entry>
Aug 01 18:39:30 user nova-compute[72150]:       <entry name="uuid">0c6f0595-d475-48c9-8726-cffcdb047b2d</entry>
Aug 01 18:39:30 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:39:30 user nova-compute[72150]:     </system>
Aug 01 18:39:30 user nova-compute[72150]:   </sysinfo>
Aug 01 18:39:30 user nova-compute[72150]:   <os>
Aug 01 18:39:30 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:39:30 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:39:30 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:39:30 user nova-compute[72150]:   </os>
Aug 01 18:39:30 user nova-compute[72150]:   <features>
Aug 01 18:39:30 user nova-compute[72150]:     <acpi/>
Aug 01 18:39:30 user nova-compute[72150]:     <apic/>
Aug 01 18:39:30 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:39:30 user nova-compute[72150]:   </features>
Aug 01 18:39:30 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:39:30 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:39:30 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:39:30 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:39:30 user nova-compute[72150]:   </clock>
Aug 01 18:39:30 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:39:30 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:39:30 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:39:30 user nova-compute[72150]:   </cpu>
Aug 01 18:39:30 user nova-compute[72150]:   <devices>
Aug 01 18:39:30 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:39:30 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:39:30 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/disk"/>
Aug 01 18:39:30 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:39:30 user nova-compute[72150]:     </disk>
Aug 01 18:39:30 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:39:30 user nova-compute[72150]:       <mac address="fa:16:3e:76:17:26"/>
Aug 01 18:39:30 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:39:30 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:39:30 user nova-compute[72150]:       <target dev="tapfc7d8e56-f8"/>
Aug 01 18:39:30 user nova-compute[72150]:     </interface>
Aug 01 18:39:30 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:39:30 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/console.log" append="off"/>
Aug 01 18:39:30 user nova-compute[72150]:     </serial>
Aug 01 18:39:30 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:39:30 user nova-compute[72150]:     <video>
Aug 01 18:39:30 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:39:30 user nova-compute[72150]:     </video>
Aug 01 18:39:30 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:39:30 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:39:30 user nova-compute[72150]:     </rng>
Aug 01 18:39:30 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:39:30 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:39:30 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:39:30 user nova-compute[72150]:     </memballoon>
Aug 01 18:39:30 user nova-compute[72150]:   </devices>
Aug 01 18:39:30 user nova-compute[72150]: </domain>
Aug 01 18:39:30 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:39:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-527022266',display_name='tempest-AttachVolumeNegativeTest-server-527022266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-527022266',id=39,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQP0a4apKyrs1Lou0TfJauuMwG/EkLMFOHmyGtjK5JE0aFi8mG/FLtlfmo+LvuRohARnJ1vUkGIe+HveA89vytiEyj51LUXeCsz66gdRo6tF275p5RenrW+98hsrGWcCQ==',key_name='tempest-keypair-1845805441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66bad8c4e2a74caf8d35ad98e7888266',ramdisk_id='',reservation_id='r-zdoi45y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-504132593',owner_user_name='tempest-AttachVolumeNegativeTest-504132593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:39:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f11bcc2f9cc048beb928fc0d3c30403e',uuid=0c6f0595-d475-48c9-8726-cffcdb047b2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc7d8e56-f828-4324-afaa-123405c9f968", "address": "fa:16:3e:76:17:26", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc7d8e56-f8", "ovs_interfaceid": "fc7d8e56-f828-4324-afaa-123405c9f968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converting VIF {"id": "fc7d8e56-f828-4324-afaa-123405c9f968", "address": "fa:16:3e:76:17:26", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc7d8e56-f8", "ovs_interfaceid": "fc7d8e56-f828-4324-afaa-123405c9f968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:17:26,bridge_name='br-int',has_traffic_filtering=True,id=fc7d8e56-f828-4324-afaa-123405c9f968,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc7d8e56-f8') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG os_vif [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:17:26,bridge_name='br-int',has_traffic_filtering=True,id=fc7d8e56-f828-4324-afaa-123405c9f968,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc7d8e56-f8') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc7d8e56-f8, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc7d8e56-f8, col_values=(('external_ids', {'iface-id': 'fc7d8e56-f828-4324-afaa-123405c9f968', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:17:26', 'vm-uuid': '0c6f0595-d475-48c9-8726-cffcdb047b2d'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:30 user nova-compute[72150]: INFO os_vif [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:17:26,bridge_name='br-int',has_traffic_filtering=True,id=fc7d8e56-f828-4324-afaa-123405c9f968,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc7d8e56-f8')
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:39:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] No VIF found with MAC fa:16:3e:76:17:26, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:39:31 user nova-compute[72150]: DEBUG nova.network.neutron [None req-0982b87d-c9fe-417c-a258-b39e41b558f3 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Updating instance_info_cache with network_info: [{"id": "8839e09b-66e1-4465-88d2-19f19dc1b010", "address": "fa:16:3e:69:a8:32", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8839e09b-66", "ovs_interfaceid": "8839e09b-66e1-4465-88d2-19f19dc1b010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:39:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0982b87d-c9fe-417c-a258-b39e41b558f3 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Releasing lock "refresh_cache-54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:39:31 user nova-compute[72150]: DEBUG nova.objects.instance [None req-0982b87d-c9fe-417c-a258-b39e41b558f3 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lazy-loading 'migration_context' on Instance uuid 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:39:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0982b87d-c9fe-417c-a258-b39e41b558f3 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0982b87d-c9fe-417c-a258-b39e41b558f3 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:31 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-0982b87d-c9fe-417c-a258-b39e41b558f3 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:39:31 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-0982b87d-c9fe-417c-a258-b39e41b558f3 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:39:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0982b87d-c9fe-417c-a258-b39e41b558f3 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.510s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:31 user nova-compute[72150]: DEBUG nova.compute.manager [req-e039024c-be12-4131-9019-0909211051fb req-cad6570d-074a-4f2b-8eba-7c5cb8fd424a service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Received event network-vif-plugged-fc7d8e56-f828-4324-afaa-123405c9f968 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:39:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e039024c-be12-4131-9019-0909211051fb req-cad6570d-074a-4f2b-8eba-7c5cb8fd424a service nova] Acquiring lock "0c6f0595-d475-48c9-8726-cffcdb047b2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e039024c-be12-4131-9019-0909211051fb req-cad6570d-074a-4f2b-8eba-7c5cb8fd424a service nova] Lock "0c6f0595-d475-48c9-8726-cffcdb047b2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e039024c-be12-4131-9019-0909211051fb req-cad6570d-074a-4f2b-8eba-7c5cb8fd424a service nova] Lock "0c6f0595-d475-48c9-8726-cffcdb047b2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:31 user nova-compute[72150]: DEBUG nova.compute.manager [req-e039024c-be12-4131-9019-0909211051fb req-cad6570d-074a-4f2b-8eba-7c5cb8fd424a service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] No waiting events found dispatching network-vif-plugged-fc7d8e56-f828-4324-afaa-123405c9f968 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:39:31 user nova-compute[72150]: WARNING nova.compute.manager [req-e039024c-be12-4131-9019-0909211051fb req-cad6570d-074a-4f2b-8eba-7c5cb8fd424a service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Received unexpected event network-vif-plugged-fc7d8e56-f828-4324-afaa-123405c9f968 for instance with vm_state building and task_state spawning.
Aug 01 18:39:31 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-0982b87d-c9fe-417c-a258-b39e41b558f3 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Deleted allocation for migration 3de744ad-9181-4023-8bdc-93e18fae964d
Aug 01 18:39:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0982b87d-c9fe-417c-a258-b39e41b558f3 tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.132s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:33 user nova-compute[72150]: DEBUG nova.compute.manager [req-13a8739c-54dc-4363-844a-c1de90f11d17 req-64a26913-c504-429d-8194-8f5f59f30ecd service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Received event network-vif-plugged-fc7d8e56-f828-4324-afaa-123405c9f968 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:39:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-13a8739c-54dc-4363-844a-c1de90f11d17 req-64a26913-c504-429d-8194-8f5f59f30ecd service nova] Acquiring lock "0c6f0595-d475-48c9-8726-cffcdb047b2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-13a8739c-54dc-4363-844a-c1de90f11d17 req-64a26913-c504-429d-8194-8f5f59f30ecd service nova] Lock "0c6f0595-d475-48c9-8726-cffcdb047b2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-13a8739c-54dc-4363-844a-c1de90f11d17 req-64a26913-c504-429d-8194-8f5f59f30ecd service nova] Lock "0c6f0595-d475-48c9-8726-cffcdb047b2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:33 user nova-compute[72150]: DEBUG nova.compute.manager [req-13a8739c-54dc-4363-844a-c1de90f11d17 req-64a26913-c504-429d-8194-8f5f59f30ecd service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] No waiting events found dispatching network-vif-plugged-fc7d8e56-f828-4324-afaa-123405c9f968 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:39:33 user nova-compute[72150]: WARNING nova.compute.manager [req-13a8739c-54dc-4363-844a-c1de90f11d17 req-64a26913-c504-429d-8194-8f5f59f30ecd service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Received unexpected event network-vif-plugged-fc7d8e56-f828-4324-afaa-123405c9f968 for instance with vm_state building and task_state spawning.
Aug 01 18:39:33 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915173.8710504, 0c6f0595-d475-48c9-8726-cffcdb047b2d => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:39:33 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] VM Resumed (Lifecycle Event)
Aug 01 18:39:33 user nova-compute[72150]: DEBUG nova.compute.manager [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:39:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:39:33 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Instance spawned successfully.
Aug 01 18:39:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:39:33 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:39:33 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:39:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:39:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:39:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:39:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:39:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:39:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:39:33 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:39:33 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915173.8745508, 0c6f0595-d475-48c9-8726-cffcdb047b2d => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:39:33 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] VM Started (Lifecycle Event)
Aug 01 18:39:33 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:39:33 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:39:33 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:39:33 user nova-compute[72150]: INFO nova.compute.manager [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Took 5.92 seconds to spawn the instance on the hypervisor.
Aug 01 18:39:33 user nova-compute[72150]: DEBUG nova.compute.manager [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:39:34 user nova-compute[72150]: INFO nova.compute.manager [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Took 6.92 seconds to build instance.
Aug 01 18:39:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af2daa2c-3bf8-42a8-8e04-8d23cc1f670c tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "0c6f0595-d475-48c9-8726-cffcdb047b2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.030s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:35 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:39:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:39 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:39:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:41 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:39:42 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:39:42 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:39:43 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:39:43 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:39:44 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:39:44 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:39:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-ea68420b-8362-4df3-b710-cd1cf76adba0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:39:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-ea68420b-8362-4df3-b710-cd1cf76adba0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:39:44 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:39:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:39:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:39:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:39:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:39:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:45 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Updating instance_info_cache with network_info: [{"id": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "address": "fa:16:3e:a6:bd:40", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a63bb1a-08", "ovs_interfaceid": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:39:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-ea68420b-8362-4df3-b710-cd1cf76adba0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:39:45 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:39:45 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:39:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:45 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:39:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:39:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:39:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:39:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:39:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d402a88-3a51-48af-8bc9-53a2040f8634/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d402a88-3a51-48af-8bc9-53a2040f8634/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d402a88-3a51-48af-8bc9-53a2040f8634/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d402a88-3a51-48af-8bc9-53a2040f8634/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:39:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:49 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:39:49 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:39:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=6916MB free_disk=25.243553161621094GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG nova.compute.manager [req-54df06c3-9865-4642-a06a-8cd9be723f0a req-427cb3f7-7fa0-4565-bd3a-512f591a2ced service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Received event network-changed-b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG nova.compute.manager [req-54df06c3-9865-4642-a06a-8cd9be723f0a req-427cb3f7-7fa0-4565-bd3a-512f591a2ced service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Refreshing instance network info cache due to event network-changed-b9e510dc-94be-4362-b3a8-4d68f1f769f3. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-54df06c3-9865-4642-a06a-8cd9be723f0a req-427cb3f7-7fa0-4565-bd3a-512f591a2ced service nova] Acquiring lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-54df06c3-9865-4642-a06a-8cd9be723f0a req-427cb3f7-7fa0-4565-bd3a-512f591a2ced service nova] Acquired lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG nova.network.neutron [req-54df06c3-9865-4642-a06a-8cd9be723f0a req-427cb3f7-7fa0-4565-bd3a-512f591a2ced service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Refreshing network info cache for port b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 769690c8-53c5-4057-88a5-fbdbcb930e32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ea68420b-8362-4df3-b710-cd1cf76adba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 08851ec4-6f71-4ec1-a092-42aab83ee87f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance bf2d1f14-2227-41d1-bd73-a05ab3149aba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 42e75a98-beb1-4688-a375-affc63b14252 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 65b04144-3b1f-4975-8524-2c9f9660672a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance d2117837-5552-4ec3-9f9b-62629c1ff4cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 737a8853-f9b9-4a0b-95a1-200d72c4d806 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 07213597-fa7a-4422-956a-1b02737cc647 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 316953c9-42a9-4598-9385-0c138415ea6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 9d402a88-3a51-48af-8bc9-53a2040f8634 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 0c6f0595-d475-48c9-8726-cffcdb047b2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:39:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:39:50 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:39:50 user nova-compute[72150]: DEBUG nova.network.neutron [req-54df06c3-9865-4642-a06a-8cd9be723f0a req-427cb3f7-7fa0-4565-bd3a-512f591a2ced service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Updated VIF entry in instance network info cache for port b9e510dc-94be-4362-b3a8-4d68f1f769f3. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:39:50 user nova-compute[72150]: DEBUG nova.network.neutron [req-54df06c3-9865-4642-a06a-8cd9be723f0a req-427cb3f7-7fa0-4565-bd3a-512f591a2ced service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Updating instance_info_cache with network_info: [{"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e510dc-94", "ovs_interfaceid": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:39:50 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:39:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquiring lock "07213597-fa7a-4422-956a-1b02737cc647" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "07213597-fa7a-4422-956a-1b02737cc647" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:50 user nova-compute[72150]: INFO nova.compute.manager [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Shelve offloading
Aug 01 18:39:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-54df06c3-9865-4642-a06a-8cd9be723f0a req-427cb3f7-7fa0-4565-bd3a-512f591a2ced service nova] Releasing lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:39:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:39:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.573s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-713067d9-047d-4f4c-9e4e-ece2384e0bbd req-e52704a8-ad8f-4025-b1f5-84809afc028a service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Received event network-vif-unplugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:39:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-713067d9-047d-4f4c-9e4e-ece2384e0bbd req-e52704a8-ad8f-4025-b1f5-84809afc028a service nova] Acquiring lock "07213597-fa7a-4422-956a-1b02737cc647-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-713067d9-047d-4f4c-9e4e-ece2384e0bbd req-e52704a8-ad8f-4025-b1f5-84809afc028a service nova] Lock "07213597-fa7a-4422-956a-1b02737cc647-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-713067d9-047d-4f4c-9e4e-ece2384e0bbd req-e52704a8-ad8f-4025-b1f5-84809afc028a service nova] Lock "07213597-fa7a-4422-956a-1b02737cc647-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-713067d9-047d-4f4c-9e4e-ece2384e0bbd req-e52704a8-ad8f-4025-b1f5-84809afc028a service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] No waiting events found dispatching network-vif-unplugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:39:50 user nova-compute[72150]: WARNING nova.compute.manager [req-713067d9-047d-4f4c-9e4e-ece2384e0bbd req-e52704a8-ad8f-4025-b1f5-84809afc028a service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Received unexpected event network-vif-unplugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 for instance with vm_state active and task_state shelving.
Aug 01 18:39:50 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Instance destroyed successfully.
Aug 01 18:39:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:39:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquiring lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:39:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquired lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:39:50 user nova-compute[72150]: DEBUG nova.network.neutron [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:39:51 user nova-compute[72150]: INFO nova.compute.manager [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Rescuing
Aug 01 18:39:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "refresh_cache-316953c9-42a9-4598-9385-0c138415ea6f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:39:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquired lock "refresh_cache-316953c9-42a9-4598-9385-0c138415ea6f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:39:51 user nova-compute[72150]: DEBUG nova.network.neutron [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:39:51 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:39:51 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:39:51 user nova-compute[72150]: DEBUG nova.network.neutron [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Updating instance_info_cache with network_info: [{"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e510dc-94", "ovs_interfaceid": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:39:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Releasing lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:39:51 user nova-compute[72150]: DEBUG nova.network.neutron [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Updating instance_info_cache with network_info: [{"id": "ed51a469-3095-4679-b038-c18153c8f95e", "address": "fa:16:3e:13:9f:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped51a469-30", "ovs_interfaceid": "ed51a469-3095-4679-b038-c18153c8f95e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:39:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Releasing lock "refresh_cache-316953c9-42a9-4598-9385-0c138415ea6f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:52 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Instance destroyed successfully.
Aug 01 18:39:52 user nova-compute[72150]: DEBUG nova.objects.instance [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lazy-loading 'resources' on Instance uuid 07213597-fa7a-4422-956a-1b02737cc647 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-691830454',display_name='tempest-TestShelveInstance-server-691830454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-691830454',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyoTrCOpTYRiMQpfxAHrmgEh2IuXfKFd05eInP4gONn7Z6yLSlklJvNu/KixD0APbHlXD8tsKWypMmSvEXNQ7HC+5Bl+96BWCjszExqbYWAuUU70+cSHaxQ4fZmIre9ag==',key_name='tempest-TestShelveInstance-873495065',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:38:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96ebdfa1a1d744989c2ae19afba252a2',ramdisk_id='',reservation_id='r-0wlnrl2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-359406348',owner_user_name='tempest-TestShelveInstance-359406348-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:38:13Z,user_data=None,user_id='3e19b7bbe9bf473f8ce8d121dcaf5e35',uuid=07213597-fa7a-4422-956a-1b02737cc647,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e510dc-94", "ovs_interfaceid": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Converting VIF {"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e510dc-94", "ovs_interfaceid": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:2f:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9e510dc-94be-4362-b3a8-4d68f1f769f3,network=Network(ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e510dc-94') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG os_vif [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:2f:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9e510dc-94be-4362-b3a8-4d68f1f769f3,network=Network(ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e510dc-94') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9e510dc-94, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG nova.compute.manager [req-3c2fccb6-8754-49e1-a213-8621d09735d9 req-cb80361b-23b6-4b50-aec9-b9a5575aa868 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Received event network-changed-b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG nova.compute.manager [req-3c2fccb6-8754-49e1-a213-8621d09735d9 req-cb80361b-23b6-4b50-aec9-b9a5575aa868 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Refreshing instance network info cache due to event network-changed-b9e510dc-94be-4362-b3a8-4d68f1f769f3. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3c2fccb6-8754-49e1-a213-8621d09735d9 req-cb80361b-23b6-4b50-aec9-b9a5575aa868 service nova] Acquiring lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3c2fccb6-8754-49e1-a213-8621d09735d9 req-cb80361b-23b6-4b50-aec9-b9a5575aa868 service nova] Acquired lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG nova.network.neutron [req-3c2fccb6-8754-49e1-a213-8621d09735d9 req-cb80361b-23b6-4b50-aec9-b9a5575aa868 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Refreshing network info cache for port b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:52 user nova-compute[72150]: INFO os_vif [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:2f:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9e510dc-94be-4362-b3a8-4d68f1f769f3,network=Network(ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e510dc-94')
Aug 01 18:39:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdAEYcHK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:39:52 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:39:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[deada720-0913-4b57-ae9b-47ac26e3ee4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d7f3a1-dfd2-43cf-8080-6e993a352ac1]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:39:52 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:39:52 user nova-compute[72150]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:39:52 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:39:52 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:39:52 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:39:52 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:39:52 user nova-compute[72150]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:39:52 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:39:52 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:39:52 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c48fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77'): ({'sdd'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Removing single pathed devices sdd {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d83731e-73ac-4327-b5b5-bf2ba4145e4a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f81fb6-c546-467b-8270-9db6dec20cdd]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Flushing IO for device /dev/sdd {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff88289-f04d-4647-9cb0-a01c6068b940]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG nova.compute.manager [req-54fe43df-4cab-47e9-b110-f07d38c46d95 req-4b9b8683-2192-4d16-86e8-6781f428c345 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Received event network-vif-plugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-54fe43df-4cab-47e9-b110-f07d38c46d95 req-4b9b8683-2192-4d16-86e8-6781f428c345 service nova] Acquiring lock "07213597-fa7a-4422-956a-1b02737cc647-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-54fe43df-4cab-47e9-b110-f07d38c46d95 req-4b9b8683-2192-4d16-86e8-6781f428c345 service nova] Lock "07213597-fa7a-4422-956a-1b02737cc647-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-54fe43df-4cab-47e9-b110-f07d38c46d95 req-4b9b8683-2192-4d16-86e8-6781f428c345 service nova] Lock "07213597-fa7a-4422-956a-1b02737cc647-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG nova.compute.manager [req-54fe43df-4cab-47e9-b110-f07d38c46d95 req-4b9b8683-2192-4d16-86e8-6781f428c345 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] No waiting events found dispatching network-vif-plugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:39:52 user nova-compute[72150]: WARNING nova.compute.manager [req-54fe43df-4cab-47e9-b110-f07d38c46d95 req-4b9b8683-2192-4d16-86e8-6781f428c345 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Received unexpected event network-vif-plugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 for instance with vm_state active and task_state shelving.
Aug 01 18:39:52 user nova-compute[72150]: DEBUG nova.compute.manager [req-54fe43df-4cab-47e9-b110-f07d38c46d95 req-4b9b8683-2192-4d16-86e8-6781f428c345 service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received event network-vif-unplugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-54fe43df-4cab-47e9-b110-f07d38c46d95 req-4b9b8683-2192-4d16-86e8-6781f428c345 service nova] Acquiring lock "316953c9-42a9-4598-9385-0c138415ea6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-54fe43df-4cab-47e9-b110-f07d38c46d95 req-4b9b8683-2192-4d16-86e8-6781f428c345 service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-54fe43df-4cab-47e9-b110-f07d38c46d95 req-4b9b8683-2192-4d16-86e8-6781f428c345 service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG nova.compute.manager [req-54fe43df-4cab-47e9-b110-f07d38c46d95 req-4b9b8683-2192-4d16-86e8-6781f428c345 service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] No waiting events found dispatching network-vif-unplugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:39:52 user nova-compute[72150]: WARNING nova.compute.manager [req-54fe43df-4cab-47e9-b110-f07d38c46d95 req-4b9b8683-2192-4d16-86e8-6781f428c345 service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received unexpected event network-vif-unplugged-ed51a469-3095-4679-b038-c18153c8f95e for instance with vm_state active and task_state rescuing.
Aug 01 18:39:52 user nova-compute[72150]: DEBUG nova.compute.manager [req-54fe43df-4cab-47e9-b110-f07d38c46d95 req-4b9b8683-2192-4d16-86e8-6781f428c345 service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-54fe43df-4cab-47e9-b110-f07d38c46d95 req-4b9b8683-2192-4d16-86e8-6781f428c345 service nova] Acquiring lock "316953c9-42a9-4598-9385-0c138415ea6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-54fe43df-4cab-47e9-b110-f07d38c46d95 req-4b9b8683-2192-4d16-86e8-6781f428c345 service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-54fe43df-4cab-47e9-b110-f07d38c46d95 req-4b9b8683-2192-4d16-86e8-6781f428c345 service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG nova.compute.manager [req-54fe43df-4cab-47e9-b110-f07d38c46d95 req-4b9b8683-2192-4d16-86e8-6781f428c345 service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] No waiting events found dispatching network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:39:52 user nova-compute[72150]: WARNING nova.compute.manager [req-54fe43df-4cab-47e9-b110-f07d38c46d95 req-4b9b8683-2192-4d16-86e8-6781f428c345 service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received unexpected event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e for instance with vm_state active and task_state rescuing.
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[430e3d86-df23-475f-a74e-2d59d7ada59f]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] SCSI volumes sdd have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c22909-bda5-4682-93e8-ce8df91cbd14]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1246548-9c46-4a4d-9a2f-e68263c759e2]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77, portal: 172.16.0.220,3260]
Aug 01 18:39:52 user nova-compute[72150]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77, portal: 172.16.0.220,3260] successful.
Aug 01 18:39:52 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[596de6d6-6f2e-46e5-ab9e-64c14a2f8393]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] <== disconnect_volume: return (321ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:39:52 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Deleting instance files /opt/stack/data/nova/instances/07213597-fa7a-4422-956a-1b02737cc647_del
Aug 01 18:39:52 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Deletion of /opt/stack/data/nova/instances/07213597-fa7a-4422-956a-1b02737cc647_del complete
Aug 01 18:39:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:52 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Instance destroyed successfully.
Aug 01 18:39:52 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Attempting a stable device rescue
Aug 01 18:39:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72150) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Instance directory exists: not creating {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 18:39:52 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Creating image(s)
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "/opt/stack/data/nova/instances/316953c9-42a9-4598-9385-0c138415ea6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "/opt/stack/data/nova/instances/316953c9-42a9-4598-9385-0c138415ea6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "/opt/stack/data/nova/instances/316953c9-42a9-4598-9385-0c138415ea6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG nova.objects.instance [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'trusted_certs' on Instance uuid 316953c9-42a9-4598-9385-0c138415ea6f {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "0d606c56db554d538ad71883838d9113680faeff" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "0d606c56db554d538ad71883838d9113680faeff" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG nova.network.neutron [req-3c2fccb6-8754-49e1-a213-8621d09735d9 req-cb80361b-23b6-4b50-aec9-b9a5575aa868 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Updated VIF entry in instance network info cache for port b9e510dc-94be-4362-b3a8-4d68f1f769f3. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG nova.network.neutron [req-3c2fccb6-8754-49e1-a213-8621d09735d9 req-cb80361b-23b6-4b50-aec9-b9a5575aa868 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Updating instance_info_cache with network_info: [{"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": null, "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb9e510dc-94", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:39:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3c2fccb6-8754-49e1-a213-8621d09735d9 req-cb80361b-23b6-4b50-aec9-b9a5575aa868 service nova] Releasing lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:39:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d606c56db554d538ad71883838d9113680faeff.part --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d606c56db554d538ad71883838d9113680faeff.part --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:53 user nova-compute[72150]: DEBUG nova.virt.images [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] 61328e5e-9bb9-451c-b8d6-8c834a45d744 was qcow2, converting to raw {{(pid=72150) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 18:39:53 user nova-compute[72150]: DEBUG nova.privsep.utils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72150) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 18:39:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d606c56db554d538ad71883838d9113680faeff.part /opt/stack/data/nova/instances/_base/0d606c56db554d538ad71883838d9113680faeff.converted {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:54 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Deleted allocations for instance 07213597-fa7a-4422-956a-1b02737cc647
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.objects.instance [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lazy-loading 'numa_topology' on Instance uuid 07213597-fa7a-4422-956a-1b02737cc647 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d606c56db554d538ad71883838d9113680faeff.part /opt/stack/data/nova/instances/_base/0d606c56db554d538ad71883838d9113680faeff.converted" returned: 0 in 0.349s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d606c56db554d538ad71883838d9113680faeff.converted --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d606c56db554d538ad71883838d9113680faeff.converted --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "0d606c56db554d538ad71883838d9113680faeff" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.676s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "0d606c56db554d538ad71883838d9113680faeff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "0d606c56db554d538ad71883838d9113680faeff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d606c56db554d538ad71883838d9113680faeff --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.compute.manager [req-b94e3ddb-bcfb-4c8e-8186-8164d5afc85c req-f6759d93-ce3b-4715-b307-cfe6c172df6b service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Received event network-changed-c4fe7e1b-47aa-495a-9f09-2780827d1f41 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.compute.manager [req-b94e3ddb-bcfb-4c8e-8186-8164d5afc85c req-f6759d93-ce3b-4715-b307-cfe6c172df6b service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Refreshing instance network info cache due to event network-changed-c4fe7e1b-47aa-495a-9f09-2780827d1f41. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b94e3ddb-bcfb-4c8e-8186-8164d5afc85c req-f6759d93-ce3b-4715-b307-cfe6c172df6b service nova] Acquiring lock "refresh_cache-5dbd0cf2-7aa9-452a-9322-a58c23d7cc52" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b94e3ddb-bcfb-4c8e-8186-8164d5afc85c req-f6759d93-ce3b-4715-b307-cfe6c172df6b service nova] Acquired lock "refresh_cache-5dbd0cf2-7aa9-452a-9322-a58c23d7cc52" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.network.neutron [req-b94e3ddb-bcfb-4c8e-8186-8164d5afc85c req-f6759d93-ce3b-4715-b307-cfe6c172df6b service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Refreshing network info cache for port c4fe7e1b-47aa-495a-9f09-2780827d1f41 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d606c56db554d538ad71883838d9113680faeff --force-share --output=json" returned: 0 in 0.153s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d606c56db554d538ad71883838d9113680faeff,backing_fmt=raw /opt/stack/data/nova/instances/316953c9-42a9-4598-9385-0c138415ea6f/disk.rescue {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.560s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d606c56db554d538ad71883838d9113680faeff,backing_fmt=raw /opt/stack/data/nova/instances/316953c9-42a9-4598-9385-0c138415ea6f/disk.rescue" returned: 0 in 0.058s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "0d606c56db554d538ad71883838d9113680faeff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.objects.instance [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'migration_context' on Instance uuid 316953c9-42a9-4598-9385-0c138415ea6f {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Start _get_guest_xml network_info=[{"id": "ed51a469-3095-4679-b038-c18153c8f95e", "address": "fa:16:3e:13:9f:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "vif_mac": "fa:16:3e:13:9f:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped51a469-30", "ovs_interfaceid": "ed51a469-3095-4679-b038-c18153c8f95e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '61328e5e-9bb9-451c-b8d6-8c834a45d744', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd697df91-a93a-4b65-be6e-52bfda49a963', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oOkAyqjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '316953c9-42a9-4598-9385-0c138415ea6f', 'attached_at': '', 'detached_at': '', 'volume_id': '39b8b189-c5f4-4c2a-a973-ee3f807ea688', 'serial': '39b8b189-c5f4-4c2a-a973-ee3f807ea688'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.objects.instance [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'resources' on Instance uuid 316953c9-42a9-4598-9385-0c138415ea6f {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.objects.instance [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'numa_topology' on Instance uuid 316953c9-42a9-4598-9385-0c138415ea6f {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:39:54 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:39:54 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-74dd01af-0901-4c8a-a89b-3183f61f559a tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "07213597-fa7a-4422-956a-1b02737cc647" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.644s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.objects.instance [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'vcpu_model' on Instance uuid 316953c9-42a9-4598-9385-0c138415ea6f {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oOkAyqjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:39:54 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:39:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:39:54 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:39:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:39:54 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[889d43ef-770b-4e1e-9467-10a8d6a33729]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = oOkAyqjD\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 18:39:54 user nova-compute[72150]: node.name = iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688
Aug 01 18:39:54 user nova-compute[72150]: node.tpgt = -1
Aug 01 18:39:54 user nova-compute[72150]: node.startup = automatic
Aug 01 18:39:54 user nova-compute[72150]: node.leading_login = No
Aug 01 18:39:54 user nova-compute[72150]: iface.iscsi_ifacename = default
Aug 01 18:39:54 user nova-compute[72150]: iface.net_ifacename = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.ipaddress = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.prefix_len = 0
Aug 01 18:39:54 user nova-compute[72150]: iface.hwaddress = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.transport_name = tcp
Aug 01 18:39:54 user nova-compute[72150]: iface.initiatorname = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.state = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.vlan_id = 0
Aug 01 18:39:54 user nova-compute[72150]: iface.vlan_priority = 0
Aug 01 18:39:54 user nova-compute[72150]: iface.vlan_state = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.iface_num = 0
Aug 01 18:39:54 user nova-compute[72150]: iface.mtu = 0
Aug 01 18:39:54 user nova-compute[72150]: iface.port = 0
Aug 01 18:39:54 user nova-compute[72150]: iface.bootproto = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.subnet_mask = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.gateway = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.dhcp_alt_client_id = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.dhcp_dns = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.dhcp_learn_iqn = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.dhcp_vendor_id_state = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.dhcp_vendor_id = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.dhcp_slp_da = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.fragmentation = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.gratuitous_arp = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.incoming_forwarding = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.tos_state = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.tos = 0
Aug 01 18:39:54 user nova-compute[72150]: iface.ttl = 0
Aug 01 18:39:54 user nova-compute[72150]: iface.delayed_ack = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.tcp_nagle = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.tcp_wsf_state = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.tcp_wsf = 0
Aug 01 18:39:54 user nova-compute[72150]: iface.tcp_timer_scale = 0
Aug 01 18:39:54 user nova-compute[72150]: iface.tcp_timestamp = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.redirect = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.def_task_mgmt_timeout = 0
Aug 01 18:39:54 user nova-compute[72150]: iface.header_digest = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.data_digest = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.immediate_data = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.initial_r2t = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.data_seq_inorder = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.data_pdu_inorder = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.erl = 0
Aug 01 18:39:54 user nova-compute[72150]: iface.max_receive_data_len = 0
Aug 01 18:39:54 user nova-compute[72150]: iface.first_burst_len = 0
Aug 01 18:39:54 user nova-compute[72150]: iface.max_outstanding_r2t = 0
Aug 01 18:39:54 user nova-compute[72150]: iface.max_burst_len = 0
Aug 01 18:39:54 user nova-compute[72150]: iface.chap_auth = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.bidi_chap = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.strict_login_compliance = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.discovery_auth = <empty>
Aug 01 18:39:54 user nova-compute[72150]: iface.discovery_logout = <empty>
Aug 01 18:39:54 user nova-compute[72150]: node.discovery_address = <empty>
Aug 01 18:39:54 user nova-compute[72150]: node.discovery_port = 0
Aug 01 18:39:54 user nova-compute[72150]: node.discovery_type = static
Aug 01 18:39:54 user nova-compute[72150]: node.session.initial_cmdsn = 0
Aug 01 18:39:54 user nova-compute[72150]: node.session.initial_login_retry_max = 8
Aug 01 18:39:54 user nova-compute[72150]: node.session.xmit_thread_priority = -20
Aug 01 18:39:54 user nova-compute[72150]: node.session.cmds_max = 128
Aug 01 18:39:54 user nova-compute[72150]: node.session.queue_depth = 32
Aug 01 18:39:54 user nova-compute[72150]: node.session.nr_sessions = 1
Aug 01 18:39:54 user nova-compute[72150]: node.session.auth.authmethod = CHAP
Aug 01 18:39:54 user nova-compute[72150]: node.session.auth.username = oOkAyqjD
Aug 01 18:39:54 user nova-compute[72150]: node.session.auth.password = ***
Aug 01 18:39:54 user nova-compute[72150]: node.session.auth.username_in = <empty>
Aug 01 18:39:54 user nova-compute[72150]: node.session.auth.password_in = <empty>
Aug 01 18:39:54 user nova-compute[72150]: node.session.auth.chap_algs = MD5
Aug 01 18:39:54 user nova-compute[72150]: node.session.timeo.replacement_timeout = 120
Aug 01 18:39:54 user nova-compute[72150]: node.session.err_timeo.abort_timeout = 15
Aug 01 18:39:54 user nova-compute[72150]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 18:39:54 user nova-compute[72150]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 18:39:54 user nova-compute[72150]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 18:39:54 user nova-compute[72150]: node.session.iscsi.FastAbort = Yes
Aug 01 18:39:54 user nova-compute[72150]: node.session.iscsi.InitialR2T = No
Aug 01 18:39:54 user nova-compute[72150]: node.session.iscsi.ImmediateData = Yes
Aug 01 18:39:54 user nova-compute[72150]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 18:39:54 user nova-compute[72150]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 18:39:54 user nova-compute[72150]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 18:39:54 user nova-compute[72150]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 18:39:54 user nova-compute[72150]: node.session.iscsi.MaxConnections = 1
Aug 01 18:39:54 user nova-compute[72150]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 18:39:54 user nova-compute[72150]: node.session.iscsi.ERL = 0
Aug 01 18:39:54 user nova-compute[72150]: node.session.scan = manual
Aug 01 18:39:54 user nova-compute[72150]: node.session.reopen_max = 0
Aug 01 18:39:54 user nova-compute[72150]: node.conn[0].address = 172.16.0.220
Aug 01 18:39:54 user nova-compute[72150]: node.conn[0].port = 3260
Aug 01 18:39:54 user nova-compute[72150]: node.conn[0].startup = manual
Aug 01 18:39:54 user nova-compute[72150]: node.conn[0].tcp.window_size = 524288
Aug 01 18:39:54 user nova-compute[72150]: node.conn[0].tcp.type_of_service = 0
Aug 01 18:39:54 user nova-compute[72150]: node.conn[0].timeo.logout_timeout = 15
Aug 01 18:39:54 user nova-compute[72150]: node.conn[0].timeo.login_timeout = 15
Aug 01 18:39:54 user nova-compute[72150]: node.conn[0].timeo.auth_timeout = 45
Aug 01 18:39:54 user nova-compute[72150]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 18:39:54 user nova-compute[72150]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 18:39:54 user nova-compute[72150]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 18:39:54 user nova-compute[72150]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 18:39:54 user nova-compute[72150]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 18:39:54 user nova-compute[72150]: node.conn[0].iscsi.DataDigest = None
Aug 01 18:39:54 user nova-compute[72150]: node.conn[0].iscsi.IFMarker = No
Aug 01 18:39:54 user nova-compute[72150]: node.conn[0].iscsi.OFMarker = No
Aug 01 18:39:54 user nova-compute[72150]: # END RECORD
Aug 01 18:39:54 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd08c5f-f8a6-41a2-8d57-1f7dde4368fb]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab29eb71-e668-4db6-8bdf-a4acab4788f2]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oOkAyqjD {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oOkAyqjD" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46d5067-d69e-40a9-a532-16922f94b4be]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oOkAyqjD'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6844e033-cff9-45e3-a10a-06e5fe589657]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:39:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b615b7-fd3e-4960-887f-39f38eeaac25]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:39:55 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:39:55 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:39:55 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:39:55 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:39:55 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:39:55 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:39:55 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:39:55 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.153s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] HCTL ('38', '0', '0', 0) found on session 43 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bb0a95-b59f-4be0-8248-ca4b6b24ae89]: (4, ('0 0 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Searching for a device in session 43 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oOkAyqjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.176s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] <== connect_volume: return (177ms) {'type': 'block', 'scsi_wwn': '23434656432363939', 'path': '/dev/sdg'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434656432363939', 'path': '/dev/sdg'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:37:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-441711796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-441711796',id=36,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:38:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ad8ef64d051424e9fe644a1fb40fcb4',ramdisk_id='',reservation_id='r-cwbwup3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-23372548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:38:27Z,user_data=None,user_id='cc00b9006f5842c6b875c5d25538b718',uuid=316953c9-42a9-4598-9385-0c138415ea6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed51a469-3095-4679-b038-c18153c8f95e", "address": "fa:16:3e:13:9f:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "vif_mac": "fa:16:3e:13:9f:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped51a469-30", "ovs_interfaceid": "ed51a469-3095-4679-b038-c18153c8f95e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converting VIF {"id": "ed51a469-3095-4679-b038-c18153c8f95e", "address": "fa:16:3e:13:9f:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "vif_mac": "fa:16:3e:13:9f:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped51a469-30", "ovs_interfaceid": "ed51a469-3095-4679-b038-c18153c8f95e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:9f:5a,bridge_name='br-int',has_traffic_filtering=True,id=ed51a469-3095-4679-b038-c18153c8f95e,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped51a469-30') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG nova.objects.instance [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'pci_devices' on Instance uuid 316953c9-42a9-4598-9385-0c138415ea6f {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:39:55 user nova-compute[72150]:   <uuid>316953c9-42a9-4598-9385-0c138415ea6f</uuid>
Aug 01 18:39:55 user nova-compute[72150]:   <name>instance-00000024</name>
Aug 01 18:39:55 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:39:55 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:39:55 user nova-compute[72150]:   <metadata>
Aug 01 18:39:55 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:39:55 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:39:55 user nova-compute[72150]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-441711796</nova:name>
Aug 01 18:39:55 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:39:54</nova:creationTime>
Aug 01 18:39:55 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:39:55 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:39:55 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:39:55 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:39:55 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:39:55 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:39:55 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:39:55 user nova-compute[72150]:       <nova:owner>
Aug 01 18:39:55 user nova-compute[72150]:         <nova:user uuid="cc00b9006f5842c6b875c5d25538b718">tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member</nova:user>
Aug 01 18:39:55 user nova-compute[72150]:         <nova:project uuid="5ad8ef64d051424e9fe644a1fb40fcb4">tempest-ServerBootFromVolumeStableRescueTest-23372548</nova:project>
Aug 01 18:39:55 user nova-compute[72150]:       </nova:owner>
Aug 01 18:39:55 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:39:55 user nova-compute[72150]:       <nova:ports>
Aug 01 18:39:55 user nova-compute[72150]:         <nova:port uuid="ed51a469-3095-4679-b038-c18153c8f95e">
Aug 01 18:39:55 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 18:39:55 user nova-compute[72150]:         </nova:port>
Aug 01 18:39:55 user nova-compute[72150]:       </nova:ports>
Aug 01 18:39:55 user nova-compute[72150]:     </nova:instance>
Aug 01 18:39:55 user nova-compute[72150]:   </metadata>
Aug 01 18:39:55 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:39:55 user nova-compute[72150]:     <system>
Aug 01 18:39:55 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:39:55 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:39:55 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:39:55 user nova-compute[72150]:       <entry name="serial">316953c9-42a9-4598-9385-0c138415ea6f</entry>
Aug 01 18:39:55 user nova-compute[72150]:       <entry name="uuid">316953c9-42a9-4598-9385-0c138415ea6f</entry>
Aug 01 18:39:55 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:39:55 user nova-compute[72150]:     </system>
Aug 01 18:39:55 user nova-compute[72150]:   </sysinfo>
Aug 01 18:39:55 user nova-compute[72150]:   <os>
Aug 01 18:39:55 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:39:55 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:39:55 user nova-compute[72150]:   </os>
Aug 01 18:39:55 user nova-compute[72150]:   <features>
Aug 01 18:39:55 user nova-compute[72150]:     <acpi/>
Aug 01 18:39:55 user nova-compute[72150]:     <apic/>
Aug 01 18:39:55 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:39:55 user nova-compute[72150]:   </features>
Aug 01 18:39:55 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:39:55 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:39:55 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:39:55 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:39:55 user nova-compute[72150]:   </clock>
Aug 01 18:39:55 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:39:55 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:39:55 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:39:55 user nova-compute[72150]:   </cpu>
Aug 01 18:39:55 user nova-compute[72150]:   <devices>
Aug 01 18:39:55 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:39:55 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:39:55 user nova-compute[72150]:       <source dev="/dev/sdg"/>
Aug 01 18:39:55 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:39:55 user nova-compute[72150]:       <serial>39b8b189-c5f4-4c2a-a973-ee3f807ea688</serial>
Aug 01 18:39:55 user nova-compute[72150]:     </disk>
Aug 01 18:39:55 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:39:55 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:39:55 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/316953c9-42a9-4598-9385-0c138415ea6f/disk.rescue"/>
Aug 01 18:39:55 user nova-compute[72150]:       <target dev="vdb" bus="virtio"/>
Aug 01 18:39:55 user nova-compute[72150]:       <boot order="1"/>
Aug 01 18:39:55 user nova-compute[72150]:     </disk>
Aug 01 18:39:55 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:39:55 user nova-compute[72150]:       <mac address="fa:16:3e:13:9f:5a"/>
Aug 01 18:39:55 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:39:55 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:39:55 user nova-compute[72150]:       <target dev="taped51a469-30"/>
Aug 01 18:39:55 user nova-compute[72150]:     </interface>
Aug 01 18:39:55 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:39:55 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/316953c9-42a9-4598-9385-0c138415ea6f/console.log" append="off"/>
Aug 01 18:39:55 user nova-compute[72150]:     </serial>
Aug 01 18:39:55 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:39:55 user nova-compute[72150]:     <video>
Aug 01 18:39:55 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:39:55 user nova-compute[72150]:     </video>
Aug 01 18:39:55 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:39:55 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:39:55 user nova-compute[72150]:     </rng>
Aug 01 18:39:55 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:39:55 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:39:55 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:39:55 user nova-compute[72150]:     </memballoon>
Aug 01 18:39:55 user nova-compute[72150]:   </devices>
Aug 01 18:39:55 user nova-compute[72150]: </domain>
Aug 01 18:39:55 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:39:55 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Instance destroyed successfully.
Aug 01 18:39:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] No VIF found with MAC fa:16:3e:13:9f:5a, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG nova.network.neutron [req-b94e3ddb-bcfb-4c8e-8186-8164d5afc85c req-f6759d93-ce3b-4715-b307-cfe6c172df6b service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Updated VIF entry in instance network info cache for port c4fe7e1b-47aa-495a-9f09-2780827d1f41. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG nova.network.neutron [req-b94e3ddb-bcfb-4c8e-8186-8164d5afc85c req-f6759d93-ce3b-4715-b307-cfe6c172df6b service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Updating instance_info_cache with network_info: [{"id": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "address": "fa:16:3e:c8:34:35", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fe7e1b-47", "ovs_interfaceid": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:39:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b94e3ddb-bcfb-4c8e-8186-8164d5afc85c req-f6759d93-ce3b-4715-b307-cfe6c172df6b service nova] Releasing lock "refresh_cache-5dbd0cf2-7aa9-452a-9322-a58c23d7cc52" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:39:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-bf9b1c06-3218-406f-9541-5cb2ca5dba9d req-c9d7e1ed-94c6-427c-bdc2-a382e8a6e097 service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:39:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bf9b1c06-3218-406f-9541-5cb2ca5dba9d req-c9d7e1ed-94c6-427c-bdc2-a382e8a6e097 service nova] Acquiring lock "316953c9-42a9-4598-9385-0c138415ea6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bf9b1c06-3218-406f-9541-5cb2ca5dba9d req-c9d7e1ed-94c6-427c-bdc2-a382e8a6e097 service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-bf9b1c06-3218-406f-9541-5cb2ca5dba9d req-c9d7e1ed-94c6-427c-bdc2-a382e8a6e097 service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-bf9b1c06-3218-406f-9541-5cb2ca5dba9d req-c9d7e1ed-94c6-427c-bdc2-a382e8a6e097 service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] No waiting events found dispatching network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:39:56 user nova-compute[72150]: WARNING nova.compute.manager [req-bf9b1c06-3218-406f-9541-5cb2ca5dba9d req-c9d7e1ed-94c6-427c-bdc2-a382e8a6e097 service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received unexpected event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e for instance with vm_state active and task_state rescuing.
Aug 01 18:39:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:39:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Removed pending event for 316953c9-42a9-4598-9385-0c138415ea6f due to event {{(pid=72150) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 18:39:58 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915198.5876162, 316953c9-42a9-4598-9385-0c138415ea6f => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:39:58 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] VM Resumed (Lifecycle Event)
Aug 01 18:39:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-00d7f821-abb8-40ad-bdd6-3ac0c20c49ce tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:39:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:39:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:39:58 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 18:39:58 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915198.5889392, 316953c9-42a9-4598-9385-0c138415ea6f => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:39:58 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] VM Started (Lifecycle Event)
Aug 01 18:39:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:39:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:39:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-c94c1979-7d9d-414a-a3a7-acefbf0d9bf8 req-76fed9a8-90cb-4c87-a731-3b271c84ebb1 service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:39:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c94c1979-7d9d-414a-a3a7-acefbf0d9bf8 req-76fed9a8-90cb-4c87-a731-3b271c84ebb1 service nova] Acquiring lock "316953c9-42a9-4598-9385-0c138415ea6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:39:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c94c1979-7d9d-414a-a3a7-acefbf0d9bf8 req-76fed9a8-90cb-4c87-a731-3b271c84ebb1 service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:39:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c94c1979-7d9d-414a-a3a7-acefbf0d9bf8 req-76fed9a8-90cb-4c87-a731-3b271c84ebb1 service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:39:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-c94c1979-7d9d-414a-a3a7-acefbf0d9bf8 req-76fed9a8-90cb-4c87-a731-3b271c84ebb1 service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] No waiting events found dispatching network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:39:58 user nova-compute[72150]: WARNING nova.compute.manager [req-c94c1979-7d9d-414a-a3a7-acefbf0d9bf8 req-76fed9a8-90cb-4c87-a731-3b271c84ebb1 service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received unexpected event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e for instance with vm_state rescued and task_state None.
Aug 01 18:39:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "6bf4d051-455d-4bd8-b9b0-4f9e4082901f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:40:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "6bf4d051-455d-4bd8-b9b0-4f9e4082901f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:40:05 user nova-compute[72150]: DEBUG nova.compute.manager [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:40:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:40:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:40:05 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:40:05 user nova-compute[72150]: INFO nova.compute.claims [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Claim successful on node user
Aug 01 18:40:05 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:40:05 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:40:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:40:05 user nova-compute[72150]: DEBUG nova.compute.manager [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:40:05 user nova-compute[72150]: DEBUG nova.compute.manager [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:40:05 user nova-compute[72150]: DEBUG nova.network.neutron [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:40:05 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:40:05 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915190.9385731, 07213597-fa7a-4422-956a-1b02737cc647 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:40:05 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 07213597-fa7a-4422-956a-1b02737cc647] VM Stopped (Lifecycle Event)
Aug 01 18:40:05 user nova-compute[72150]: DEBUG nova.compute.manager [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:40:05 user nova-compute[72150]: DEBUG nova.compute.manager [None req-98b0ee17-6e59-43e2-89c2-40987d7232a4 None None] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:40:05 user nova-compute[72150]: INFO nova.virt.block_device [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Booting with volume 5094cb61-74e8-4c85-84bd-a79a40d641f6 at /dev/vda
Aug 01 18:40:06 user nova-compute[72150]: DEBUG os_brick.utils [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG nova.policy [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92c7ef0ed6814f8880de76adb913a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ca44f23b114893afcfe57c52f693b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[20401efc-b29f-4d6f-abaa-abecf903dbbc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7e3379-f532-4bdc-aa6d-b3e28395acdf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1d2e12-0394-4f3e-822b-9b05b7264988]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[defb3862-3cab-4370-8fb6-5778d06f4508]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:40:06 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:40:06 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62b3453-5135-4cf6-85d0-dc40468047e3]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG os_brick.utils [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Updating existing volume attachment record: bc13daab-b751-4eb6-999f-423e592e8d71 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG nova.network.neutron [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Successfully created port: 6b6df9a4-874c-4b35-bc04-beda6938aedb {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "65b04144-3b1f-4975-8524-2c9f9660672a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "65b04144-3b1f-4975-8524-2c9f9660672a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:40:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:40:06 user nova-compute[72150]: INFO nova.compute.manager [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Terminating instance
Aug 01 18:40:06 user nova-compute[72150]: DEBUG nova.compute.manager [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:40:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:07 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Instance destroyed successfully.
Aug 01 18:40:07 user nova-compute[72150]: DEBUG nova.objects.instance [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'resources' on Instance uuid 65b04144-3b1f-4975-8524-2c9f9660672a {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:40:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:33:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1438581595',display_name='tempest-ServerRescueNegativeTestJSON-server-1438581595',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1438581595',id=28,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3bQqS2j4kZRk333FJ16crVHeGKsnlSqh38puJr9piXdSV+XYf+feSl84MueVV3t5BtCP0cq69HG1ekvpdvbT4swu2ub0xC3rQ4sqVxWLfImu3Ng8/Yes0u2g+aQjMwbw==',key_name='tempest-keypair-1393509934',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:35:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0b70fdffe9e414aa766f7c8f7a20d50',ramdisk_id='',reservation_id='r-f8e04fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2003578958',owner_user_name='tempest-ServerRescueNegativeTestJSON-2003578958-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:37:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375cd4acff1646f4a5418fb012118600',uuid=65b04144-3b1f-4975-8524-2c9f9660672a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "address": "fa:16:3e:fd:8c:16", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1bb810-d0", "ovs_interfaceid": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:40:07 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converting VIF {"id": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "address": "fa:16:3e:fd:8c:16", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1bb810-d0", "ovs_interfaceid": "7f1bb810-d0cc-4f82-98c4-48abef3008b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:40:07 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:8c:16,bridge_name='br-int',has_traffic_filtering=True,id=7f1bb810-d0cc-4f82-98c4-48abef3008b2,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1bb810-d0') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:40:07 user nova-compute[72150]: DEBUG os_vif [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:8c:16,bridge_name='br-int',has_traffic_filtering=True,id=7f1bb810-d0cc-4f82-98c4-48abef3008b2,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1bb810-d0') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:40:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f1bb810-d0, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:40:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:07 user nova-compute[72150]: INFO os_vif [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:8c:16,bridge_name='br-int',has_traffic_filtering=True,id=7f1bb810-d0cc-4f82-98c4-48abef3008b2,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1bb810-d0')
Aug 01 18:40:07 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Deleting instance files /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a_del
Aug 01 18:40:07 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Deletion of /opt/stack/data/nova/instances/65b04144-3b1f-4975-8524-2c9f9660672a_del complete
Aug 01 18:40:07 user nova-compute[72150]: INFO nova.compute.manager [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 01 18:40:07 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:40:07 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:40:07 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:40:08 user nova-compute[72150]: DEBUG nova.compute.manager [req-6b3f8213-2c5d-4816-8137-be80305d7bf2 req-dd6f4f71-429a-4e38-b5fe-667297f6428d service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received event network-vif-unplugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:40:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6b3f8213-2c5d-4816-8137-be80305d7bf2 req-dd6f4f71-429a-4e38-b5fe-667297f6428d service nova] Acquiring lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:40:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6b3f8213-2c5d-4816-8137-be80305d7bf2 req-dd6f4f71-429a-4e38-b5fe-667297f6428d service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:40:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6b3f8213-2c5d-4816-8137-be80305d7bf2 req-dd6f4f71-429a-4e38-b5fe-667297f6428d service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:40:08 user nova-compute[72150]: DEBUG nova.compute.manager [req-6b3f8213-2c5d-4816-8137-be80305d7bf2 req-dd6f4f71-429a-4e38-b5fe-667297f6428d service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] No waiting events found dispatching network-vif-unplugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:40:08 user nova-compute[72150]: DEBUG nova.compute.manager [req-6b3f8213-2c5d-4816-8137-be80305d7bf2 req-dd6f4f71-429a-4e38-b5fe-667297f6428d service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received event network-vif-unplugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:40:08 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:40:08 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Took 0.91 seconds to deallocate network for instance.
Aug 01 18:40:08 user nova-compute[72150]: DEBUG nova.compute.manager [req-5417a54c-80a9-4c30-abf1-84293c3b79bd req-f35385e8-c326-4f56-987a-f065d0e75fbc service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received event network-vif-deleted-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:40:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:40:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:40:08 user nova-compute[72150]: DEBUG nova.network.neutron [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Successfully updated port: 6b6df9a4-874c-4b35-bc04-beda6938aedb {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:40:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "refresh_cache-6bf4d051-455d-4bd8-b9b0-4f9e4082901f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:40:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquired lock "refresh_cache-6bf4d051-455d-4bd8-b9b0-4f9e4082901f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:40:08 user nova-compute[72150]: DEBUG nova.network.neutron [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:40:08 user nova-compute[72150]: DEBUG nova.network.neutron [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:40:09 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:40:09 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:40:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:40:09 user nova-compute[72150]: DEBUG nova.network.neutron [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Updating instance_info_cache with network_info: [{"id": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "address": "fa:16:3e:4c:29:fe", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6df9a4-87", "ovs_interfaceid": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:40:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Releasing lock "refresh_cache-6bf4d051-455d-4bd8-b9b0-4f9e4082901f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:40:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Instance network_info: |[{"id": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "address": "fa:16:3e:4c:29:fe", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6df9a4-87", "ovs_interfaceid": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:40:09 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Deleted allocations for instance 65b04144-3b1f-4975-8524-2c9f9660672a
Aug 01 18:40:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b76e5b62-f393-41ef-9265-37b06d90ff82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "65b04144-3b1f-4975-8524-2c9f9660672a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.405s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:40:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-1ea9f43e-0519-408d-a21d-9d6f004dd0ba req-95c927d7-eacf-4235-a3f1-4ffffaa8310a service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received event network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:40:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1ea9f43e-0519-408d-a21d-9d6f004dd0ba req-95c927d7-eacf-4235-a3f1-4ffffaa8310a service nova] Acquiring lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:40:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1ea9f43e-0519-408d-a21d-9d6f004dd0ba req-95c927d7-eacf-4235-a3f1-4ffffaa8310a service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:40:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1ea9f43e-0519-408d-a21d-9d6f004dd0ba req-95c927d7-eacf-4235-a3f1-4ffffaa8310a service nova] Lock "65b04144-3b1f-4975-8524-2c9f9660672a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:40:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-1ea9f43e-0519-408d-a21d-9d6f004dd0ba req-95c927d7-eacf-4235-a3f1-4ffffaa8310a service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] No waiting events found dispatching network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:40:10 user nova-compute[72150]: WARNING nova.compute.manager [req-1ea9f43e-0519-408d-a21d-9d6f004dd0ba req-95c927d7-eacf-4235-a3f1-4ffffaa8310a service nova] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Received unexpected event network-vif-plugged-7f1bb810-d0cc-4f82-98c4-48abef3008b2 for instance with vm_state deleted and task_state None.
Aug 01 18:40:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-1ea9f43e-0519-408d-a21d-9d6f004dd0ba req-95c927d7-eacf-4235-a3f1-4ffffaa8310a service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Received event network-changed-6b6df9a4-874c-4b35-bc04-beda6938aedb {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:40:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-1ea9f43e-0519-408d-a21d-9d6f004dd0ba req-95c927d7-eacf-4235-a3f1-4ffffaa8310a service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Refreshing instance network info cache due to event network-changed-6b6df9a4-874c-4b35-bc04-beda6938aedb. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:40:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1ea9f43e-0519-408d-a21d-9d6f004dd0ba req-95c927d7-eacf-4235-a3f1-4ffffaa8310a service nova] Acquiring lock "refresh_cache-6bf4d051-455d-4bd8-b9b0-4f9e4082901f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:40:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1ea9f43e-0519-408d-a21d-9d6f004dd0ba req-95c927d7-eacf-4235-a3f1-4ffffaa8310a service nova] Acquired lock "refresh_cache-6bf4d051-455d-4bd8-b9b0-4f9e4082901f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:40:10 user nova-compute[72150]: DEBUG nova.network.neutron [req-1ea9f43e-0519-408d-a21d-9d6f004dd0ba req-95c927d7-eacf-4235-a3f1-4ffffaa8310a service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Refreshing network info cache for port 6b6df9a4-874c-4b35-bc04-beda6938aedb {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:40:10 user nova-compute[72150]: DEBUG nova.network.neutron [req-1ea9f43e-0519-408d-a21d-9d6f004dd0ba req-95c927d7-eacf-4235-a3f1-4ffffaa8310a service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Updated VIF entry in instance network info cache for port 6b6df9a4-874c-4b35-bc04-beda6938aedb. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:40:10 user nova-compute[72150]: DEBUG nova.network.neutron [req-1ea9f43e-0519-408d-a21d-9d6f004dd0ba req-95c927d7-eacf-4235-a3f1-4ffffaa8310a service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Updating instance_info_cache with network_info: [{"id": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "address": "fa:16:3e:4c:29:fe", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6df9a4-87", "ovs_interfaceid": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:40:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1ea9f43e-0519-408d-a21d-9d6f004dd0ba req-95c927d7-eacf-4235-a3f1-4ffffaa8310a service nova] Releasing lock "refresh_cache-6bf4d051-455d-4bd8-b9b0-4f9e4082901f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:40:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:40:14 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Creating image(s)
Aug 01 18:40:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Did not create local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Ensure instance console log exists: /opt/stack/data/nova/instances/6bf4d051-455d-4bd8-b9b0-4f9e4082901f/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Start _get_guest_xml network_info=[{"id": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "address": "fa:16:3e:4c:29:fe", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6df9a4-87", "ovs_interfaceid": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'bc13daab-b751-4eb6-999f-423e592e8d71', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QSvyOMNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6bf4d051-455d-4bd8-b9b0-4f9e4082901f', 'attached_at': '', 'detached_at': '', 'volume_id': '5094cb61-74e8-4c85-84bd-a79a40d641f6', 'serial': '5094cb61-74e8-4c85-84bd-a79a40d641f6'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:40:14 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:40:14 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:40:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QSvyOMNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:40:14 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:40:14 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:40:14 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1342b83-9e6c-423c-825d-1ed0ed8979cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:40:14 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58beffe-a785-48af-822e-0ad4542ef446]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6] added
Aug 01 18:40:14 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[203d0fd0-b6d1-4447-a3d5-6dbed2210cf0]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8d911b-c3e0-4382-bfcd-a1393e6ee625]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QSvyOMNw {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QSvyOMNw" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c10b8e-bdcf-483a-a545-25eda659a603]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QSvyOMNw'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c046a98-9ce0-43ba-b08a-2b0419c57556]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c74f61-275c-4497-8c3f-2f53e6223e04]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:40:14 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:40:14 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:40:14 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:40:14 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:40:14 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:40:14 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:40:14 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:40:14 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb82021e-0447-4aca-8ad4-8edb63b12980]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6, portal: 172.16.0.220,3260]
Aug 01 18:40:14 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6, portal: 172.16.0.220,3260] successful.
Aug 01 18:40:14 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fc7a4d-dae9-43cd-b4f4-8b4ac745a7fd]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[de738ebe-f656-4285-a45f-e334bb8b1ce8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:40:14 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:40:14 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:40:14 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:40:14 user nova-compute[72150]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 (non-flash)
Aug 01 18:40:14 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:40:14 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:40:14 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:40:14 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:40:14 user nova-compute[72150]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 (non-flash)
Aug 01 18:40:14 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab53186a-977d-4873-8863-23370cbb28fd]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QSvyOMNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:40:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:40:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26331346631353537', 'path': '/dev/sdd'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:40:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331346631353537', 'path': '/dev/sdd'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:40:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1080443909',display_name='tempest-TestVolumeBootPattern-server-1080443909',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1080443909',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVf3lHt050k356A8Gut9WieNqP8u9vIp5xdHm1rq7ONC5kHGtGA6mBo7SyXu2T5UgJrBcaDoeDkrLO73m2dxgj5g1F2RdpTy7mOLuxRD5SR618gGiTwTven5q6qp8rd8g==',key_name='tempest-TestVolumeBootPattern-35567601',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7ca44f23b114893afcfe57c52f693b1',ramdisk_id='',reservation_id='r-ypv11gsz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-295340968',owner_user_name='tempest-TestVolumeBootPattern-295340968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:40:06Z,user_data=None,user_id='92c7ef0ed6814f8880de76adb913a487',uuid=6bf4d051-455d-4bd8-b9b0-4f9e4082901f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "address": "fa:16:3e:4c:29:fe", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6df9a4-87", "ovs_interfaceid": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:40:15 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converting VIF {"id": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "address": "fa:16:3e:4c:29:fe", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6df9a4-87", "ovs_interfaceid": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:40:15 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:29:fe,bridge_name='br-int',has_traffic_filtering=True,id=6b6df9a4-874c-4b35-bc04-beda6938aedb,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6df9a4-87') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:40:15 user nova-compute[72150]: DEBUG nova.objects.instance [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lazy-loading 'pci_devices' on Instance uuid 6bf4d051-455d-4bd8-b9b0-4f9e4082901f {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:40:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:40:15 user nova-compute[72150]:   <uuid>6bf4d051-455d-4bd8-b9b0-4f9e4082901f</uuid>
Aug 01 18:40:15 user nova-compute[72150]:   <name>instance-00000028</name>
Aug 01 18:40:15 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:40:15 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:40:15 user nova-compute[72150]:   <metadata>
Aug 01 18:40:15 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:40:15 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:40:15 user nova-compute[72150]:       <nova:name>tempest-TestVolumeBootPattern-server-1080443909</nova:name>
Aug 01 18:40:15 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:40:14</nova:creationTime>
Aug 01 18:40:15 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:40:15 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:40:15 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:40:15 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:40:15 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:40:15 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:40:15 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:40:15 user nova-compute[72150]:       <nova:owner>
Aug 01 18:40:15 user nova-compute[72150]:         <nova:user uuid="92c7ef0ed6814f8880de76adb913a487">tempest-TestVolumeBootPattern-295340968-project-member</nova:user>
Aug 01 18:40:15 user nova-compute[72150]:         <nova:project uuid="e7ca44f23b114893afcfe57c52f693b1">tempest-TestVolumeBootPattern-295340968</nova:project>
Aug 01 18:40:15 user nova-compute[72150]:       </nova:owner>
Aug 01 18:40:15 user nova-compute[72150]:       <nova:ports>
Aug 01 18:40:15 user nova-compute[72150]:         <nova:port uuid="6b6df9a4-874c-4b35-bc04-beda6938aedb">
Aug 01 18:40:15 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 18:40:15 user nova-compute[72150]:         </nova:port>
Aug 01 18:40:15 user nova-compute[72150]:       </nova:ports>
Aug 01 18:40:15 user nova-compute[72150]:     </nova:instance>
Aug 01 18:40:15 user nova-compute[72150]:   </metadata>
Aug 01 18:40:15 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:40:15 user nova-compute[72150]:     <system>
Aug 01 18:40:15 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:40:15 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:40:15 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:40:15 user nova-compute[72150]:       <entry name="serial">6bf4d051-455d-4bd8-b9b0-4f9e4082901f</entry>
Aug 01 18:40:15 user nova-compute[72150]:       <entry name="uuid">6bf4d051-455d-4bd8-b9b0-4f9e4082901f</entry>
Aug 01 18:40:15 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:40:15 user nova-compute[72150]:     </system>
Aug 01 18:40:15 user nova-compute[72150]:   </sysinfo>
Aug 01 18:40:15 user nova-compute[72150]:   <os>
Aug 01 18:40:15 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:40:15 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:40:15 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:40:15 user nova-compute[72150]:   </os>
Aug 01 18:40:15 user nova-compute[72150]:   <features>
Aug 01 18:40:15 user nova-compute[72150]:     <acpi/>
Aug 01 18:40:15 user nova-compute[72150]:     <apic/>
Aug 01 18:40:15 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:40:15 user nova-compute[72150]:   </features>
Aug 01 18:40:15 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:40:15 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:40:15 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:40:15 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:40:15 user nova-compute[72150]:   </clock>
Aug 01 18:40:15 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:40:15 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:40:15 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:40:15 user nova-compute[72150]:   </cpu>
Aug 01 18:40:15 user nova-compute[72150]:   <devices>
Aug 01 18:40:15 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:40:15 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:40:15 user nova-compute[72150]:       <source dev="/dev/sdd"/>
Aug 01 18:40:15 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:40:15 user nova-compute[72150]:       <serial>5094cb61-74e8-4c85-84bd-a79a40d641f6</serial>
Aug 01 18:40:15 user nova-compute[72150]:     </disk>
Aug 01 18:40:15 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:40:15 user nova-compute[72150]:       <mac address="fa:16:3e:4c:29:fe"/>
Aug 01 18:40:15 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:40:15 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:40:15 user nova-compute[72150]:       <target dev="tap6b6df9a4-87"/>
Aug 01 18:40:15 user nova-compute[72150]:     </interface>
Aug 01 18:40:15 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:40:15 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/6bf4d051-455d-4bd8-b9b0-4f9e4082901f/console.log" append="off"/>
Aug 01 18:40:15 user nova-compute[72150]:     </serial>
Aug 01 18:40:15 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:40:15 user nova-compute[72150]:     <video>
Aug 01 18:40:15 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:40:15 user nova-compute[72150]:     </video>
Aug 01 18:40:15 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:40:15 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:40:15 user nova-compute[72150]:     </rng>
Aug 01 18:40:15 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:40:15 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:40:15 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:40:15 user nova-compute[72150]:     </memballoon>
Aug 01 18:40:15 user nova-compute[72150]:   </devices>
Aug 01 18:40:15 user nova-compute[72150]: </domain>
Aug 01 18:40:15 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:40:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1080443909',display_name='tempest-TestVolumeBootPattern-server-1080443909',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1080443909',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVf3lHt050k356A8Gut9WieNqP8u9vIp5xdHm1rq7ONC5kHGtGA6mBo7SyXu2T5UgJrBcaDoeDkrLO73m2dxgj5g1F2RdpTy7mOLuxRD5SR618gGiTwTven5q6qp8rd8g==',key_name='tempest-TestVolumeBootPattern-35567601',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7ca44f23b114893afcfe57c52f693b1',ramdisk_id='',reservation_id='r-ypv11gsz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-295340968',owner_user_name='tempest-TestVolumeBootPattern-295340968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:40:06Z,user_data=None,user_id='92c7ef0ed6814f8880de76adb913a487',uuid=6bf4d051-455d-4bd8-b9b0-4f9e4082901f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "address": "fa:16:3e:4c:29:fe", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6df9a4-87", "ovs_interfaceid": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:40:15 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converting VIF {"id": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "address": "fa:16:3e:4c:29:fe", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6df9a4-87", "ovs_interfaceid": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:40:15 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:29:fe,bridge_name='br-int',has_traffic_filtering=True,id=6b6df9a4-874c-4b35-bc04-beda6938aedb,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6df9a4-87') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:40:15 user nova-compute[72150]: DEBUG os_vif [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:29:fe,bridge_name='br-int',has_traffic_filtering=True,id=6b6df9a4-874c-4b35-bc04-beda6938aedb,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6df9a4-87') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:40:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:40:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:40:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b6df9a4-87, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:40:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6b6df9a4-87, col_values=(('external_ids', {'iface-id': '6b6df9a4-874c-4b35-bc04-beda6938aedb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:29:fe', 'vm-uuid': '6bf4d051-455d-4bd8-b9b0-4f9e4082901f'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:40:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:40:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:15 user nova-compute[72150]: INFO os_vif [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:29:fe,bridge_name='br-int',has_traffic_filtering=True,id=6b6df9a4-874c-4b35-bc04-beda6938aedb,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6df9a4-87')
Aug 01 18:40:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:40:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] No VIF found with MAC fa:16:3e:4c:29:fe, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:40:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:17 user nova-compute[72150]: DEBUG nova.compute.manager [req-6a05b9e5-b223-4dc1-8897-48d533d0b069 req-b32859bb-b811-4767-bd46-7e9c64b5d44e service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Received event network-vif-plugged-6b6df9a4-874c-4b35-bc04-beda6938aedb {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:40:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6a05b9e5-b223-4dc1-8897-48d533d0b069 req-b32859bb-b811-4767-bd46-7e9c64b5d44e service nova] Acquiring lock "6bf4d051-455d-4bd8-b9b0-4f9e4082901f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:40:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6a05b9e5-b223-4dc1-8897-48d533d0b069 req-b32859bb-b811-4767-bd46-7e9c64b5d44e service nova] Lock "6bf4d051-455d-4bd8-b9b0-4f9e4082901f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:40:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6a05b9e5-b223-4dc1-8897-48d533d0b069 req-b32859bb-b811-4767-bd46-7e9c64b5d44e service nova] Lock "6bf4d051-455d-4bd8-b9b0-4f9e4082901f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:40:17 user nova-compute[72150]: DEBUG nova.compute.manager [req-6a05b9e5-b223-4dc1-8897-48d533d0b069 req-b32859bb-b811-4767-bd46-7e9c64b5d44e service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] No waiting events found dispatching network-vif-plugged-6b6df9a4-874c-4b35-bc04-beda6938aedb {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:40:17 user nova-compute[72150]: WARNING nova.compute.manager [req-6a05b9e5-b223-4dc1-8897-48d533d0b069 req-b32859bb-b811-4767-bd46-7e9c64b5d44e service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Received unexpected event network-vif-plugged-6b6df9a4-874c-4b35-bc04-beda6938aedb for instance with vm_state building and task_state spawning.
Aug 01 18:40:19 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915219.3792336, 6bf4d051-455d-4bd8-b9b0-4f9e4082901f => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:40:19 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] VM Resumed (Lifecycle Event)
Aug 01 18:40:19 user nova-compute[72150]: DEBUG nova.compute.manager [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:40:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:40:19 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Instance spawned successfully.
Aug 01 18:40:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:40:19 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:40:19 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:40:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:40:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:40:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:40:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:40:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:40:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:40:19 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:40:19 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915219.38022, 6bf4d051-455d-4bd8-b9b0-4f9e4082901f => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:40:19 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] VM Started (Lifecycle Event)
Aug 01 18:40:19 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:40:19 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:40:19 user nova-compute[72150]: INFO nova.compute.manager [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Took 5.27 seconds to spawn the instance on the hypervisor.
Aug 01 18:40:19 user nova-compute[72150]: DEBUG nova.compute.manager [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:40:19 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:40:19 user nova-compute[72150]: DEBUG nova.compute.manager [req-091d361a-4a5b-4f88-835c-8bdb533fde6b req-9dcd1ca8-2f31-4c79-a95d-831d2b6544c7 service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Received event network-vif-plugged-6b6df9a4-874c-4b35-bc04-beda6938aedb {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:40:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-091d361a-4a5b-4f88-835c-8bdb533fde6b req-9dcd1ca8-2f31-4c79-a95d-831d2b6544c7 service nova] Acquiring lock "6bf4d051-455d-4bd8-b9b0-4f9e4082901f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:40:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-091d361a-4a5b-4f88-835c-8bdb533fde6b req-9dcd1ca8-2f31-4c79-a95d-831d2b6544c7 service nova] Lock "6bf4d051-455d-4bd8-b9b0-4f9e4082901f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:40:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-091d361a-4a5b-4f88-835c-8bdb533fde6b req-9dcd1ca8-2f31-4c79-a95d-831d2b6544c7 service nova] Lock "6bf4d051-455d-4bd8-b9b0-4f9e4082901f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:40:19 user nova-compute[72150]: DEBUG nova.compute.manager [req-091d361a-4a5b-4f88-835c-8bdb533fde6b req-9dcd1ca8-2f31-4c79-a95d-831d2b6544c7 service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] No waiting events found dispatching network-vif-plugged-6b6df9a4-874c-4b35-bc04-beda6938aedb {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:40:19 user nova-compute[72150]: WARNING nova.compute.manager [req-091d361a-4a5b-4f88-835c-8bdb533fde6b req-9dcd1ca8-2f31-4c79-a95d-831d2b6544c7 service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Received unexpected event network-vif-plugged-6b6df9a4-874c-4b35-bc04-beda6938aedb for instance with vm_state building and task_state spawning.
Aug 01 18:40:19 user nova-compute[72150]: INFO nova.compute.manager [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Took 14.26 seconds to build instance.
Aug 01 18:40:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1b4635ea-4c74-47b4-a8c0-a5f43b4df5f8 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "6bf4d051-455d-4bd8-b9b0-4f9e4082901f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.379s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:40:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:22 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915207.6983905, 65b04144-3b1f-4975-8524-2c9f9660672a => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:40:22 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] VM Stopped (Lifecycle Event)
Aug 01 18:40:22 user nova-compute[72150]: DEBUG nova.compute.manager [None req-eb527b8a-f588-4549-834b-7366469cb312 None None] [instance: 65b04144-3b1f-4975-8524-2c9f9660672a] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:40:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:35 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:40:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:40 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:40:43 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:40:43 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:40:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:44 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:40:44 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:40:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:40:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:40:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:40:44 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:40:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:40:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/316953c9-42a9-4598-9385-0c138415ea6f/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/316953c9-42a9-4598-9385-0c138415ea6f/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/316953c9-42a9-4598-9385-0c138415ea6f/disk.rescue --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/316953c9-42a9-4598-9385-0c138415ea6f/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:40:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:40:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:40:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d402a88-3a51-48af-8bc9-53a2040f8634/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d402a88-3a51-48af-8bc9-53a2040f8634/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d402a88-3a51-48af-8bc9-53a2040f8634/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d402a88-3a51-48af-8bc9-53a2040f8634/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:40:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Acquiring lock "9d402a88-3a51-48af-8bc9-53a2040f8634" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:40:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "9d402a88-3a51-48af-8bc9-53a2040f8634" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:40:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Acquiring lock "9d402a88-3a51-48af-8bc9-53a2040f8634-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:40:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "9d402a88-3a51-48af-8bc9-53a2040f8634-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:40:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "9d402a88-3a51-48af-8bc9-53a2040f8634-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:40:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:47 user nova-compute[72150]: INFO nova.compute.manager [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Terminating instance
Aug 01 18:40:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:40:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:40:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.compute.manager [req-2ea9220c-80e6-49f0-9962-2984a66cb124 req-8a1d225f-eb0a-4e69-9584-dca5ff166243 service nova] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Received event network-vif-unplugged-e80b9f9f-0b9c-4388-90e7-d36d277cc846 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2ea9220c-80e6-49f0-9962-2984a66cb124 req-8a1d225f-eb0a-4e69-9584-dca5ff166243 service nova] Acquiring lock "9d402a88-3a51-48af-8bc9-53a2040f8634-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2ea9220c-80e6-49f0-9962-2984a66cb124 req-8a1d225f-eb0a-4e69-9584-dca5ff166243 service nova] Lock "9d402a88-3a51-48af-8bc9-53a2040f8634-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2ea9220c-80e6-49f0-9962-2984a66cb124 req-8a1d225f-eb0a-4e69-9584-dca5ff166243 service nova] Lock "9d402a88-3a51-48af-8bc9-53a2040f8634-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.compute.manager [req-2ea9220c-80e6-49f0-9962-2984a66cb124 req-8a1d225f-eb0a-4e69-9584-dca5ff166243 service nova] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] No waiting events found dispatching network-vif-unplugged-e80b9f9f-0b9c-4388-90e7-d36d277cc846 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.compute.manager [req-2ea9220c-80e6-49f0-9962-2984a66cb124 req-8a1d225f-eb0a-4e69-9584-dca5ff166243 service nova] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Received event network-vif-unplugged-e80b9f9f-0b9c-4388-90e7-d36d277cc846 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:48 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Instance destroyed successfully.
Aug 01 18:40:48 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:40:48 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=7154MB free_disk=25.14487075805664GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.objects.instance [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lazy-loading 'resources' on Instance uuid 9d402a88-3a51-48af-8bc9-53a2040f8634 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1868345466',display_name='tempest-ServersNegativeTestJSON-server-1868345466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1868345466',id=38,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:39:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='871994ab4c4848dfbe070a8d9c8d1d4e',ramdisk_id='',reservation_id='r-2m5aqx30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1642498340',owner_user_name='tempest-ServersNegativeTestJSON-1642498340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:39:05Z,user_data=None,user_id='dccfa49288a945b9b0707c140b0b2cbb',uuid=9d402a88-3a51-48af-8bc9-53a2040f8634,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e80b9f9f-0b9c-4388-90e7-d36d277cc846", "address": "fa:16:3e:11:7e:32", "network": {"id": "c7354620-f943-40a7-a673-5e6e9103498d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205923950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871994ab4c4848dfbe070a8d9c8d1d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape80b9f9f-0b", "ovs_interfaceid": "e80b9f9f-0b9c-4388-90e7-d36d277cc846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Converting VIF {"id": "e80b9f9f-0b9c-4388-90e7-d36d277cc846", "address": "fa:16:3e:11:7e:32", "network": {"id": "c7354620-f943-40a7-a673-5e6e9103498d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205923950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871994ab4c4848dfbe070a8d9c8d1d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape80b9f9f-0b", "ovs_interfaceid": "e80b9f9f-0b9c-4388-90e7-d36d277cc846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:7e:32,bridge_name='br-int',has_traffic_filtering=True,id=e80b9f9f-0b9c-4388-90e7-d36d277cc846,network=Network(c7354620-f943-40a7-a673-5e6e9103498d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape80b9f9f-0b') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG os_vif [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:7e:32,bridge_name='br-int',has_traffic_filtering=True,id=e80b9f9f-0b9c-4388-90e7-d36d277cc846,network=Network(c7354620-f943-40a7-a673-5e6e9103498d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape80b9f9f-0b') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape80b9f9f-0b, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:48 user nova-compute[72150]: INFO os_vif [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:7e:32,bridge_name='br-int',has_traffic_filtering=True,id=e80b9f9f-0b9c-4388-90e7-d36d277cc846,network=Network(c7354620-f943-40a7-a673-5e6e9103498d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape80b9f9f-0b')
Aug 01 18:40:48 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Deleting instance files /opt/stack/data/nova/instances/9d402a88-3a51-48af-8bc9-53a2040f8634_del
Aug 01 18:40:48 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Deletion of /opt/stack/data/nova/instances/9d402a88-3a51-48af-8bc9-53a2040f8634_del complete
Aug 01 18:40:48 user nova-compute[72150]: INFO nova.compute.manager [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 01 18:40:48 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 769690c8-53c5-4057-88a5-fbdbcb930e32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ea68420b-8362-4df3-b710-cd1cf76adba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 08851ec4-6f71-4ec1-a092-42aab83ee87f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance bf2d1f14-2227-41d1-bd73-a05ab3149aba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 42e75a98-beb1-4688-a375-affc63b14252 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance d2117837-5552-4ec3-9f9b-62629c1ff4cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 737a8853-f9b9-4a0b-95a1-200d72c4d806 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 316953c9-42a9-4598-9385-0c138415ea6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 9d402a88-3a51-48af-8bc9-53a2040f8634 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 0c6f0595-d475-48c9-8726-cffcdb047b2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 6bf4d051-455d-4bd8-b9b0-4f9e4082901f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:40:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:40:49 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:40:49 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:40:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:40:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.584s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:40:49 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:40:49 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Took 0.55 seconds to deallocate network for instance.
Aug 01 18:40:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:40:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:40:49 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:40:49 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:40:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:40:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:49 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Deleted allocations for instance 9d402a88-3a51-48af-8bc9-53a2040f8634
Aug 01 18:40:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0127441d-ed80-41ff-99f3-34d0900e36bd tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "9d402a88-3a51-48af-8bc9-53a2040f8634" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.089s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:40:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-c3653a38-e2d2-4377-b8ac-24c32ac3cc95 req-bb072a16-1d37-4b01-a824-0d327f0f091f service nova] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Received event network-vif-plugged-e80b9f9f-0b9c-4388-90e7-d36d277cc846 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:40:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c3653a38-e2d2-4377-b8ac-24c32ac3cc95 req-bb072a16-1d37-4b01-a824-0d327f0f091f service nova] Acquiring lock "9d402a88-3a51-48af-8bc9-53a2040f8634-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:40:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c3653a38-e2d2-4377-b8ac-24c32ac3cc95 req-bb072a16-1d37-4b01-a824-0d327f0f091f service nova] Lock "9d402a88-3a51-48af-8bc9-53a2040f8634-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:40:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c3653a38-e2d2-4377-b8ac-24c32ac3cc95 req-bb072a16-1d37-4b01-a824-0d327f0f091f service nova] Lock "9d402a88-3a51-48af-8bc9-53a2040f8634-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:40:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-c3653a38-e2d2-4377-b8ac-24c32ac3cc95 req-bb072a16-1d37-4b01-a824-0d327f0f091f service nova] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] No waiting events found dispatching network-vif-plugged-e80b9f9f-0b9c-4388-90e7-d36d277cc846 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:40:50 user nova-compute[72150]: WARNING nova.compute.manager [req-c3653a38-e2d2-4377-b8ac-24c32ac3cc95 req-bb072a16-1d37-4b01-a824-0d327f0f091f service nova] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Received unexpected event network-vif-plugged-e80b9f9f-0b9c-4388-90e7-d36d277cc846 for instance with vm_state deleted and task_state None.
Aug 01 18:40:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-c3653a38-e2d2-4377-b8ac-24c32ac3cc95 req-bb072a16-1d37-4b01-a824-0d327f0f091f service nova] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Received event network-vif-deleted-e80b9f9f-0b9c-4388-90e7-d36d277cc846 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:40:50 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:40:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:40:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-08851ec4-6f71-4ec1-a092-42aab83ee87f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:40:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-08851ec4-6f71-4ec1-a092-42aab83ee87f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:40:50 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:40:50 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Updating instance_info_cache with network_info: [{"id": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "address": "fa:16:3e:e4:fb:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c860dfa-73", "ovs_interfaceid": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:40:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-08851ec4-6f71-4ec1-a092-42aab83ee87f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:40:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:40:50 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:40:50 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:40:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:40:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:40:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:40:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:40:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:40:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:40:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:03 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915248.3057406, 9d402a88-3a51-48af-8bc9-53a2040f8634 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:41:03 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] VM Stopped (Lifecycle Event)
Aug 01 18:41:03 user nova-compute[72150]: DEBUG nova.compute.manager [None req-c3b62207-a2b1-4f6c-a5a1-2945627a4689 None None] [instance: 9d402a88-3a51-48af-8bc9-53a2040f8634] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:41:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "ea68420b-8362-4df3-b710-cd1cf76adba0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:09 user nova-compute[72150]: INFO nova.compute.manager [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Terminating instance
Aug 01 18:41:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG nova.compute.manager [req-abe16aea-204e-40db-9d47-8854886a6078 req-338701b3-b8fc-43d8-9d8f-345933e5f38f service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Received event network-vif-unplugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-abe16aea-204e-40db-9d47-8854886a6078 req-338701b3-b8fc-43d8-9d8f-345933e5f38f service nova] Acquiring lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-abe16aea-204e-40db-9d47-8854886a6078 req-338701b3-b8fc-43d8-9d8f-345933e5f38f service nova] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-abe16aea-204e-40db-9d47-8854886a6078 req-338701b3-b8fc-43d8-9d8f-345933e5f38f service nova] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG nova.compute.manager [req-abe16aea-204e-40db-9d47-8854886a6078 req-338701b3-b8fc-43d8-9d8f-345933e5f38f service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] No waiting events found dispatching network-vif-unplugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG nova.compute.manager [req-abe16aea-204e-40db-9d47-8854886a6078 req-338701b3-b8fc-43d8-9d8f-345933e5f38f service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Received event network-vif-unplugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:09 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Instance destroyed successfully.
Aug 01 18:41:09 user nova-compute[72150]: DEBUG nova.objects.instance [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'resources' on Instance uuid ea68420b-8362-4df3-b710-cd1cf76adba0 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-784211986',display_name='tempest-ServerRescueNegativeTestJSON-server-784211986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-784211986',id=13,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:26:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0b70fdffe9e414aa766f7c8f7a20d50',ramdisk_id='',reservation_id='r-wf7l5fq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2003578958',owner_user_name='tempest-ServerRescueNegativeTestJSON-2003578958-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:26:54Z,user_data=None,user_id='375cd4acff1646f4a5418fb012118600',uuid=ea68420b-8362-4df3-b710-cd1cf76adba0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "address": "fa:16:3e:a6:bd:40", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a63bb1a-08", "ovs_interfaceid": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converting VIF {"id": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "address": "fa:16:3e:a6:bd:40", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a63bb1a-08", "ovs_interfaceid": "6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:bd:40,bridge_name='br-int',has_traffic_filtering=True,id=6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a63bb1a-08') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG os_vif [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:bd:40,bridge_name='br-int',has_traffic_filtering=True,id=6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a63bb1a-08') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a63bb1a-08, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:09 user nova-compute[72150]: INFO os_vif [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:bd:40,bridge_name='br-int',has_traffic_filtering=True,id=6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a63bb1a-08')
Aug 01 18:41:09 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Deleting instance files /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0_del
Aug 01 18:41:09 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Deletion of /opt/stack/data/nova/instances/ea68420b-8362-4df3-b710-cd1cf76adba0_del complete
Aug 01 18:41:10 user nova-compute[72150]: INFO nova.compute.manager [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 18:41:10 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:41:10 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:41:10 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:41:10 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:41:10 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Took 0.50 seconds to deallocate network for instance.
Aug 01 18:41:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:10 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:41:10 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:41:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:10 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Deleted allocations for instance ea68420b-8362-4df3-b710-cd1cf76adba0
Aug 01 18:41:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7ec1437c-c4d4-4367-a6fa-1af2e106f2ec tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.933s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:11 user nova-compute[72150]: DEBUG nova.compute.manager [req-d4d55eb4-4067-45d6-9aa4-831d7b8ff72f req-05e46c97-cb8d-4867-840f-55abe6416c42 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Received event network-vif-plugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:41:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d4d55eb4-4067-45d6-9aa4-831d7b8ff72f req-05e46c97-cb8d-4867-840f-55abe6416c42 service nova] Acquiring lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d4d55eb4-4067-45d6-9aa4-831d7b8ff72f req-05e46c97-cb8d-4867-840f-55abe6416c42 service nova] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d4d55eb4-4067-45d6-9aa4-831d7b8ff72f req-05e46c97-cb8d-4867-840f-55abe6416c42 service nova] Lock "ea68420b-8362-4df3-b710-cd1cf76adba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:11 user nova-compute[72150]: DEBUG nova.compute.manager [req-d4d55eb4-4067-45d6-9aa4-831d7b8ff72f req-05e46c97-cb8d-4867-840f-55abe6416c42 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] No waiting events found dispatching network-vif-plugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:41:11 user nova-compute[72150]: WARNING nova.compute.manager [req-d4d55eb4-4067-45d6-9aa4-831d7b8ff72f req-05e46c97-cb8d-4867-840f-55abe6416c42 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Received unexpected event network-vif-plugged-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a for instance with vm_state deleted and task_state None.
Aug 01 18:41:11 user nova-compute[72150]: DEBUG nova.compute.manager [req-d4d55eb4-4067-45d6-9aa4-831d7b8ff72f req-05e46c97-cb8d-4867-840f-55abe6416c42 service nova] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Received event network-vif-deleted-6a63bb1a-08e7-4b34-b27e-5b2ae4ec617a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:41:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:18 user nova-compute[72150]: DEBUG nova.compute.manager [req-c6fc970b-e631-4694-955d-890e80223bef req-492e411b-daa0-4abd-a540-5afc44c965bd service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Received event network-changed-fc7d8e56-f828-4324-afaa-123405c9f968 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:41:18 user nova-compute[72150]: DEBUG nova.compute.manager [req-c6fc970b-e631-4694-955d-890e80223bef req-492e411b-daa0-4abd-a540-5afc44c965bd service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Refreshing instance network info cache due to event network-changed-fc7d8e56-f828-4324-afaa-123405c9f968. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:41:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c6fc970b-e631-4694-955d-890e80223bef req-492e411b-daa0-4abd-a540-5afc44c965bd service nova] Acquiring lock "refresh_cache-0c6f0595-d475-48c9-8726-cffcdb047b2d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:41:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c6fc970b-e631-4694-955d-890e80223bef req-492e411b-daa0-4abd-a540-5afc44c965bd service nova] Acquired lock "refresh_cache-0c6f0595-d475-48c9-8726-cffcdb047b2d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:41:18 user nova-compute[72150]: DEBUG nova.network.neutron [req-c6fc970b-e631-4694-955d-890e80223bef req-492e411b-daa0-4abd-a540-5afc44c965bd service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Refreshing network info cache for port fc7d8e56-f828-4324-afaa-123405c9f968 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:41:18 user nova-compute[72150]: DEBUG nova.network.neutron [req-c6fc970b-e631-4694-955d-890e80223bef req-492e411b-daa0-4abd-a540-5afc44c965bd service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Updated VIF entry in instance network info cache for port fc7d8e56-f828-4324-afaa-123405c9f968. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:41:18 user nova-compute[72150]: DEBUG nova.network.neutron [req-c6fc970b-e631-4694-955d-890e80223bef req-492e411b-daa0-4abd-a540-5afc44c965bd service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Updating instance_info_cache with network_info: [{"id": "fc7d8e56-f828-4324-afaa-123405c9f968", "address": "fa:16:3e:76:17:26", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc7d8e56-f8", "ovs_interfaceid": "fc7d8e56-f828-4324-afaa-123405c9f968", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:41:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c6fc970b-e631-4694-955d-890e80223bef req-492e411b-daa0-4abd-a540-5afc44c965bd service nova] Releasing lock "refresh_cache-0c6f0595-d475-48c9-8726-cffcdb047b2d" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:41:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:20 user nova-compute[72150]: INFO nova.compute.manager [None req-2abb7b5b-bb5c-4950-a636-f64883c287dd tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Get console output
Aug 01 18:41:20 user nova-compute[72150]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 01 18:41:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "0c6f0595-d475-48c9-8726-cffcdb047b2d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "0c6f0595-d475-48c9-8726-cffcdb047b2d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:21 user nova-compute[72150]: DEBUG nova.objects.instance [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lazy-loading 'flavor' on Instance uuid 0c6f0595-d475-48c9-8726-cffcdb047b2d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:41:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "0c6f0595-d475-48c9-8726-cffcdb047b2d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "0c6f0595-d475-48c9-8726-cffcdb047b2d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "0c6f0595-d475-48c9-8726-cffcdb047b2d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:22 user nova-compute[72150]: INFO nova.compute.manager [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Attaching volume f896c9fd-9ddb-4058-aaee-b6b0674b45b7 to /dev/vdb
Aug 01 18:41:22 user nova-compute[72150]: DEBUG os_brick.utils [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:41:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[543aa777-ba88-49b6-b849-bd7d0af0f359]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8dac331-ad4f-4fe2-a351-d7b2d3f3a70f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[39263f5f-644d-4b67-9fb4-4b945f2fa7d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3412722-a584-47f1-a791-50927c5ca848]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:41:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:41:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:41:22 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:41:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8ca545-03cd-42eb-95a2-2e70acdf1f59]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:41:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:41:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:41:22 user nova-compute[72150]: DEBUG os_brick.utils [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:41:22 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Updating existing volume attachment record: d20181cb-2c51-4910-9721-0642c6ae38e8 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:41:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:24 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915269.9018097, ea68420b-8362-4df3-b710-cd1cf76adba0 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:41:24 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] VM Stopped (Lifecycle Event)
Aug 01 18:41:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:24 user nova-compute[72150]: DEBUG nova.compute.manager [None req-2c88d27a-fe98-4736-b560-5318c7167bca None None] [instance: ea68420b-8362-4df3-b710-cd1cf76adba0] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:41:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mkUFBwHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:41:30 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:41:30 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:41:30 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e6ea3b-df32-41b5-a337-74fcf9dd395b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:41:30 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f15d838-c72b-4ffc-adb3-82cce432aed9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7] added
Aug 01 18:41:30 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5e6e26-b02f-4f76-a9ff-01cf64a3c9d0]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42b7318-59ec-41c5-a6db-ac3c7f7b0614]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mkUFBwHD {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mkUFBwHD" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddee4a63-3d92-41a6-83b0-0459d38a6086]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mkUFBwHD'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7eb4a1-7536-4cd0-8ca0-2a67f8bcd1c1]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1147c244-8747-410a-8b0a-54b77fdd39ac]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:41:30 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:41:30 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:41:30 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:41:30 user nova-compute[72150]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 (non-flash)
Aug 01 18:41:30 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:41:30 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:41:30 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:41:30 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:41:30 user nova-compute[72150]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 (non-flash)
Aug 01 18:41:30 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[97685f96-1e57-4e6f-a2c6-ad22a2aa350b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7, portal: 172.16.0.220,3260]
Aug 01 18:41:30 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7, portal: 172.16.0.220,3260] successful.
Aug 01 18:41:30 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc28f78-6e87-4986-bf4f-39d489ed7f62]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e648b81b-0c29-4246-850c-b8afe14b338f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:41:30 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:41:30 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:41:30 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:41:30 user nova-compute[72150]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 (non-flash)
Aug 01 18:41:30 user nova-compute[72150]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 (non-flash)
Aug 01 18:41:30 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:41:30 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:41:30 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:41:30 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:41:30 user nova-compute[72150]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 (non-flash)
Aug 01 18:41:30 user nova-compute[72150]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 (non-flash)
Aug 01 18:41:30 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[976b6906-bd59-4fa3-8ae0-839b991125c5]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:41:30 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mkUFBwHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:41:31 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:41:31 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23430646536663266', 'path': '/dev/sde'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:41:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430646536663266', 'path': '/dev/sde'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:41:31 user nova-compute[72150]: DEBUG nova.objects.instance [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lazy-loading 'flavor' on Instance uuid 0c6f0595-d475-48c9-8726-cffcdb047b2d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:41:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:41:31 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:41:31 user nova-compute[72150]:   <source dev="/dev/sde"/>
Aug 01 18:41:31 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:41:31 user nova-compute[72150]:   <serial>f896c9fd-9ddb-4058-aaee-b6b0674b45b7</serial>
Aug 01 18:41:31 user nova-compute[72150]: </disk>
Aug 01 18:41:31 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:41:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:41:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:41:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] No VIF found with MAC fa:16:3e:76:17:26, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:41:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bb6d9565-4170-4713-9cd5-eca47258cefc tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "0c6f0595-d475-48c9-8726-cffcdb047b2d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.045s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "0c6f0595-d475-48c9-8726-cffcdb047b2d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "0c6f0595-d475-48c9-8726-cffcdb047b2d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:33 user nova-compute[72150]: INFO nova.compute.manager [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Detaching volume f896c9fd-9ddb-4058-aaee-b6b0674b45b7
Aug 01 18:41:33 user nova-compute[72150]: INFO nova.virt.block_device [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Attempting to driver detach volume f896c9fd-9ddb-4058-aaee-b6b0674b45b7 from mountpoint /dev/vdb
Aug 01 18:41:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Attempting to detach device vdb from instance 0c6f0595-d475-48c9-8726-cffcdb047b2d from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:41:33 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:41:33 user nova-compute[72150]:   <source dev="/dev/sde"/>
Aug 01 18:41:33 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:41:33 user nova-compute[72150]:   <serial>f896c9fd-9ddb-4058-aaee-b6b0674b45b7</serial>
Aug 01 18:41:33 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:41:33 user nova-compute[72150]: </disk>
Aug 01 18:41:33 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:41:33 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Successfully detached device vdb from instance 0c6f0595-d475-48c9-8726-cffcdb047b2d from the persistent domain config.
Aug 01 18:41:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0c6f0595-d475-48c9-8726-cffcdb047b2d from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:41:33 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:41:33 user nova-compute[72150]:   <source dev="/dev/sde"/>
Aug 01 18:41:33 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:41:33 user nova-compute[72150]:   <serial>f896c9fd-9ddb-4058-aaee-b6b0674b45b7</serial>
Aug 01 18:41:33 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:41:33 user nova-compute[72150]: </disk>
Aug 01 18:41:33 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690915293.638256, 0c6f0595-d475-48c9-8726-cffcdb047b2d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0c6f0595-d475-48c9-8726-cffcdb047b2d {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:41:33 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Successfully detached device vdb from instance 0c6f0595-d475-48c9-8726-cffcdb047b2d from the live domain config.
Aug 01 18:41:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mkUFBwHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:41:33 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:41:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[915afb6c-65a2-420d-b6cd-ced19b0f77c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1283ec05-a39d-4fae-96eb-1d44e06b54e0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:41:33 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:41:33 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:41:33 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:41:33 user nova-compute[72150]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 (non-flash)
Aug 01 18:41:33 user nova-compute[72150]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 (non-flash)
Aug 01 18:41:33 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:41:33 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:41:33 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:41:33 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:41:33 user nova-compute[72150]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 (non-flash)
Aug 01 18:41:33 user nova-compute[72150]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 (non-flash)
Aug 01 18:41:33 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c3c3370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7'): ({'sde'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Removing single pathed devices sde {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[42867b1c-1898-4d13-a44d-ecf08efbec1e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9562193e-a3c9-4ec4-b20f-4ddfc2369bc7]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Flushing IO for device /dev/sde {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[facfa675-0fe4-4ead-8cb5-1f4c8723ada1]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de63717-fbf8-4db2-96c6-e256bcf92558]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] SCSI volumes sde have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.145s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cddc71-5d64-4367-b865-c22b30540092]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:41:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dda9db1-11d6-4432-9cec-6d45ffee5c21]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7, portal: 172.16.0.220,3260]
Aug 01 18:41:34 user nova-compute[72150]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7, portal: 172.16.0.220,3260] successful.
Aug 01 18:41:34 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:41:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f896c9fd-9ddb-4058-aaee-b6b0674b45b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbedf9a-f058-4cac-9c12-237d94fc79fa]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:41:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.433s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:41:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] <== disconnect_volume: return (434ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:41:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:41:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:34 user nova-compute[72150]: DEBUG nova.objects.instance [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lazy-loading 'flavor' on Instance uuid 0c6f0595-d475-48c9-8726-cffcdb047b2d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:41:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a4f71620-a9c5-4651-b73f-f9a5db70756a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "0c6f0595-d475-48c9-8726-cffcdb047b2d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.715s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:36 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:41:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquiring lock "07213597-fa7a-4422-956a-1b02737cc647" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "07213597-fa7a-4422-956a-1b02737cc647" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:41 user nova-compute[72150]: INFO nova.compute.manager [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Unshelving
Aug 01 18:41:41 user nova-compute[72150]: INFO nova.virt.block_device [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Booting with volume c747e83a-c5db-4737-a028-fd1e6024fe77 at /dev/vda
Aug 01 18:41:41 user nova-compute[72150]: DEBUG os_brick.utils [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cf255e-8a8e-4b4f-ad9c-3dbfa583bea7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12f03ad-94c5-4a60-98dd-c802807d8c9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6cfeb5-a18d-4fb3-bcee-1e71795fd841]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f982fe34-6684-4b73-a199-ee8a95836add]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:41:41 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:41:41 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[510229f7-cb9a-4263-8358-950d97d5ccef]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG os_brick.utils [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Updating existing volume attachment record: 24b28bea-2aa3-4fd3-a8ee-c0c925034c4c {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:41:41 user nova-compute[72150]: INFO nova.compute.manager [None req-1402f79d-40e2-4f82-aa61-d8a6788ecd9a tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Unrescuing
Aug 01 18:41:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1402f79d-40e2-4f82-aa61-d8a6788ecd9a tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "refresh_cache-316953c9-42a9-4598-9385-0c138415ea6f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1402f79d-40e2-4f82-aa61-d8a6788ecd9a tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquired lock "refresh_cache-316953c9-42a9-4598-9385-0c138415ea6f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:41:41 user nova-compute[72150]: DEBUG nova.network.neutron [None req-1402f79d-40e2-4f82-aa61-d8a6788ecd9a tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:41:42 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:41:42 user nova-compute[72150]: DEBUG nova.network.neutron [None req-1402f79d-40e2-4f82-aa61-d8a6788ecd9a tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Updating instance_info_cache with network_info: [{"id": "ed51a469-3095-4679-b038-c18153c8f95e", "address": "fa:16:3e:13:9f:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped51a469-30", "ovs_interfaceid": "ed51a469-3095-4679-b038-c18153c8f95e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:41:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1402f79d-40e2-4f82-aa61-d8a6788ecd9a tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Releasing lock "refresh_cache-316953c9-42a9-4598-9385-0c138415ea6f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:41:42 user nova-compute[72150]: DEBUG nova.objects.instance [None req-1402f79d-40e2-4f82-aa61-d8a6788ecd9a tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'flavor' on Instance uuid 316953c9-42a9-4598-9385-0c138415ea6f {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:41:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:43 user nova-compute[72150]: DEBUG nova.compute.manager [req-1da090d1-0de8-47eb-afbe-0f5e3078c9b1 req-867b84c0-b6c5-45b2-a4e9-7ab0cd5d34cd service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received event network-vif-unplugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:41:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1da090d1-0de8-47eb-afbe-0f5e3078c9b1 req-867b84c0-b6c5-45b2-a4e9-7ab0cd5d34cd service nova] Acquiring lock "316953c9-42a9-4598-9385-0c138415ea6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1da090d1-0de8-47eb-afbe-0f5e3078c9b1 req-867b84c0-b6c5-45b2-a4e9-7ab0cd5d34cd service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1da090d1-0de8-47eb-afbe-0f5e3078c9b1 req-867b84c0-b6c5-45b2-a4e9-7ab0cd5d34cd service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:43 user nova-compute[72150]: DEBUG nova.compute.manager [req-1da090d1-0de8-47eb-afbe-0f5e3078c9b1 req-867b84c0-b6c5-45b2-a4e9-7ab0cd5d34cd service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] No waiting events found dispatching network-vif-unplugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:41:43 user nova-compute[72150]: WARNING nova.compute.manager [req-1da090d1-0de8-47eb-afbe-0f5e3078c9b1 req-867b84c0-b6c5-45b2-a4e9-7ab0cd5d34cd service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received unexpected event network-vif-unplugged-ed51a469-3095-4679-b038-c18153c8f95e for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:41:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:43 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Instance destroyed successfully.
Aug 01 18:41:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:43 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:41:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:44 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:41:44 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:41:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:44 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:41:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] Acquiring lock "316953c9-42a9-4598-9385-0c138415ea6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] No waiting events found dispatching network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:41:45 user nova-compute[72150]: WARNING nova.compute.manager [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received unexpected event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:41:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] Acquiring lock "316953c9-42a9-4598-9385-0c138415ea6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] No waiting events found dispatching network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:41:45 user nova-compute[72150]: WARNING nova.compute.manager [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received unexpected event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:41:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] Acquiring lock "316953c9-42a9-4598-9385-0c138415ea6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] No waiting events found dispatching network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:41:45 user nova-compute[72150]: WARNING nova.compute.manager [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received unexpected event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:41:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received event network-vif-unplugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] Acquiring lock "316953c9-42a9-4598-9385-0c138415ea6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] No waiting events found dispatching network-vif-unplugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:41:45 user nova-compute[72150]: WARNING nova.compute.manager [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received unexpected event network-vif-unplugged-ed51a469-3095-4679-b038-c18153c8f95e for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:41:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] Acquiring lock "316953c9-42a9-4598-9385-0c138415ea6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] No waiting events found dispatching network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:41:45 user nova-compute[72150]: WARNING nova.compute.manager [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received unexpected event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:41:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] Acquiring lock "316953c9-42a9-4598-9385-0c138415ea6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] No waiting events found dispatching network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:41:45 user nova-compute[72150]: WARNING nova.compute.manager [req-ca3e21c4-ae91-4358-b0ba-34d24eccef81 req-735dab78-395d-4f0d-8747-fedd1dcf794d service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received unexpected event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:41:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:41:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:41:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:41:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:41:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-9205d1b6-40a6-4683-a059-8d53e96f459f req-ad30912e-38c9-49c6-9562-699a83bf7d18 service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9205d1b6-40a6-4683-a059-8d53e96f459f req-ad30912e-38c9-49c6-9562-699a83bf7d18 service nova] Acquiring lock "316953c9-42a9-4598-9385-0c138415ea6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9205d1b6-40a6-4683-a059-8d53e96f459f req-ad30912e-38c9-49c6-9562-699a83bf7d18 service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9205d1b6-40a6-4683-a059-8d53e96f459f req-ad30912e-38c9-49c6-9562-699a83bf7d18 service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-9205d1b6-40a6-4683-a059-8d53e96f459f req-ad30912e-38c9-49c6-9562-699a83bf7d18 service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] No waiting events found dispatching network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:41:47 user nova-compute[72150]: WARNING nova.compute.manager [req-9205d1b6-40a6-4683-a059-8d53e96f459f req-ad30912e-38c9-49c6-9562-699a83bf7d18 service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received unexpected event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e for instance with vm_state rescued and task_state unrescuing.
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Removed pending event for 316953c9-42a9-4598-9385-0c138415ea6f due to event {{(pid=72150) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915307.2623816, 316953c9-42a9-4598-9385-0c138415ea6f => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:41:47 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] VM Resumed (Lifecycle Event)
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-1402f79d-40e2-4f82-aa61-d8a6788ecd9a tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:41:47 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:41:47 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=7616MB free_disk=25.198963165283203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:41:47 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915307.2632701, 316953c9-42a9-4598-9385-0c138415ea6f => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:41:47 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] VM Started (Lifecycle Event)
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 769690c8-53c5-4057-88a5-fbdbcb930e32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 08851ec4-6f71-4ec1-a092-42aab83ee87f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance bf2d1f14-2227-41d1-bd73-a05ab3149aba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 42e75a98-beb1-4688-a375-affc63b14252 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance d2117837-5552-4ec3-9f9b-62629c1ff4cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 737a8853-f9b9-4a0b-95a1-200d72c4d806 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 316953c9-42a9-4598-9385-0c138415ea6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 0c6f0595-d475-48c9-8726-cffcdb047b2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 6bf4d051-455d-4bd8-b9b0-4f9e4082901f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 07213597-fa7a-4422-956a-1b02737cc647 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:41:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:41:48 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:41:48 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:41:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:41:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:50 user nova-compute[72150]: DEBUG nova.objects.instance [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lazy-loading 'pci_requests' on Instance uuid 07213597-fa7a-4422-956a-1b02737cc647 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:41:50 user nova-compute[72150]: DEBUG nova.objects.instance [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lazy-loading 'numa_topology' on Instance uuid 07213597-fa7a-4422-956a-1b02737cc647 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:41:50 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:41:50 user nova-compute[72150]: INFO nova.compute.claims [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Claim successful on node user
Aug 01 18:41:50 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:41:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:41:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-bf2d1f14-2227-41d1-bd73-a05ab3149aba" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:41:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-bf2d1f14-2227-41d1-bd73-a05ab3149aba" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:41:50 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:41:50 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:41:50 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:41:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:50 user nova-compute[72150]: INFO nova.network.neutron [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Updating port b9e510dc-94be-4362-b3a8-4d68f1f769f3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 18:41:50 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Updating instance_info_cache with network_info: [{"id": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "address": "fa:16:3e:63:c8:50", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41eb682d-9c", "ovs_interfaceid": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:41:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-bf2d1f14-2227-41d1-bd73-a05ab3149aba" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:41:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:41:50 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:41:50 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:41:50 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:41:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquiring lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquired lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.network.neutron [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-dd4773ad-5e8d-4a30-8ecd-d7018e5ab714 req-a4a3ed28-ce05-4d6d-8c23-c42f0e13c7e3 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Received event network-changed-b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-dd4773ad-5e8d-4a30-8ecd-d7018e5ab714 req-a4a3ed28-ce05-4d6d-8c23-c42f0e13c7e3 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Refreshing instance network info cache due to event network-changed-b9e510dc-94be-4362-b3a8-4d68f1f769f3. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-dd4773ad-5e8d-4a30-8ecd-d7018e5ab714 req-a4a3ed28-ce05-4d6d-8c23-c42f0e13c7e3 service nova] Acquiring lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.network.neutron [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Updating instance_info_cache with network_info: [{"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e510dc-94", "ovs_interfaceid": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Releasing lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:41:51 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Creating image(s)
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Did not create local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Ensure instance console log exists: /opt/stack/data/nova/instances/07213597-fa7a-4422-956a-1b02737cc647/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Start _get_guest_xml network_info=[{"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e510dc-94", "ovs_interfaceid": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '24b28bea-2aa3-4fd3-a8ee-c0c925034c4c', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdAEYcHK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '07213597-fa7a-4422-956a-1b02737cc647', 'attached_at': '', 'detached_at': '', 'volume_id': 'c747e83a-c5db-4737-a028-fd1e6024fe77', 'serial': 'c747e83a-c5db-4737-a028-fd1e6024fe77'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-dd4773ad-5e8d-4a30-8ecd-d7018e5ab714 req-a4a3ed28-ce05-4d6d-8c23-c42f0e13c7e3 service nova] Acquired lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.network.neutron [req-dd4773ad-5e8d-4a30-8ecd-d7018e5ab714 req-a4a3ed28-ce05-4d6d-8c23-c42f0e13c7e3 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Refreshing network info cache for port b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:41:51 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:41:51 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.objects.instance [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lazy-loading 'vcpu_model' on Instance uuid 07213597-fa7a-4422-956a-1b02737cc647 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdAEYcHK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:41:51 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:41:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:41:51 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:41:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:41:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:41:51 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:41:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[818d026d-defb-4007-a956-d8143b446087]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:41:52 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedf8855-31a9-4dc3-9544-82b69846ce64]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77] added
Aug 01 18:41:52 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28f9a7a-1c9e-48cd-a47e-4fb37077a792]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[939842c6-06af-4103-a37c-6305fdb8ff7a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IdAEYcHK {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IdAEYcHK" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[337e2a1c-5783-47eb-af7c-3495c1c7d6ff]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IdAEYcHK'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9dd1086-5638-4bd4-804f-0eb69467f4a0]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ea75f2-fb0a-49bc-b1b9-c10a29b170f6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:41:52 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:41:52 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:41:52 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:41:52 user nova-compute[72150]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 (non-flash)
Aug 01 18:41:52 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:41:52 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:41:52 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:41:52 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:41:52 user nova-compute[72150]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 (non-flash)
Aug 01 18:41:52 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e841bee-7005-4999-a6cc-6a17b1594c2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77, portal: 172.16.0.220,3260]
Aug 01 18:41:52 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77, portal: 172.16.0.220,3260] successful.
Aug 01 18:41:52 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26db328-f728-4dc8-9404-dafe437a6b35]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4a69a9-b040-4874-8bdc-9228a10bcc9f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:41:52 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:41:52 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:41:52 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:41:52 user nova-compute[72150]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 (non-flash)
Aug 01 18:41:52 user nova-compute[72150]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:41:52 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:41:52 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:41:52 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:41:52 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:41:52 user nova-compute[72150]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 (non-flash)
Aug 01 18:41:52 user nova-compute[72150]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:41:52 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[be141b60-7146-4b67-8b7b-a70cca255dbd]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdAEYcHK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG nova.network.neutron [req-dd4773ad-5e8d-4a30-8ecd-d7018e5ab714 req-a4a3ed28-ce05-4d6d-8c23-c42f0e13c7e3 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Updated VIF entry in instance network info cache for port b9e510dc-94be-4362-b3a8-4d68f1f769f3. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG nova.network.neutron [req-dd4773ad-5e8d-4a30-8ecd-d7018e5ab714 req-a4a3ed28-ce05-4d6d-8c23-c42f0e13c7e3 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Updating instance_info_cache with network_info: [{"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e510dc-94", "ovs_interfaceid": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:41:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-dd4773ad-5e8d-4a30-8ecd-d7018e5ab714 req-a4a3ed28-ce05-4d6d-8c23-c42f0e13c7e3 service nova] Releasing lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:41:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:41:53 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23663656665363663', 'path': '/dev/sde'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:41:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663656665363663', 'path': '/dev/sde'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:41:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T18:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-691830454',display_name='tempest-TestShelveInstance-server-691830454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-691830454',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-873495065',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:38:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='96ebdfa1a1d744989c2ae19afba252a2',ramdisk_id='',reservation_id='r-0wlnrl2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-359406348',owner_user_name='tempest-TestShelveInstance-359406348-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:41:42Z,user_data=None,user_id='3e19b7bbe9bf473f8ce8d121dcaf5e35',uuid=07213597-fa7a-4422-956a-1b02737cc647,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e510dc-94", "ovs_interfaceid": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:41:53 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Converting VIF {"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e510dc-94", "ovs_interfaceid": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:41:53 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:2f:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9e510dc-94be-4362-b3a8-4d68f1f769f3,network=Network(ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e510dc-94') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:41:53 user nova-compute[72150]: DEBUG nova.objects.instance [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lazy-loading 'pci_devices' on Instance uuid 07213597-fa7a-4422-956a-1b02737cc647 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:41:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:41:53 user nova-compute[72150]:   <uuid>07213597-fa7a-4422-956a-1b02737cc647</uuid>
Aug 01 18:41:53 user nova-compute[72150]:   <name>instance-00000023</name>
Aug 01 18:41:53 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:41:53 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:41:53 user nova-compute[72150]:   <metadata>
Aug 01 18:41:53 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:41:53 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:41:53 user nova-compute[72150]:       <nova:name>tempest-TestShelveInstance-server-691830454</nova:name>
Aug 01 18:41:53 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:41:51</nova:creationTime>
Aug 01 18:41:53 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:41:53 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:41:53 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:41:53 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:41:53 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:41:53 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:41:53 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:41:53 user nova-compute[72150]:       <nova:owner>
Aug 01 18:41:53 user nova-compute[72150]:         <nova:user uuid="3e19b7bbe9bf473f8ce8d121dcaf5e35">tempest-TestShelveInstance-359406348-project-member</nova:user>
Aug 01 18:41:53 user nova-compute[72150]:         <nova:project uuid="96ebdfa1a1d744989c2ae19afba252a2">tempest-TestShelveInstance-359406348</nova:project>
Aug 01 18:41:53 user nova-compute[72150]:       </nova:owner>
Aug 01 18:41:53 user nova-compute[72150]:       <nova:ports>
Aug 01 18:41:53 user nova-compute[72150]:         <nova:port uuid="b9e510dc-94be-4362-b3a8-4d68f1f769f3">
Aug 01 18:41:53 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 18:41:53 user nova-compute[72150]:         </nova:port>
Aug 01 18:41:53 user nova-compute[72150]:       </nova:ports>
Aug 01 18:41:53 user nova-compute[72150]:     </nova:instance>
Aug 01 18:41:53 user nova-compute[72150]:   </metadata>
Aug 01 18:41:53 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:41:53 user nova-compute[72150]:     <system>
Aug 01 18:41:53 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:41:53 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:41:53 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:41:53 user nova-compute[72150]:       <entry name="serial">07213597-fa7a-4422-956a-1b02737cc647</entry>
Aug 01 18:41:53 user nova-compute[72150]:       <entry name="uuid">07213597-fa7a-4422-956a-1b02737cc647</entry>
Aug 01 18:41:53 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:41:53 user nova-compute[72150]:     </system>
Aug 01 18:41:53 user nova-compute[72150]:   </sysinfo>
Aug 01 18:41:53 user nova-compute[72150]:   <os>
Aug 01 18:41:53 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:41:53 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:41:53 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:41:53 user nova-compute[72150]:   </os>
Aug 01 18:41:53 user nova-compute[72150]:   <features>
Aug 01 18:41:53 user nova-compute[72150]:     <acpi/>
Aug 01 18:41:53 user nova-compute[72150]:     <apic/>
Aug 01 18:41:53 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:41:53 user nova-compute[72150]:   </features>
Aug 01 18:41:53 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:41:53 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:41:53 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:41:53 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:41:53 user nova-compute[72150]:   </clock>
Aug 01 18:41:53 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:41:53 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:41:53 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:41:53 user nova-compute[72150]:   </cpu>
Aug 01 18:41:53 user nova-compute[72150]:   <devices>
Aug 01 18:41:53 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:41:53 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:41:53 user nova-compute[72150]:       <source dev="/dev/sde"/>
Aug 01 18:41:53 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:41:53 user nova-compute[72150]:       <serial>c747e83a-c5db-4737-a028-fd1e6024fe77</serial>
Aug 01 18:41:53 user nova-compute[72150]:     </disk>
Aug 01 18:41:53 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:41:53 user nova-compute[72150]:       <mac address="fa:16:3e:3c:2f:8e"/>
Aug 01 18:41:53 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:41:53 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:41:53 user nova-compute[72150]:       <target dev="tapb9e510dc-94"/>
Aug 01 18:41:53 user nova-compute[72150]:     </interface>
Aug 01 18:41:53 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:41:53 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/07213597-fa7a-4422-956a-1b02737cc647/console.log" append="off"/>
Aug 01 18:41:53 user nova-compute[72150]:     </serial>
Aug 01 18:41:53 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:41:53 user nova-compute[72150]:     <video>
Aug 01 18:41:53 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:41:53 user nova-compute[72150]:     </video>
Aug 01 18:41:53 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:41:53 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:41:53 user nova-compute[72150]:     </rng>
Aug 01 18:41:53 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:41:53 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:41:53 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:41:53 user nova-compute[72150]:     </memballoon>
Aug 01 18:41:53 user nova-compute[72150]:   </devices>
Aug 01 18:41:53 user nova-compute[72150]: </domain>
Aug 01 18:41:53 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:41:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T18:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-691830454',display_name='tempest-TestShelveInstance-server-691830454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-691830454',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-873495065',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:38:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='96ebdfa1a1d744989c2ae19afba252a2',ramdisk_id='',reservation_id='r-0wlnrl2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-359406348',owner_user_name='tempest-TestShelveInstance-359406348-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:41:42Z,user_data=None,user_id='3e19b7bbe9bf473f8ce8d121dcaf5e35',uuid=07213597-fa7a-4422-956a-1b02737cc647,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e510dc-94", "ovs_interfaceid": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:41:53 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Converting VIF {"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e510dc-94", "ovs_interfaceid": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:41:53 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:2f:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9e510dc-94be-4362-b3a8-4d68f1f769f3,network=Network(ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e510dc-94') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:41:53 user nova-compute[72150]: DEBUG os_vif [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:2f:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9e510dc-94be-4362-b3a8-4d68f1f769f3,network=Network(ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e510dc-94') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:41:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:41:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:41:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9e510dc-94, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:41:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb9e510dc-94, col_values=(('external_ids', {'iface-id': 'b9e510dc-94be-4362-b3a8-4d68f1f769f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:2f:8e', 'vm-uuid': '07213597-fa7a-4422-956a-1b02737cc647'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:41:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:41:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:53 user nova-compute[72150]: INFO os_vif [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:2f:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9e510dc-94be-4362-b3a8-4d68f1f769f3,network=Network(ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e510dc-94')
Aug 01 18:41:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:41:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] No VIF found with MAC fa:16:3e:3c:2f:8e, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:41:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:54 user nova-compute[72150]: DEBUG nova.compute.manager [req-0f1e9ab6-d57b-448b-aa36-ba763f0e1b0d req-1e577c5e-c00f-44de-b82f-b4cc0727bf1b service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Received event network-vif-plugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:41:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0f1e9ab6-d57b-448b-aa36-ba763f0e1b0d req-1e577c5e-c00f-44de-b82f-b4cc0727bf1b service nova] Acquiring lock "07213597-fa7a-4422-956a-1b02737cc647-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0f1e9ab6-d57b-448b-aa36-ba763f0e1b0d req-1e577c5e-c00f-44de-b82f-b4cc0727bf1b service nova] Lock "07213597-fa7a-4422-956a-1b02737cc647-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0f1e9ab6-d57b-448b-aa36-ba763f0e1b0d req-1e577c5e-c00f-44de-b82f-b4cc0727bf1b service nova] Lock "07213597-fa7a-4422-956a-1b02737cc647-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:54 user nova-compute[72150]: DEBUG nova.compute.manager [req-0f1e9ab6-d57b-448b-aa36-ba763f0e1b0d req-1e577c5e-c00f-44de-b82f-b4cc0727bf1b service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] No waiting events found dispatching network-vif-plugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:41:54 user nova-compute[72150]: WARNING nova.compute.manager [req-0f1e9ab6-d57b-448b-aa36-ba763f0e1b0d req-1e577c5e-c00f-44de-b82f-b4cc0727bf1b service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Received unexpected event network-vif-plugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 18:41:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:56 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915316.7848206, 07213597-fa7a-4422-956a-1b02737cc647 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:41:56 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 07213597-fa7a-4422-956a-1b02737cc647] VM Resumed (Lifecycle Event)
Aug 01 18:41:56 user nova-compute[72150]: DEBUG nova.compute.manager [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:41:56 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:41:56 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:41:56 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Instance spawned successfully.
Aug 01 18:41:56 user nova-compute[72150]: DEBUG nova.compute.manager [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:41:56 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:41:56 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 07213597-fa7a-4422-956a-1b02737cc647] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:41:56 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915316.7854972, 07213597-fa7a-4422-956a-1b02737cc647 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:41:56 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 07213597-fa7a-4422-956a-1b02737cc647] VM Started (Lifecycle Event)
Aug 01 18:41:56 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:41:56 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:41:56 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 07213597-fa7a-4422-956a-1b02737cc647] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:41:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-54bf54a0-eef6-4567-9702-c69d015b0353 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "07213597-fa7a-4422-956a-1b02737cc647" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.234s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-5f0b913b-081d-4969-8afc-cedc97089152 req-8241ae1c-bd06-4fcf-bb67-08a2bde02961 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Received event network-vif-plugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:41:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5f0b913b-081d-4969-8afc-cedc97089152 req-8241ae1c-bd06-4fcf-bb67-08a2bde02961 service nova] Acquiring lock "07213597-fa7a-4422-956a-1b02737cc647-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5f0b913b-081d-4969-8afc-cedc97089152 req-8241ae1c-bd06-4fcf-bb67-08a2bde02961 service nova] Lock "07213597-fa7a-4422-956a-1b02737cc647-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5f0b913b-081d-4969-8afc-cedc97089152 req-8241ae1c-bd06-4fcf-bb67-08a2bde02961 service nova] Lock "07213597-fa7a-4422-956a-1b02737cc647-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-5f0b913b-081d-4969-8afc-cedc97089152 req-8241ae1c-bd06-4fcf-bb67-08a2bde02961 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] No waiting events found dispatching network-vif-plugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:41:57 user nova-compute[72150]: WARNING nova.compute.manager [req-5f0b913b-081d-4969-8afc-cedc97089152 req-8241ae1c-bd06-4fcf-bb67-08a2bde02961 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Received unexpected event network-vif-plugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 for instance with vm_state active and task_state None.
Aug 01 18:41:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-3aee0c09-0127-4b2f-82ec-b2264308a8ea req-0e4a0502-fec6-46b3-8a6a-28ce3f537ebc service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Received event network-changed-6b6df9a4-874c-4b35-bc04-beda6938aedb {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:41:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-3aee0c09-0127-4b2f-82ec-b2264308a8ea req-0e4a0502-fec6-46b3-8a6a-28ce3f537ebc service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Refreshing instance network info cache due to event network-changed-6b6df9a4-874c-4b35-bc04-beda6938aedb. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:41:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3aee0c09-0127-4b2f-82ec-b2264308a8ea req-0e4a0502-fec6-46b3-8a6a-28ce3f537ebc service nova] Acquiring lock "refresh_cache-6bf4d051-455d-4bd8-b9b0-4f9e4082901f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:41:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3aee0c09-0127-4b2f-82ec-b2264308a8ea req-0e4a0502-fec6-46b3-8a6a-28ce3f537ebc service nova] Acquired lock "refresh_cache-6bf4d051-455d-4bd8-b9b0-4f9e4082901f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:41:57 user nova-compute[72150]: DEBUG nova.network.neutron [req-3aee0c09-0127-4b2f-82ec-b2264308a8ea req-0e4a0502-fec6-46b3-8a6a-28ce3f537ebc service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Refreshing network info cache for port 6b6df9a4-874c-4b35-bc04-beda6938aedb {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:41:57 user nova-compute[72150]: DEBUG nova.network.neutron [req-3aee0c09-0127-4b2f-82ec-b2264308a8ea req-0e4a0502-fec6-46b3-8a6a-28ce3f537ebc service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Updated VIF entry in instance network info cache for port 6b6df9a4-874c-4b35-bc04-beda6938aedb. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:41:57 user nova-compute[72150]: DEBUG nova.network.neutron [req-3aee0c09-0127-4b2f-82ec-b2264308a8ea req-0e4a0502-fec6-46b3-8a6a-28ce3f537ebc service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Updating instance_info_cache with network_info: [{"id": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "address": "fa:16:3e:4c:29:fe", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6df9a4-87", "ovs_interfaceid": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:41:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3aee0c09-0127-4b2f-82ec-b2264308a8ea req-0e4a0502-fec6-46b3-8a6a-28ce3f537ebc service nova] Releasing lock "refresh_cache-6bf4d051-455d-4bd8-b9b0-4f9e4082901f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:41:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "6bf4d051-455d-4bd8-b9b0-4f9e4082901f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "6bf4d051-455d-4bd8-b9b0-4f9e4082901f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "6bf4d051-455d-4bd8-b9b0-4f9e4082901f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "6bf4d051-455d-4bd8-b9b0-4f9e4082901f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "6bf4d051-455d-4bd8-b9b0-4f9e4082901f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:58 user nova-compute[72150]: INFO nova.compute.manager [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Terminating instance
Aug 01 18:41:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:41:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-9d8cf5ea-134e-4365-a66b-e9cd8c3223d8 req-286fafda-b2fd-4ed8-98ed-7efe11c5df69 service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Received event network-changed-6b6df9a4-874c-4b35-bc04-beda6938aedb {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-9d8cf5ea-134e-4365-a66b-e9cd8c3223d8 req-286fafda-b2fd-4ed8-98ed-7efe11c5df69 service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Refreshing instance network info cache due to event network-changed-6b6df9a4-874c-4b35-bc04-beda6938aedb. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9d8cf5ea-134e-4365-a66b-e9cd8c3223d8 req-286fafda-b2fd-4ed8-98ed-7efe11c5df69 service nova] Acquiring lock "refresh_cache-6bf4d051-455d-4bd8-b9b0-4f9e4082901f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9d8cf5ea-134e-4365-a66b-e9cd8c3223d8 req-286fafda-b2fd-4ed8-98ed-7efe11c5df69 service nova] Acquired lock "refresh_cache-6bf4d051-455d-4bd8-b9b0-4f9e4082901f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG nova.network.neutron [req-9d8cf5ea-134e-4365-a66b-e9cd8c3223d8 req-286fafda-b2fd-4ed8-98ed-7efe11c5df69 service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Refreshing network info cache for port 6b6df9a4-874c-4b35-bc04-beda6938aedb {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:41:59 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Instance destroyed successfully.
Aug 01 18:41:59 user nova-compute[72150]: DEBUG nova.objects.instance [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lazy-loading 'resources' on Instance uuid 6bf4d051-455d-4bd8-b9b0-4f9e4082901f {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1080443909',display_name='tempest-TestVolumeBootPattern-server-1080443909',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1080443909',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVf3lHt050k356A8Gut9WieNqP8u9vIp5xdHm1rq7ONC5kHGtGA6mBo7SyXu2T5UgJrBcaDoeDkrLO73m2dxgj5g1F2RdpTy7mOLuxRD5SR618gGiTwTven5q6qp8rd8g==',key_name='tempest-TestVolumeBootPattern-35567601',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:40:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7ca44f23b114893afcfe57c52f693b1',ramdisk_id='',reservation_id='r-ypv11gsz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-295340968',owner_user_name='tempest-TestVolumeBootPattern-295340968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:40:20Z,user_data=None,user_id='92c7ef0ed6814f8880de76adb913a487',uuid=6bf4d051-455d-4bd8-b9b0-4f9e4082901f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "address": "fa:16:3e:4c:29:fe", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6df9a4-87", "ovs_interfaceid": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converting VIF {"id": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "address": "fa:16:3e:4c:29:fe", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6df9a4-87", "ovs_interfaceid": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:29:fe,bridge_name='br-int',has_traffic_filtering=True,id=6b6df9a4-874c-4b35-bc04-beda6938aedb,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6df9a4-87') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG os_vif [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:29:fe,bridge_name='br-int',has_traffic_filtering=True,id=6b6df9a4-874c-4b35-bc04-beda6938aedb,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6df9a4-87') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b6df9a4-87, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-321ec09c-546b-4b9f-bbe1-1a05b4a2985a req-bba18ddf-eb9f-4d6d-bc52-b81e1695b638 service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Received event network-vif-unplugged-6b6df9a4-874c-4b35-bc04-beda6938aedb {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-321ec09c-546b-4b9f-bbe1-1a05b4a2985a req-bba18ddf-eb9f-4d6d-bc52-b81e1695b638 service nova] Acquiring lock "6bf4d051-455d-4bd8-b9b0-4f9e4082901f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-321ec09c-546b-4b9f-bbe1-1a05b4a2985a req-bba18ddf-eb9f-4d6d-bc52-b81e1695b638 service nova] Lock "6bf4d051-455d-4bd8-b9b0-4f9e4082901f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-321ec09c-546b-4b9f-bbe1-1a05b4a2985a req-bba18ddf-eb9f-4d6d-bc52-b81e1695b638 service nova] Lock "6bf4d051-455d-4bd8-b9b0-4f9e4082901f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-321ec09c-546b-4b9f-bbe1-1a05b4a2985a req-bba18ddf-eb9f-4d6d-bc52-b81e1695b638 service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] No waiting events found dispatching network-vif-unplugged-6b6df9a4-874c-4b35-bc04-beda6938aedb {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-321ec09c-546b-4b9f-bbe1-1a05b4a2985a req-bba18ddf-eb9f-4d6d-bc52-b81e1695b638 service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Received event network-vif-unplugged-6b6df9a4-874c-4b35-bc04-beda6938aedb for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-321ec09c-546b-4b9f-bbe1-1a05b4a2985a req-bba18ddf-eb9f-4d6d-bc52-b81e1695b638 service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Received event network-vif-plugged-6b6df9a4-874c-4b35-bc04-beda6938aedb {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-321ec09c-546b-4b9f-bbe1-1a05b4a2985a req-bba18ddf-eb9f-4d6d-bc52-b81e1695b638 service nova] Acquiring lock "6bf4d051-455d-4bd8-b9b0-4f9e4082901f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-321ec09c-546b-4b9f-bbe1-1a05b4a2985a req-bba18ddf-eb9f-4d6d-bc52-b81e1695b638 service nova] Lock "6bf4d051-455d-4bd8-b9b0-4f9e4082901f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-321ec09c-546b-4b9f-bbe1-1a05b4a2985a req-bba18ddf-eb9f-4d6d-bc52-b81e1695b638 service nova] Lock "6bf4d051-455d-4bd8-b9b0-4f9e4082901f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-321ec09c-546b-4b9f-bbe1-1a05b4a2985a req-bba18ddf-eb9f-4d6d-bc52-b81e1695b638 service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] No waiting events found dispatching network-vif-plugged-6b6df9a4-874c-4b35-bc04-beda6938aedb {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:41:59 user nova-compute[72150]: WARNING nova.compute.manager [req-321ec09c-546b-4b9f-bbe1-1a05b4a2985a req-bba18ddf-eb9f-4d6d-bc52-b81e1695b638 service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Received unexpected event network-vif-plugged-6b6df9a4-874c-4b35-bc04-beda6938aedb for instance with vm_state active and task_state deleting.
Aug 01 18:41:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:41:59 user nova-compute[72150]: INFO os_vif [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:29:fe,bridge_name='br-int',has_traffic_filtering=True,id=6b6df9a4-874c-4b35-bc04-beda6938aedb,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6df9a4-87')
Aug 01 18:41:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QSvyOMNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:41:59 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:41:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6faa56c-6a9e-41cd-acd9-2aadcd58a007]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4f47a2-fa8b-4bd2-9590-e35ab4d90614]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:41:59 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:41:59 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:41:59 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:41:59 user nova-compute[72150]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 (non-flash)
Aug 01 18:41:59 user nova-compute[72150]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:41:59 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:41:59 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:41:59 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:41:59 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:41:59 user nova-compute[72150]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 (non-flash)
Aug 01 18:41:59 user nova-compute[72150]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:41:59 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec5f12d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6'): ({'sdd'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Removing single pathed devices sdd {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf723be3-a291-44e5-9899-334e2056675d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7de8611-8cfa-46c5-881a-ef5c641457fd]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Flushing IO for device /dev/sdd {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0467787-f29e-46b6-8eba-e0309e1846a3]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.072s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7c42a7-3426-44e9-b7d7-3adb41a444c2]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] SCSI volumes sdd have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[929dd29a-5120-4e8e-970e-94022682f155]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[13276689-6fa0-4aa8-a9c7-735fad10abaf]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6, portal: 172.16.0.220,3260]
Aug 01 18:41:59 user nova-compute[72150]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6, portal: 172.16.0.220,3260] successful.
Aug 01 18:41:59 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5094cb61-74e8-4c85-84bd-a79a40d641f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c90076f-9ec6-4d42-b98d-5bfe5da4b833]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] <== disconnect_volume: return (349ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:41:59 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Deleting instance files /opt/stack/data/nova/instances/6bf4d051-455d-4bd8-b9b0-4f9e4082901f_del
Aug 01 18:41:59 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Deletion of /opt/stack/data/nova/instances/6bf4d051-455d-4bd8-b9b0-4f9e4082901f_del complete
Aug 01 18:41:59 user nova-compute[72150]: DEBUG nova.network.neutron [req-9d8cf5ea-134e-4365-a66b-e9cd8c3223d8 req-286fafda-b2fd-4ed8-98ed-7efe11c5df69 service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Updated VIF entry in instance network info cache for port 6b6df9a4-874c-4b35-bc04-beda6938aedb. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG nova.network.neutron [req-9d8cf5ea-134e-4365-a66b-e9cd8c3223d8 req-286fafda-b2fd-4ed8-98ed-7efe11c5df69 service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Updating instance_info_cache with network_info: [{"id": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "address": "fa:16:3e:4c:29:fe", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6df9a4-87", "ovs_interfaceid": "6b6df9a4-874c-4b35-bc04-beda6938aedb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "769690c8-53c5-4057-88a5-fbdbcb930e32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:41:59 user nova-compute[72150]: INFO nova.compute.manager [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Terminating instance
Aug 01 18:41:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9d8cf5ea-134e-4365-a66b-e9cd8c3223d8 req-286fafda-b2fd-4ed8-98ed-7efe11c5df69 service nova] Releasing lock "refresh_cache-6bf4d051-455d-4bd8-b9b0-4f9e4082901f" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:41:59 user nova-compute[72150]: INFO nova.compute.manager [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 01 18:41:59 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:41:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:00 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Instance destroyed successfully.
Aug 01 18:42:00 user nova-compute[72150]: DEBUG nova.objects.instance [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lazy-loading 'resources' on Instance uuid 769690c8-53c5-4057-88a5-fbdbcb930e32 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:42:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-101128963',display_name='tempest-ServerRescueNegativeTestJSON-server-101128963',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-101128963',id=12,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:29:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0b70fdffe9e414aa766f7c8f7a20d50',ramdisk_id='',reservation_id='r-mwkwhm7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2003578958',owner_user_name='tempest-ServerRescueNegativeTestJSON-2003578958-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:31:41Z,user_data=None,user_id='375cd4acff1646f4a5418fb012118600',uuid=769690c8-53c5-4057-88a5-fbdbcb930e32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "address": "fa:16:3e:8e:d7:75", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2596e33-c1", "ovs_interfaceid": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:42:00 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converting VIF {"id": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "address": "fa:16:3e:8e:d7:75", "network": {"id": "79fab4a5-51aa-4502-8f14-4222e52244d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-767839333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b70fdffe9e414aa766f7c8f7a20d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2596e33-c1", "ovs_interfaceid": "b2596e33-c1fc-42ae-ae83-524af44bbb0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:42:00 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:d7:75,bridge_name='br-int',has_traffic_filtering=True,id=b2596e33-c1fc-42ae-ae83-524af44bbb0a,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2596e33-c1') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:42:00 user nova-compute[72150]: DEBUG os_vif [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:d7:75,bridge_name='br-int',has_traffic_filtering=True,id=b2596e33-c1fc-42ae-ae83-524af44bbb0a,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2596e33-c1') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:42:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2596e33-c1, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:42:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:42:00 user nova-compute[72150]: INFO os_vif [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:d7:75,bridge_name='br-int',has_traffic_filtering=True,id=b2596e33-c1fc-42ae-ae83-524af44bbb0a,network=Network(79fab4a5-51aa-4502-8f14-4222e52244d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2596e33-c1')
Aug 01 18:42:00 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Deleting instance files /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32_del
Aug 01 18:42:00 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Deletion of /opt/stack/data/nova/instances/769690c8-53c5-4057-88a5-fbdbcb930e32_del complete
Aug 01 18:42:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:00 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:42:00 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Took 0.89 seconds to deallocate network for instance.
Aug 01 18:42:00 user nova-compute[72150]: INFO nova.compute.manager [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 01 18:42:00 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:42:00 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:42:00 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:42:01 user nova-compute[72150]: DEBUG nova.compute.manager [req-1125438e-8d42-49df-9e76-58ab5c031b40 req-00b73d0b-1465-490d-b767-2e893e48a9d3 service nova] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Received event network-vif-deleted-6b6df9a4-874c-4b35-bc04-beda6938aedb {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:42:01 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:42:01 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Took 0.61 seconds to deallocate network for instance.
Aug 01 18:42:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:42:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:42:01 user nova-compute[72150]: DEBUG nova.compute.manager [req-dbfb8028-ba1f-4a7c-96e5-20036728bb49 req-1898bae0-57c0-4db6-b64b-01fa61c07b7a service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received event network-vif-unplugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:42:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-dbfb8028-ba1f-4a7c-96e5-20036728bb49 req-1898bae0-57c0-4db6-b64b-01fa61c07b7a service nova] Acquiring lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:42:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-dbfb8028-ba1f-4a7c-96e5-20036728bb49 req-1898bae0-57c0-4db6-b64b-01fa61c07b7a service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:42:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-dbfb8028-ba1f-4a7c-96e5-20036728bb49 req-1898bae0-57c0-4db6-b64b-01fa61c07b7a service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:42:01 user nova-compute[72150]: DEBUG nova.compute.manager [req-dbfb8028-ba1f-4a7c-96e5-20036728bb49 req-1898bae0-57c0-4db6-b64b-01fa61c07b7a service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] No waiting events found dispatching network-vif-unplugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:42:01 user nova-compute[72150]: WARNING nova.compute.manager [req-dbfb8028-ba1f-4a7c-96e5-20036728bb49 req-1898bae0-57c0-4db6-b64b-01fa61c07b7a service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received unexpected event network-vif-unplugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a for instance with vm_state deleted and task_state None.
Aug 01 18:42:01 user nova-compute[72150]: DEBUG nova.compute.manager [req-dbfb8028-ba1f-4a7c-96e5-20036728bb49 req-1898bae0-57c0-4db6-b64b-01fa61c07b7a service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received event network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:42:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-dbfb8028-ba1f-4a7c-96e5-20036728bb49 req-1898bae0-57c0-4db6-b64b-01fa61c07b7a service nova] Acquiring lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:42:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-dbfb8028-ba1f-4a7c-96e5-20036728bb49 req-1898bae0-57c0-4db6-b64b-01fa61c07b7a service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:42:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-dbfb8028-ba1f-4a7c-96e5-20036728bb49 req-1898bae0-57c0-4db6-b64b-01fa61c07b7a service nova] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:42:01 user nova-compute[72150]: DEBUG nova.compute.manager [req-dbfb8028-ba1f-4a7c-96e5-20036728bb49 req-1898bae0-57c0-4db6-b64b-01fa61c07b7a service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] No waiting events found dispatching network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:42:01 user nova-compute[72150]: WARNING nova.compute.manager [req-dbfb8028-ba1f-4a7c-96e5-20036728bb49 req-1898bae0-57c0-4db6-b64b-01fa61c07b7a service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received unexpected event network-vif-plugged-b2596e33-c1fc-42ae-ae83-524af44bbb0a for instance with vm_state deleted and task_state None.
Aug 01 18:42:01 user nova-compute[72150]: INFO nova.compute.manager [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Took 1.00 seconds to detach 1 volumes for instance.
Aug 01 18:42:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:42:01 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:42:01 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:42:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.502s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:42:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.135s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:42:01 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Deleted allocations for instance 769690c8-53c5-4057-88a5-fbdbcb930e32
Aug 01 18:42:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d3ce308a-0194-46ec-8961-29ffe589fc82 tempest-ServerRescueNegativeTestJSON-2003578958 tempest-ServerRescueNegativeTestJSON-2003578958-project-member] Lock "769690c8-53c5-4057-88a5-fbdbcb930e32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.321s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:42:02 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:42:02 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:42:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.497s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:42:02 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Deleted allocations for instance 6bf4d051-455d-4bd8-b9b0-4f9e4082901f
Aug 01 18:42:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a478e93a-76ab-4ba3-bfbc-2ed894face1d tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "6bf4d051-455d-4bd8-b9b0-4f9e4082901f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.044s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:42:03 user nova-compute[72150]: DEBUG nova.compute.manager [req-f206fe30-11a9-4cf7-ae38-f38bda6b1c6f req-24ec5e75-dad3-4331-a4b4-1acad8869e98 service nova] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Received event network-vif-deleted-b2596e33-c1fc-42ae-ae83-524af44bbb0a {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:42:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:14 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915319.2572222, 6bf4d051-455d-4bd8-b9b0-4f9e4082901f => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:42:14 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] VM Stopped (Lifecycle Event)
Aug 01 18:42:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-02409c2b-1ca0-4035-94a3-179f9be88347 None None] [instance: 6bf4d051-455d-4bd8-b9b0-4f9e4082901f] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:42:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:15 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915320.5134604, 769690c8-53c5-4057-88a5-fbdbcb930e32 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:42:15 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] VM Stopped (Lifecycle Event)
Aug 01 18:42:15 user nova-compute[72150]: DEBUG nova.compute.manager [None req-2b29e3c8-352c-4411-a282-c75510040c1a None None] [instance: 769690c8-53c5-4057-88a5-fbdbcb930e32] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:42:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:42:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:42:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:42:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:42:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:42:21 user nova-compute[72150]: INFO nova.compute.manager [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Terminating instance
Aug 01 18:42:21 user nova-compute[72150]: DEBUG nova.compute.manager [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:42:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:21 user nova-compute[72150]: DEBUG nova.compute.manager [req-9d149b27-3610-4366-8442-91fda9a14d37 req-1c82dc6c-7154-4e83-8daa-e00ab7b1588a service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Received event network-vif-unplugged-8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:42:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9d149b27-3610-4366-8442-91fda9a14d37 req-1c82dc6c-7154-4e83-8daa-e00ab7b1588a service nova] Acquiring lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:42:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9d149b27-3610-4366-8442-91fda9a14d37 req-1c82dc6c-7154-4e83-8daa-e00ab7b1588a service nova] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:42:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9d149b27-3610-4366-8442-91fda9a14d37 req-1c82dc6c-7154-4e83-8daa-e00ab7b1588a service nova] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:42:21 user nova-compute[72150]: DEBUG nova.compute.manager [req-9d149b27-3610-4366-8442-91fda9a14d37 req-1c82dc6c-7154-4e83-8daa-e00ab7b1588a service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] No waiting events found dispatching network-vif-unplugged-8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:42:21 user nova-compute[72150]: DEBUG nova.compute.manager [req-9d149b27-3610-4366-8442-91fda9a14d37 req-1c82dc6c-7154-4e83-8daa-e00ab7b1588a service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Received event network-vif-unplugged-8839e09b-66e1-4465-88d2-19f19dc1b010 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:42:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:22 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Instance destroyed successfully.
Aug 01 18:42:22 user nova-compute[72150]: DEBUG nova.objects.instance [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lazy-loading 'resources' on Instance uuid 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:35:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-205787336',display_name='tempest-ServerActionsTestOtherA-server-205787336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-205787336',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJY2FlDJuzmLBeUAuDA5wUSU2UHRGDTZlkebFFQy7IaCc3RvIIFGPPP6kDQA5KkLRYt2dsIc0CUwBhPl2TFzcR9udfpfPek2FdJAmKOoaMyPBsGZqlWc4+qDiA+nCRd2Q==',key_name='tempest-keypair-605536790',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:37:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c393fdc0b774cd8a6208200011ba16b',ramdisk_id='',reservation_id='r-40eismfe',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-993571413',owner_user_name='tempest-ServerActionsTestOtherA-993571413-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9470bee775394bf5a3368d27b64911cb',uuid=54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8839e09b-66e1-4465-88d2-19f19dc1b010", "address": "fa:16:3e:69:a8:32", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8839e09b-66", "ovs_interfaceid": "8839e09b-66e1-4465-88d2-19f19dc1b010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converting VIF {"id": "8839e09b-66e1-4465-88d2-19f19dc1b010", "address": "fa:16:3e:69:a8:32", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8839e09b-66", "ovs_interfaceid": "8839e09b-66e1-4465-88d2-19f19dc1b010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:a8:32,bridge_name='br-int',has_traffic_filtering=True,id=8839e09b-66e1-4465-88d2-19f19dc1b010,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8839e09b-66') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG os_vif [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:a8:32,bridge_name='br-int',has_traffic_filtering=True,id=8839e09b-66e1-4465-88d2-19f19dc1b010,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8839e09b-66') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8839e09b-66, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:22 user nova-compute[72150]: INFO os_vif [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:a8:32,bridge_name='br-int',has_traffic_filtering=True,id=8839e09b-66e1-4465-88d2-19f19dc1b010,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8839e09b-66')
Aug 01 18:42:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KzEQLnfT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:42:22 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:42:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0166e9db-0ada-46e1-b5af-db878a3a25cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59a71ed-e356-4ae1-8fbf-1321a2444efe]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:42:22 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:42:22 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:42:22 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:42:22 user nova-compute[72150]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:42:22 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:42:22 user nova-compute[72150]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 (non-flash)
Aug 01 18:42:22 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:42:22 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:42:22 user nova-compute[72150]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:42:22 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c4529e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9'): ({'sdb'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Removing single pathed devices sdb {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a282303d-eaaa-4ed9-b0d5-35f0f95d15fd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d81a001-8c79-4ccd-83d6-67c600fb3983]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Flushing IO for device /dev/sdb {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c47e494-0448-419e-a912-8fcd42f8e4bf]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40c8798-349b-4e31-ba8c-0609c0329670]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c499f4-7dc0-4d4a-a5f9-ce2f4bad79e2]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b8ae47-35c4-49ca-8fa0-c1c1a5be986e]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9, portal: 172.16.0.220,3260]
Aug 01 18:42:22 user nova-compute[72150]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9, portal: 172.16.0.220,3260] successful.
Aug 01 18:42:22 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194b3ab3-36b4-4099-99ce-e23a428c23b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[63be742b-c1eb-4279-89ff-6edc34a6646c]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] <== disconnect_volume: return (323ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:42:22 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Deleting instance files /opt/stack/data/nova/instances/54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89_del
Aug 01 18:42:22 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Deletion of /opt/stack/data/nova/instances/54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89_del complete
Aug 01 18:42:22 user nova-compute[72150]: INFO nova.compute.manager [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 01 18:42:22 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:42:22 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:42:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "0c6f0595-d475-48c9-8726-cffcdb047b2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:42:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "0c6f0595-d475-48c9-8726-cffcdb047b2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:42:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "0c6f0595-d475-48c9-8726-cffcdb047b2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:42:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "0c6f0595-d475-48c9-8726-cffcdb047b2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:42:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "0c6f0595-d475-48c9-8726-cffcdb047b2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:42:23 user nova-compute[72150]: INFO nova.compute.manager [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Terminating instance
Aug 01 18:42:23 user nova-compute[72150]: DEBUG nova.compute.manager [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:42:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:23 user nova-compute[72150]: DEBUG nova.compute.manager [req-88826f17-4f73-41f3-a5fd-28e0a0a34179 req-231c2a2a-05eb-467e-b5f0-ec752df0e6ee service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Received event network-vif-plugged-8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:42:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-88826f17-4f73-41f3-a5fd-28e0a0a34179 req-231c2a2a-05eb-467e-b5f0-ec752df0e6ee service nova] Acquiring lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:42:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-88826f17-4f73-41f3-a5fd-28e0a0a34179 req-231c2a2a-05eb-467e-b5f0-ec752df0e6ee service nova] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:42:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-88826f17-4f73-41f3-a5fd-28e0a0a34179 req-231c2a2a-05eb-467e-b5f0-ec752df0e6ee service nova] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:42:23 user nova-compute[72150]: DEBUG nova.compute.manager [req-88826f17-4f73-41f3-a5fd-28e0a0a34179 req-231c2a2a-05eb-467e-b5f0-ec752df0e6ee service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] No waiting events found dispatching network-vif-plugged-8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:42:23 user nova-compute[72150]: WARNING nova.compute.manager [req-88826f17-4f73-41f3-a5fd-28e0a0a34179 req-231c2a2a-05eb-467e-b5f0-ec752df0e6ee service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Received unexpected event network-vif-plugged-8839e09b-66e1-4465-88d2-19f19dc1b010 for instance with vm_state active and task_state deleting.
Aug 01 18:42:23 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:42:23 user nova-compute[72150]: DEBUG nova.compute.manager [req-80843860-87c1-4a65-a58b-4271f535413b req-b456c313-d394-4278-951a-e148dda7fe1c service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Received event network-vif-unplugged-fc7d8e56-f828-4324-afaa-123405c9f968 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:42:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-80843860-87c1-4a65-a58b-4271f535413b req-b456c313-d394-4278-951a-e148dda7fe1c service nova] Acquiring lock "0c6f0595-d475-48c9-8726-cffcdb047b2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:42:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-80843860-87c1-4a65-a58b-4271f535413b req-b456c313-d394-4278-951a-e148dda7fe1c service nova] Lock "0c6f0595-d475-48c9-8726-cffcdb047b2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:42:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-80843860-87c1-4a65-a58b-4271f535413b req-b456c313-d394-4278-951a-e148dda7fe1c service nova] Lock "0c6f0595-d475-48c9-8726-cffcdb047b2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:42:23 user nova-compute[72150]: DEBUG nova.compute.manager [req-80843860-87c1-4a65-a58b-4271f535413b req-b456c313-d394-4278-951a-e148dda7fe1c service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] No waiting events found dispatching network-vif-unplugged-fc7d8e56-f828-4324-afaa-123405c9f968 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:42:23 user nova-compute[72150]: DEBUG nova.compute.manager [req-80843860-87c1-4a65-a58b-4271f535413b req-b456c313-d394-4278-951a-e148dda7fe1c service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Received event network-vif-unplugged-fc7d8e56-f828-4324-afaa-123405c9f968 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:42:23 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Took 1.29 seconds to deallocate network for instance.
Aug 01 18:42:23 user nova-compute[72150]: DEBUG nova.compute.manager [req-40036514-4c89-42f8-8e81-7010905b3408 req-895c842c-f5f1-4eda-b74c-b0c7478b9c8e service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Received event network-vif-deleted-8839e09b-66e1-4465-88d2-19f19dc1b010 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:42:23 user nova-compute[72150]: INFO nova.compute.manager [req-40036514-4c89-42f8-8e81-7010905b3408 req-895c842c-f5f1-4eda-b74c-b0c7478b9c8e service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Neutron deleted interface 8839e09b-66e1-4465-88d2-19f19dc1b010; detaching it from the instance and deleting it from the info cache
Aug 01 18:42:23 user nova-compute[72150]: DEBUG nova.network.neutron [req-40036514-4c89-42f8-8e81-7010905b3408 req-895c842c-f5f1-4eda-b74c-b0c7478b9c8e service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:42:23 user nova-compute[72150]: DEBUG nova.compute.manager [req-40036514-4c89-42f8-8e81-7010905b3408 req-895c842c-f5f1-4eda-b74c-b0c7478b9c8e service nova] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Detach interface failed, port_id=8839e09b-66e1-4465-88d2-19f19dc1b010, reason: Instance 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 could not be found. {{(pid=72150) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 18:42:24 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Instance destroyed successfully.
Aug 01 18:42:24 user nova-compute[72150]: DEBUG nova.objects.instance [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lazy-loading 'resources' on Instance uuid 0c6f0595-d475-48c9-8726-cffcdb047b2d {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:42:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:39:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-527022266',display_name='tempest-AttachVolumeNegativeTest-server-527022266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-527022266',id=39,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQP0a4apKyrs1Lou0TfJauuMwG/EkLMFOHmyGtjK5JE0aFi8mG/FLtlfmo+LvuRohARnJ1vUkGIe+HveA89vytiEyj51LUXeCsz66gdRo6tF275p5RenrW+98hsrGWcCQ==',key_name='tempest-keypair-1845805441',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:39:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66bad8c4e2a74caf8d35ad98e7888266',ramdisk_id='',reservation_id='r-zdoi45y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-504132593',owner_user_name='tempest-AttachVolumeNegativeTest-504132593-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:39:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f11bcc2f9cc048beb928fc0d3c30403e',uuid=0c6f0595-d475-48c9-8726-cffcdb047b2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc7d8e56-f828-4324-afaa-123405c9f968", "address": "fa:16:3e:76:17:26", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc7d8e56-f8", "ovs_interfaceid": "fc7d8e56-f828-4324-afaa-123405c9f968", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:42:24 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converting VIF {"id": "fc7d8e56-f828-4324-afaa-123405c9f968", "address": "fa:16:3e:76:17:26", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc7d8e56-f8", "ovs_interfaceid": "fc7d8e56-f828-4324-afaa-123405c9f968", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:42:24 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:17:26,bridge_name='br-int',has_traffic_filtering=True,id=fc7d8e56-f828-4324-afaa-123405c9f968,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc7d8e56-f8') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:42:24 user nova-compute[72150]: DEBUG os_vif [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:17:26,bridge_name='br-int',has_traffic_filtering=True,id=fc7d8e56-f828-4324-afaa-123405c9f968,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc7d8e56-f8') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:42:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc7d8e56-f8, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:42:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:42:24 user nova-compute[72150]: INFO os_vif [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:17:26,bridge_name='br-int',has_traffic_filtering=True,id=fc7d8e56-f828-4324-afaa-123405c9f968,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc7d8e56-f8')
Aug 01 18:42:24 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Deleting instance files /opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d_del
Aug 01 18:42:24 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Deletion of /opt/stack/data/nova/instances/0c6f0595-d475-48c9-8726-cffcdb047b2d_del complete
Aug 01 18:42:24 user nova-compute[72150]: INFO nova.compute.manager [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 01 18:42:24 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:42:24 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:42:24 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:42:24 user nova-compute[72150]: INFO nova.compute.manager [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Took 0.74 seconds to detach 1 volumes for instance.
Aug 01 18:42:24 user nova-compute[72150]: DEBUG nova.compute.manager [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Deleting volume: 194b3ab3-36b4-4099-99ce-e23a428c23b9 {{(pid=72150) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 18:42:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:42:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:42:25 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:42:25 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:42:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:42:25 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Deleted allocations for instance 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89
Aug 01 18:42:25 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:42:25 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Took 0.90 seconds to deallocate network for instance.
Aug 01 18:42:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c1c272ee-14fb-47c4-8bee-0ccd33eb23af tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.759s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:42:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:42:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:42:25 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:42:25 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:42:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:42:25 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Deleted allocations for instance 0c6f0595-d475-48c9-8726-cffcdb047b2d
Aug 01 18:42:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-88891bc2-c4ed-42ea-91fb-815c27d69ecf tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "0c6f0595-d475-48c9-8726-cffcdb047b2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.268s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:42:25 user nova-compute[72150]: DEBUG nova.compute.manager [req-59f33045-9392-4844-8332-c4ae718004d6 req-d74e3c71-c8c4-427a-a6a3-d353fde6d00f service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Received event network-vif-plugged-fc7d8e56-f828-4324-afaa-123405c9f968 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:42:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-59f33045-9392-4844-8332-c4ae718004d6 req-d74e3c71-c8c4-427a-a6a3-d353fde6d00f service nova] Acquiring lock "0c6f0595-d475-48c9-8726-cffcdb047b2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:42:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-59f33045-9392-4844-8332-c4ae718004d6 req-d74e3c71-c8c4-427a-a6a3-d353fde6d00f service nova] Lock "0c6f0595-d475-48c9-8726-cffcdb047b2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:42:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-59f33045-9392-4844-8332-c4ae718004d6 req-d74e3c71-c8c4-427a-a6a3-d353fde6d00f service nova] Lock "0c6f0595-d475-48c9-8726-cffcdb047b2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:42:25 user nova-compute[72150]: DEBUG nova.compute.manager [req-59f33045-9392-4844-8332-c4ae718004d6 req-d74e3c71-c8c4-427a-a6a3-d353fde6d00f service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] No waiting events found dispatching network-vif-plugged-fc7d8e56-f828-4324-afaa-123405c9f968 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:42:25 user nova-compute[72150]: WARNING nova.compute.manager [req-59f33045-9392-4844-8332-c4ae718004d6 req-d74e3c71-c8c4-427a-a6a3-d353fde6d00f service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Received unexpected event network-vif-plugged-fc7d8e56-f828-4324-afaa-123405c9f968 for instance with vm_state deleted and task_state None.
Aug 01 18:42:25 user nova-compute[72150]: DEBUG nova.compute.manager [req-7b8fbd31-d956-4f74-a661-1a8e992f874d req-6549d687-8113-484e-b30b-6e33f965edc7 service nova] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Received event network-vif-deleted-fc7d8e56-f828-4324-afaa-123405c9f968 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:42:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:42:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:42:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:42:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:42:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:36 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:42:37 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915342.1718829, 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:42:37 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] VM Stopped (Lifecycle Event)
Aug 01 18:42:37 user nova-compute[72150]: DEBUG nova.compute.manager [None req-a8c1b0f6-e437-4918-80d3-cecaf5a43d80 None None] [instance: 54c72ba3-0733-4a1d-b6ee-9ca4cdf28c89] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:42:39 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915344.196918, 0c6f0595-d475-48c9-8726-cffcdb047b2d => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:42:39 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] VM Stopped (Lifecycle Event)
Aug 01 18:42:39 user nova-compute[72150]: DEBUG nova.compute.manager [None req-94c48538-246a-4976-bb68-9c21ac7fa4cc None None] [instance: 0c6f0595-d475-48c9-8726-cffcdb047b2d] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:42:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:42:44 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:42:45 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:42:45 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:42:45 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:42:45 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72150) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 18:42:46 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:42:46 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:42:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:42:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:42:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:42:46 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:42:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:42:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:42:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:42:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:42:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:48 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:42:48 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:42:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=7858MB free_disk=25.24551773071289GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:42:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:42:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:42:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 08851ec4-6f71-4ec1-a092-42aab83ee87f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:42:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance bf2d1f14-2227-41d1-bd73-a05ab3149aba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:42:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 42e75a98-beb1-4688-a375-affc63b14252 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:42:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance d2117837-5552-4ec3-9f9b-62629c1ff4cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:42:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 737a8853-f9b9-4a0b-95a1-200d72c4d806 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:42:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 316953c9-42a9-4598-9385-0c138415ea6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:42:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:42:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 07213597-fa7a-4422-956a-1b02737cc647 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:42:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:42:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:42:48 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:42:49 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:42:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:42:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:42:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:42:50 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:42:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:42:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-42e75a98-beb1-4688-a375-affc63b14252" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:42:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-42e75a98-beb1-4688-a375-affc63b14252" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:42:50 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:42:51 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Updating instance_info_cache with network_info: [{"id": "10529340-a252-4604-accb-19f26670f125", "address": "fa:16:3e:56:f4:53", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10529340-a2", "ovs_interfaceid": "10529340-a252-4604-accb-19f26670f125", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:42:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-42e75a98-beb1-4688-a375-affc63b14252" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:42:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:42:51 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:42:51 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:42:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:42:51 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:42:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Cleaning up deleted instances {{(pid=72150) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 18:42:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] There are 0 instances to clean {{(pid=72150) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 18:42:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-3ae4bb2b-a08d-4f6e-a597-649302f1c71c req-3e0a5e55-a32c-45bd-8841-0e543342ce28 service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Received event network-changed-c4fe7e1b-47aa-495a-9f09-2780827d1f41 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:42:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-3ae4bb2b-a08d-4f6e-a597-649302f1c71c req-3e0a5e55-a32c-45bd-8841-0e543342ce28 service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Refreshing instance network info cache due to event network-changed-c4fe7e1b-47aa-495a-9f09-2780827d1f41. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:42:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3ae4bb2b-a08d-4f6e-a597-649302f1c71c req-3e0a5e55-a32c-45bd-8841-0e543342ce28 service nova] Acquiring lock "refresh_cache-5dbd0cf2-7aa9-452a-9322-a58c23d7cc52" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:42:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3ae4bb2b-a08d-4f6e-a597-649302f1c71c req-3e0a5e55-a32c-45bd-8841-0e543342ce28 service nova] Acquired lock "refresh_cache-5dbd0cf2-7aa9-452a-9322-a58c23d7cc52" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:42:57 user nova-compute[72150]: DEBUG nova.network.neutron [req-3ae4bb2b-a08d-4f6e-a597-649302f1c71c req-3e0a5e55-a32c-45bd-8841-0e543342ce28 service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Refreshing network info cache for port c4fe7e1b-47aa-495a-9f09-2780827d1f41 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:42:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "5dbd0cf2-7aa9-452a-9322-a58c23d7cc52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:42:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "5dbd0cf2-7aa9-452a-9322-a58c23d7cc52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:42:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "5dbd0cf2-7aa9-452a-9322-a58c23d7cc52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:42:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "5dbd0cf2-7aa9-452a-9322-a58c23d7cc52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:42:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "5dbd0cf2-7aa9-452a-9322-a58c23d7cc52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:42:57 user nova-compute[72150]: INFO nova.compute.manager [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Terminating instance
Aug 01 18:42:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:42:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG nova.network.neutron [req-3ae4bb2b-a08d-4f6e-a597-649302f1c71c req-3e0a5e55-a32c-45bd-8841-0e543342ce28 service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Updated VIF entry in instance network info cache for port c4fe7e1b-47aa-495a-9f09-2780827d1f41. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG nova.network.neutron [req-3ae4bb2b-a08d-4f6e-a597-649302f1c71c req-3e0a5e55-a32c-45bd-8841-0e543342ce28 service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Updating instance_info_cache with network_info: [{"id": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "address": "fa:16:3e:c8:34:35", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fe7e1b-47", "ovs_interfaceid": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3ae4bb2b-a08d-4f6e-a597-649302f1c71c req-3e0a5e55-a32c-45bd-8841-0e543342ce28 service nova] Releasing lock "refresh_cache-5dbd0cf2-7aa9-452a-9322-a58c23d7cc52" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-c96c6398-82ae-4e0e-822e-1138afe18603 req-a7f7d8fa-a0a4-4f24-a267-48752339c03e service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Received event network-vif-unplugged-c4fe7e1b-47aa-495a-9f09-2780827d1f41 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c96c6398-82ae-4e0e-822e-1138afe18603 req-a7f7d8fa-a0a4-4f24-a267-48752339c03e service nova] Acquiring lock "5dbd0cf2-7aa9-452a-9322-a58c23d7cc52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c96c6398-82ae-4e0e-822e-1138afe18603 req-a7f7d8fa-a0a4-4f24-a267-48752339c03e service nova] Lock "5dbd0cf2-7aa9-452a-9322-a58c23d7cc52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c96c6398-82ae-4e0e-822e-1138afe18603 req-a7f7d8fa-a0a4-4f24-a267-48752339c03e service nova] Lock "5dbd0cf2-7aa9-452a-9322-a58c23d7cc52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-c96c6398-82ae-4e0e-822e-1138afe18603 req-a7f7d8fa-a0a4-4f24-a267-48752339c03e service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] No waiting events found dispatching network-vif-unplugged-c4fe7e1b-47aa-495a-9f09-2780827d1f41 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-c96c6398-82ae-4e0e-822e-1138afe18603 req-a7f7d8fa-a0a4-4f24-a267-48752339c03e service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Received event network-vif-unplugged-c4fe7e1b-47aa-495a-9f09-2780827d1f41 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:42:58 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Instance destroyed successfully.
Aug 01 18:42:58 user nova-compute[72150]: DEBUG nova.objects.instance [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lazy-loading 'resources' on Instance uuid 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:38:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-751874109',display_name='tempest-TestVolumeBootPattern-server-751874109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-751874109',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVf3lHt050k356A8Gut9WieNqP8u9vIp5xdHm1rq7ONC5kHGtGA6mBo7SyXu2T5UgJrBcaDoeDkrLO73m2dxgj5g1F2RdpTy7mOLuxRD5SR618gGiTwTven5q6qp8rd8g==',key_name='tempest-TestVolumeBootPattern-35567601',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:38:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7ca44f23b114893afcfe57c52f693b1',ramdisk_id='',reservation_id='r-jpirbdib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-295340968',owner_user_name='tempest-TestVolumeBootPattern-295340968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:38:18Z,user_data=None,user_id='92c7ef0ed6814f8880de76adb913a487',uuid=5dbd0cf2-7aa9-452a-9322-a58c23d7cc52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "address": "fa:16:3e:c8:34:35", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fe7e1b-47", "ovs_interfaceid": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converting VIF {"id": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "address": "fa:16:3e:c8:34:35", "network": {"id": "9a207262-2706-42c5-8c0f-03c42dd915e0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1081081410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7ca44f23b114893afcfe57c52f693b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fe7e1b-47", "ovs_interfaceid": "c4fe7e1b-47aa-495a-9f09-2780827d1f41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:34:35,bridge_name='br-int',has_traffic_filtering=True,id=c4fe7e1b-47aa-495a-9f09-2780827d1f41,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4fe7e1b-47') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG os_vif [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:34:35,bridge_name='br-int',has_traffic_filtering=True,id=c4fe7e1b-47aa-495a-9f09-2780827d1f41,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4fe7e1b-47') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4fe7e1b-47, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:42:58 user nova-compute[72150]: INFO os_vif [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:34:35,bridge_name='br-int',has_traffic_filtering=True,id=c4fe7e1b-47aa-495a-9f09-2780827d1f41,network=Network(9a207262-2706-42c5-8c0f-03c42dd915e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4fe7e1b-47')
Aug 01 18:42:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTkRwigS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:42:58 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:42:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7a1650-6158-4dab-b0a0-cbc74aea44aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9600a1d-8017-423f-a179-2776f29ce4c4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:42:58 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:42:58 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:42:58 user nova-compute[72150]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:42:58 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:42:58 user nova-compute[72150]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 (non-flash)
Aug 01 18:42:58 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:42:58 user nova-compute[72150]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:42:58 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f471bf1cb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052'): ({'sdf'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Removing single pathed devices sdf {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3681978f-5654-4cec-b59d-573f978b7dcb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf5181f-7c8c-4e88-bb8c-0afbfba71cdb]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Flushing IO for device /dev/sdf {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd89fc52-45c6-445f-bbda-d899d7b399a2]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0e3b89-37ce-4d6d-9722-0562f99f4e07]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] SCSI volumes sdf have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO134f9636-c916d4f188a6055a', '/dev/disk/by-id/scsi-26339313664346631', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_134f9636') {{(pid=82940) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa8f6e7-a72e-4196-910e-24e2763b6340]: (4, None) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bde0fa9-6a33-4365-8110-bea5497d6d48]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3c28f0-7df5-4d01-865c-feaba619e66a]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052, portal: 172.16.0.220,3260]
Aug 01 18:42:58 user nova-compute[72150]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052, portal: 172.16.0.220,3260] successful.
Aug 01 18:42:58 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cfd38-e4a8-46fc-a35e-4c37a1e4a052 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[720a39f6-f3f8-41e1-8e80-22be1663168c]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] <== disconnect_volume: return (297ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:42:58 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Deleting instance files /opt/stack/data/nova/instances/5dbd0cf2-7aa9-452a-9322-a58c23d7cc52_del
Aug 01 18:42:58 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Deletion of /opt/stack/data/nova/instances/5dbd0cf2-7aa9-452a-9322-a58c23d7cc52_del complete
Aug 01 18:42:58 user nova-compute[72150]: INFO nova.compute.manager [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 01 18:42:58 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:42:58 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:42:59 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:42:59 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Took 0.50 seconds to deallocate network for instance.
Aug 01 18:42:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-7d17646d-6ae7-41d9-9d3a-e520c4d82c52 req-967d3481-2a88-4b79-b514-403bdb209fb0 service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Received event network-vif-deleted-c4fe7e1b-47aa-495a-9f09-2780827d1f41 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:42:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:00 user nova-compute[72150]: INFO nova.compute.manager [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Took 0.72 seconds to detach 1 volumes for instance.
Aug 01 18:43:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:00 user nova-compute[72150]: DEBUG nova.compute.manager [req-49a06736-f192-43f7-9d48-ec1f7cec8963 req-c833e6bf-9d60-4ca0-8a9d-8677c36f5c2a service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Received event network-vif-plugged-c4fe7e1b-47aa-495a-9f09-2780827d1f41 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:43:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-49a06736-f192-43f7-9d48-ec1f7cec8963 req-c833e6bf-9d60-4ca0-8a9d-8677c36f5c2a service nova] Acquiring lock "5dbd0cf2-7aa9-452a-9322-a58c23d7cc52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-49a06736-f192-43f7-9d48-ec1f7cec8963 req-c833e6bf-9d60-4ca0-8a9d-8677c36f5c2a service nova] Lock "5dbd0cf2-7aa9-452a-9322-a58c23d7cc52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-49a06736-f192-43f7-9d48-ec1f7cec8963 req-c833e6bf-9d60-4ca0-8a9d-8677c36f5c2a service nova] Lock "5dbd0cf2-7aa9-452a-9322-a58c23d7cc52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:00 user nova-compute[72150]: DEBUG nova.compute.manager [req-49a06736-f192-43f7-9d48-ec1f7cec8963 req-c833e6bf-9d60-4ca0-8a9d-8677c36f5c2a service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] No waiting events found dispatching network-vif-plugged-c4fe7e1b-47aa-495a-9f09-2780827d1f41 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:43:00 user nova-compute[72150]: WARNING nova.compute.manager [req-49a06736-f192-43f7-9d48-ec1f7cec8963 req-c833e6bf-9d60-4ca0-8a9d-8677c36f5c2a service nova] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Received unexpected event network-vif-plugged-c4fe7e1b-47aa-495a-9f09-2780827d1f41 for instance with vm_state deleted and task_state None.
Aug 01 18:43:00 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:43:00 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:43:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:00 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Deleted allocations for instance 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52
Aug 01 18:43:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dcd14dcf-670e-4a3a-8946-daad6e9c5467 tempest-TestVolumeBootPattern-295340968 tempest-TestVolumeBootPattern-295340968-project-member] Lock "5dbd0cf2-7aa9-452a-9322-a58c23d7cc52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.870s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:13 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915378.4689453, 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:43:13 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] VM Stopped (Lifecycle Event)
Aug 01 18:43:13 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cdfcafd2-33df-46d0-9e32-f2fc0ede8884 None None] [instance: 5dbd0cf2-7aa9-452a-9322-a58c23d7cc52] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:43:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:16 user nova-compute[72150]: INFO nova.compute.manager [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Terminating instance
Aug 01 18:43:16 user nova-compute[72150]: DEBUG nova.compute.manager [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:43:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:17 user nova-compute[72150]: DEBUG nova.compute.manager [req-fef6c8af-985e-40e3-b55e-247407d9a838 req-ee1c7068-6f54-401d-9c58-be00953091d9 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Received event network-vif-unplugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:43:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fef6c8af-985e-40e3-b55e-247407d9a838 req-ee1c7068-6f54-401d-9c58-be00953091d9 service nova] Acquiring lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fef6c8af-985e-40e3-b55e-247407d9a838 req-ee1c7068-6f54-401d-9c58-be00953091d9 service nova] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fef6c8af-985e-40e3-b55e-247407d9a838 req-ee1c7068-6f54-401d-9c58-be00953091d9 service nova] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:17 user nova-compute[72150]: DEBUG nova.compute.manager [req-fef6c8af-985e-40e3-b55e-247407d9a838 req-ee1c7068-6f54-401d-9c58-be00953091d9 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] No waiting events found dispatching network-vif-unplugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:43:17 user nova-compute[72150]: DEBUG nova.compute.manager [req-fef6c8af-985e-40e3-b55e-247407d9a838 req-ee1c7068-6f54-401d-9c58-be00953091d9 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Received event network-vif-unplugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:43:17 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Instance destroyed successfully.
Aug 01 18:43:17 user nova-compute[72150]: DEBUG nova.objects.instance [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lazy-loading 'resources' on Instance uuid bf2d1f14-2227-41d1-bd73-a05ab3149aba {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:43:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T18:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-301869653',display_name='tempest-ServerActionsTestOtherA-server-1812214243',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-301869653',id=17,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJY2FlDJuzmLBeUAuDA5wUSU2UHRGDTZlkebFFQy7IaCc3RvIIFGPPP6kDQA5KkLRYt2dsIc0CUwBhPl2TFzcR9udfpfPek2FdJAmKOoaMyPBsGZqlWc4+qDiA+nCRd2Q==',key_name='tempest-keypair-605536790',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:31:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c393fdc0b774cd8a6208200011ba16b',ramdisk_id='',reservation_id='r-djtbnitg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-993571413',owner_user_name='tempest-ServerActionsTestOtherA-993571413-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:31:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9470bee775394bf5a3368d27b64911cb',uuid=bf2d1f14-2227-41d1-bd73-a05ab3149aba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "address": "fa:16:3e:63:c8:50", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41eb682d-9c", "ovs_interfaceid": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:43:17 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converting VIF {"id": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "address": "fa:16:3e:63:c8:50", "network": {"id": "94c9640e-61d8-426e-ad98-8812959d44e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-258752565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c393fdc0b774cd8a6208200011ba16b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41eb682d-9c", "ovs_interfaceid": "41eb682d-9c56-46b8-bd1d-b479d120b8a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:43:17 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=41eb682d-9c56-46b8-bd1d-b479d120b8a1,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41eb682d-9c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:43:17 user nova-compute[72150]: DEBUG os_vif [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=41eb682d-9c56-46b8-bd1d-b479d120b8a1,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41eb682d-9c') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:43:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41eb682d-9c, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:43:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:43:17 user nova-compute[72150]: INFO os_vif [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=41eb682d-9c56-46b8-bd1d-b479d120b8a1,network=Network(94c9640e-61d8-426e-ad98-8812959d44e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41eb682d-9c')
Aug 01 18:43:17 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Deleting instance files /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba_del
Aug 01 18:43:17 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Deletion of /opt/stack/data/nova/instances/bf2d1f14-2227-41d1-bd73-a05ab3149aba_del complete
Aug 01 18:43:17 user nova-compute[72150]: INFO nova.compute.manager [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 01 18:43:17 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:43:17 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:43:17 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:43:18 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:43:18 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Took 0.59 seconds to deallocate network for instance.
Aug 01 18:43:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:18 user nova-compute[72150]: DEBUG nova.compute.manager [req-02b584ec-0de0-4812-868d-ad9533a85fec req-b4bf5b4d-af60-45e4-af82-e299f4e1b377 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Received event network-vif-deleted-41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:43:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:18 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:43:18 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:43:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:18 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Deleted allocations for instance bf2d1f14-2227-41d1-bd73-a05ab3149aba
Aug 01 18:43:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-820652e2-aad3-4d10-bf50-91f84d612bce tempest-ServerActionsTestOtherA-993571413 tempest-ServerActionsTestOtherA-993571413-project-member] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.977s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:19 user nova-compute[72150]: DEBUG nova.compute.manager [req-4d31a1b9-57ea-497b-9106-8f958ff5abde req-538aa6da-86f8-45e4-9725-b339d5818ba2 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Received event network-vif-plugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:43:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4d31a1b9-57ea-497b-9106-8f958ff5abde req-538aa6da-86f8-45e4-9725-b339d5818ba2 service nova] Acquiring lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4d31a1b9-57ea-497b-9106-8f958ff5abde req-538aa6da-86f8-45e4-9725-b339d5818ba2 service nova] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4d31a1b9-57ea-497b-9106-8f958ff5abde req-538aa6da-86f8-45e4-9725-b339d5818ba2 service nova] Lock "bf2d1f14-2227-41d1-bd73-a05ab3149aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:19 user nova-compute[72150]: DEBUG nova.compute.manager [req-4d31a1b9-57ea-497b-9106-8f958ff5abde req-538aa6da-86f8-45e4-9725-b339d5818ba2 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] No waiting events found dispatching network-vif-plugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:43:19 user nova-compute[72150]: WARNING nova.compute.manager [req-4d31a1b9-57ea-497b-9106-8f958ff5abde req-538aa6da-86f8-45e4-9725-b339d5818ba2 service nova] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Received unexpected event network-vif-plugged-41eb682d-9c56-46b8-bd1d-b479d120b8a1 for instance with vm_state deleted and task_state None.
Aug 01 18:43:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:19 user nova-compute[72150]: DEBUG nova.compute.manager [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:43:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:19 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:43:19 user nova-compute[72150]: INFO nova.compute.claims [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Claim successful on node user
Aug 01 18:43:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:20 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:43:20 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:43:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.611s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:20 user nova-compute[72150]: DEBUG nova.compute.manager [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:43:20 user nova-compute[72150]: DEBUG nova.compute.manager [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:43:20 user nova-compute[72150]: DEBUG nova.network.neutron [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:43:20 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:43:20 user nova-compute[72150]: DEBUG nova.compute.manager [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:43:20 user nova-compute[72150]: DEBUG nova.policy [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f11bcc2f9cc048beb928fc0d3c30403e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bad8c4e2a74caf8d35ad98e7888266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:43:20 user nova-compute[72150]: DEBUG nova.compute.manager [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:43:20 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:43:20 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Creating image(s)
Aug 01 18:43:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "/opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "/opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.147s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.149s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/disk 1073741824" returned: 0 in 0.058s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.159s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:21 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:43:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:21 user nova-compute[72150]: DEBUG nova.network.neutron [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Successfully created port: 30bd4e9a-f1bf-48df-962e-296027da9d23 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:43:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:21 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Cannot resize image /opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:43:21 user nova-compute[72150]: DEBUG nova.objects.instance [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lazy-loading 'migration_context' on Instance uuid ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:43:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:43:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Ensure instance console log exists: /opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:43:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:21 user nova-compute[72150]: DEBUG nova.network.neutron [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Successfully updated port: 30bd4e9a-f1bf-48df-962e-296027da9d23 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:43:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "refresh_cache-ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:43:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquired lock "refresh_cache-ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:43:21 user nova-compute[72150]: DEBUG nova.network.neutron [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:43:21 user nova-compute[72150]: DEBUG nova.compute.manager [req-6cf651cc-d388-462c-b20e-7e2cfde3b6ef req-4b53ce93-d3e3-4f2b-9d80-dc2cf7deec6f service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Received event network-changed-30bd4e9a-f1bf-48df-962e-296027da9d23 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:43:21 user nova-compute[72150]: DEBUG nova.compute.manager [req-6cf651cc-d388-462c-b20e-7e2cfde3b6ef req-4b53ce93-d3e3-4f2b-9d80-dc2cf7deec6f service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Refreshing instance network info cache due to event network-changed-30bd4e9a-f1bf-48df-962e-296027da9d23. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:43:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6cf651cc-d388-462c-b20e-7e2cfde3b6ef req-4b53ce93-d3e3-4f2b-9d80-dc2cf7deec6f service nova] Acquiring lock "refresh_cache-ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:43:21 user nova-compute[72150]: DEBUG nova.network.neutron [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.network.neutron [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Updating instance_info_cache with network_info: [{"id": "30bd4e9a-f1bf-48df-962e-296027da9d23", "address": "fa:16:3e:9d:a6:13", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bd4e9a-f1", "ovs_interfaceid": "30bd4e9a-f1bf-48df-962e-296027da9d23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Releasing lock "refresh_cache-ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.compute.manager [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Instance network_info: |[{"id": "30bd4e9a-f1bf-48df-962e-296027da9d23", "address": "fa:16:3e:9d:a6:13", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bd4e9a-f1", "ovs_interfaceid": "30bd4e9a-f1bf-48df-962e-296027da9d23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6cf651cc-d388-462c-b20e-7e2cfde3b6ef req-4b53ce93-d3e3-4f2b-9d80-dc2cf7deec6f service nova] Acquired lock "refresh_cache-ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.network.neutron [req-6cf651cc-d388-462c-b20e-7e2cfde3b6ef req-4b53ce93-d3e3-4f2b-9d80-dc2cf7deec6f service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Refreshing network info cache for port 30bd4e9a-f1bf-48df-962e-296027da9d23 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Start _get_guest_xml network_info=[{"id": "30bd4e9a-f1bf-48df-962e-296027da9d23", "address": "fa:16:3e:9d:a6:13", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bd4e9a-f1", "ovs_interfaceid": "30bd4e9a-f1bf-48df-962e-296027da9d23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:43:22 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:43:22 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:43:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-781594077',display_name='tempest-AttachVolumeNegativeTest-server-781594077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-781594077',id=41,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuhVndNcFL+FbuRIiXcrjQKYEZMopDrfzbSyRmTXbwlWPruP4brHBU0paY2niEuKDw1Af6QDlB1kblWNkXZbDcnPjXUyWyDd9tZvbIQvdjZ6D5zbIJVLIq319ytxVtYJQ==',key_name='tempest-keypair-1472158408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66bad8c4e2a74caf8d35ad98e7888266',ramdisk_id='',reservation_id='r-5inistdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-504132593',owner_user_name='tempest-AttachVolumeNegativeTest-504132593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:43:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f11bcc2f9cc048beb928fc0d3c30403e',uuid=ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30bd4e9a-f1bf-48df-962e-296027da9d23", "address": "fa:16:3e:9d:a6:13", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bd4e9a-f1", "ovs_interfaceid": "30bd4e9a-f1bf-48df-962e-296027da9d23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converting VIF {"id": "30bd4e9a-f1bf-48df-962e-296027da9d23", "address": "fa:16:3e:9d:a6:13", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bd4e9a-f1", "ovs_interfaceid": "30bd4e9a-f1bf-48df-962e-296027da9d23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:a6:13,bridge_name='br-int',has_traffic_filtering=True,id=30bd4e9a-f1bf-48df-962e-296027da9d23,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bd4e9a-f1') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.objects.instance [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lazy-loading 'pci_devices' on Instance uuid ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:43:22 user nova-compute[72150]:   <uuid>ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c</uuid>
Aug 01 18:43:22 user nova-compute[72150]:   <name>instance-00000029</name>
Aug 01 18:43:22 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:43:22 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:43:22 user nova-compute[72150]:   <metadata>
Aug 01 18:43:22 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:43:22 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:43:22 user nova-compute[72150]:       <nova:name>tempest-AttachVolumeNegativeTest-server-781594077</nova:name>
Aug 01 18:43:22 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:43:22</nova:creationTime>
Aug 01 18:43:22 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:43:22 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:43:22 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:43:22 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:43:22 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:43:22 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:43:22 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:43:22 user nova-compute[72150]:       <nova:owner>
Aug 01 18:43:22 user nova-compute[72150]:         <nova:user uuid="f11bcc2f9cc048beb928fc0d3c30403e">tempest-AttachVolumeNegativeTest-504132593-project-member</nova:user>
Aug 01 18:43:22 user nova-compute[72150]:         <nova:project uuid="66bad8c4e2a74caf8d35ad98e7888266">tempest-AttachVolumeNegativeTest-504132593</nova:project>
Aug 01 18:43:22 user nova-compute[72150]:       </nova:owner>
Aug 01 18:43:22 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:43:22 user nova-compute[72150]:       <nova:ports>
Aug 01 18:43:22 user nova-compute[72150]:         <nova:port uuid="30bd4e9a-f1bf-48df-962e-296027da9d23">
Aug 01 18:43:22 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 18:43:22 user nova-compute[72150]:         </nova:port>
Aug 01 18:43:22 user nova-compute[72150]:       </nova:ports>
Aug 01 18:43:22 user nova-compute[72150]:     </nova:instance>
Aug 01 18:43:22 user nova-compute[72150]:   </metadata>
Aug 01 18:43:22 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:43:22 user nova-compute[72150]:     <system>
Aug 01 18:43:22 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:43:22 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:43:22 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:43:22 user nova-compute[72150]:       <entry name="serial">ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c</entry>
Aug 01 18:43:22 user nova-compute[72150]:       <entry name="uuid">ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c</entry>
Aug 01 18:43:22 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:43:22 user nova-compute[72150]:     </system>
Aug 01 18:43:22 user nova-compute[72150]:   </sysinfo>
Aug 01 18:43:22 user nova-compute[72150]:   <os>
Aug 01 18:43:22 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:43:22 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:43:22 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:43:22 user nova-compute[72150]:   </os>
Aug 01 18:43:22 user nova-compute[72150]:   <features>
Aug 01 18:43:22 user nova-compute[72150]:     <acpi/>
Aug 01 18:43:22 user nova-compute[72150]:     <apic/>
Aug 01 18:43:22 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:43:22 user nova-compute[72150]:   </features>
Aug 01 18:43:22 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:43:22 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:43:22 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:43:22 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:43:22 user nova-compute[72150]:   </clock>
Aug 01 18:43:22 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:43:22 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:43:22 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:43:22 user nova-compute[72150]:   </cpu>
Aug 01 18:43:22 user nova-compute[72150]:   <devices>
Aug 01 18:43:22 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:43:22 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:43:22 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/disk"/>
Aug 01 18:43:22 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:43:22 user nova-compute[72150]:     </disk>
Aug 01 18:43:22 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:43:22 user nova-compute[72150]:       <mac address="fa:16:3e:9d:a6:13"/>
Aug 01 18:43:22 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:43:22 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:43:22 user nova-compute[72150]:       <target dev="tap30bd4e9a-f1"/>
Aug 01 18:43:22 user nova-compute[72150]:     </interface>
Aug 01 18:43:22 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:43:22 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/console.log" append="off"/>
Aug 01 18:43:22 user nova-compute[72150]:     </serial>
Aug 01 18:43:22 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:43:22 user nova-compute[72150]:     <video>
Aug 01 18:43:22 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:43:22 user nova-compute[72150]:     </video>
Aug 01 18:43:22 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:43:22 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:43:22 user nova-compute[72150]:     </rng>
Aug 01 18:43:22 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:43:22 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:43:22 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:43:22 user nova-compute[72150]:     </memballoon>
Aug 01 18:43:22 user nova-compute[72150]:   </devices>
Aug 01 18:43:22 user nova-compute[72150]: </domain>
Aug 01 18:43:22 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:43:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-781594077',display_name='tempest-AttachVolumeNegativeTest-server-781594077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-781594077',id=41,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuhVndNcFL+FbuRIiXcrjQKYEZMopDrfzbSyRmTXbwlWPruP4brHBU0paY2niEuKDw1Af6QDlB1kblWNkXZbDcnPjXUyWyDd9tZvbIQvdjZ6D5zbIJVLIq319ytxVtYJQ==',key_name='tempest-keypair-1472158408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66bad8c4e2a74caf8d35ad98e7888266',ramdisk_id='',reservation_id='r-5inistdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-504132593',owner_user_name='tempest-AttachVolumeNegativeTest-504132593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:43:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f11bcc2f9cc048beb928fc0d3c30403e',uuid=ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30bd4e9a-f1bf-48df-962e-296027da9d23", "address": "fa:16:3e:9d:a6:13", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bd4e9a-f1", "ovs_interfaceid": "30bd4e9a-f1bf-48df-962e-296027da9d23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converting VIF {"id": "30bd4e9a-f1bf-48df-962e-296027da9d23", "address": "fa:16:3e:9d:a6:13", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bd4e9a-f1", "ovs_interfaceid": "30bd4e9a-f1bf-48df-962e-296027da9d23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:a6:13,bridge_name='br-int',has_traffic_filtering=True,id=30bd4e9a-f1bf-48df-962e-296027da9d23,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bd4e9a-f1') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG os_vif [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:a6:13,bridge_name='br-int',has_traffic_filtering=True,id=30bd4e9a-f1bf-48df-962e-296027da9d23,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bd4e9a-f1') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30bd4e9a-f1, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap30bd4e9a-f1, col_values=(('external_ids', {'iface-id': '30bd4e9a-f1bf-48df-962e-296027da9d23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:a6:13', 'vm-uuid': 'ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:22 user nova-compute[72150]: INFO os_vif [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:a6:13,bridge_name='br-int',has_traffic_filtering=True,id=30bd4e9a-f1bf-48df-962e-296027da9d23,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bd4e9a-f1')
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] No VIF found with MAC fa:16:3e:9d:a6:13, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.network.neutron [req-6cf651cc-d388-462c-b20e-7e2cfde3b6ef req-4b53ce93-d3e3-4f2b-9d80-dc2cf7deec6f service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Updated VIF entry in instance network info cache for port 30bd4e9a-f1bf-48df-962e-296027da9d23. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG nova.network.neutron [req-6cf651cc-d388-462c-b20e-7e2cfde3b6ef req-4b53ce93-d3e3-4f2b-9d80-dc2cf7deec6f service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Updating instance_info_cache with network_info: [{"id": "30bd4e9a-f1bf-48df-962e-296027da9d23", "address": "fa:16:3e:9d:a6:13", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bd4e9a-f1", "ovs_interfaceid": "30bd4e9a-f1bf-48df-962e-296027da9d23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:43:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6cf651cc-d388-462c-b20e-7e2cfde3b6ef req-4b53ce93-d3e3-4f2b-9d80-dc2cf7deec6f service nova] Releasing lock "refresh_cache-ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:43:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:24 user nova-compute[72150]: DEBUG nova.compute.manager [req-5800409c-c5c5-4fcc-9ebf-8911f344d337 req-e251223b-d2e0-4cfb-9d67-674dd9b40844 service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Received event network-vif-plugged-30bd4e9a-f1bf-48df-962e-296027da9d23 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:43:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5800409c-c5c5-4fcc-9ebf-8911f344d337 req-e251223b-d2e0-4cfb-9d67-674dd9b40844 service nova] Acquiring lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5800409c-c5c5-4fcc-9ebf-8911f344d337 req-e251223b-d2e0-4cfb-9d67-674dd9b40844 service nova] Lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5800409c-c5c5-4fcc-9ebf-8911f344d337 req-e251223b-d2e0-4cfb-9d67-674dd9b40844 service nova] Lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:24 user nova-compute[72150]: DEBUG nova.compute.manager [req-5800409c-c5c5-4fcc-9ebf-8911f344d337 req-e251223b-d2e0-4cfb-9d67-674dd9b40844 service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] No waiting events found dispatching network-vif-plugged-30bd4e9a-f1bf-48df-962e-296027da9d23 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:43:24 user nova-compute[72150]: WARNING nova.compute.manager [req-5800409c-c5c5-4fcc-9ebf-8911f344d337 req-e251223b-d2e0-4cfb-9d67-674dd9b40844 service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Received unexpected event network-vif-plugged-30bd4e9a-f1bf-48df-962e-296027da9d23 for instance with vm_state building and task_state spawning.
Aug 01 18:43:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:25 user nova-compute[72150]: DEBUG nova.compute.manager [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:43:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:43:25 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915405.7225404, ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:43:25 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] VM Resumed (Lifecycle Event)
Aug 01 18:43:25 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Instance spawned successfully.
Aug 01 18:43:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:43:25 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:43:25 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:43:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:43:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:43:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:43:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:43:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:43:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:43:25 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:43:25 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915405.7226942, ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:43:25 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] VM Started (Lifecycle Event)
Aug 01 18:43:25 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:43:25 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:43:25 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:43:25 user nova-compute[72150]: INFO nova.compute.manager [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Took 5.38 seconds to spawn the instance on the hypervisor.
Aug 01 18:43:25 user nova-compute[72150]: DEBUG nova.compute.manager [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:43:25 user nova-compute[72150]: INFO nova.compute.manager [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Took 6.34 seconds to build instance.
Aug 01 18:43:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34b494fb-c9b9-47f7-b85d-29d878c6f70a tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.448s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:26 user nova-compute[72150]: DEBUG nova.compute.manager [req-14f0cfe4-b1a1-4e5c-b4f9-9d37e7f05ec6 req-b0e8dc8e-bb9c-491e-a0f3-54d22a7b224a service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Received event network-vif-plugged-30bd4e9a-f1bf-48df-962e-296027da9d23 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:43:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-14f0cfe4-b1a1-4e5c-b4f9-9d37e7f05ec6 req-b0e8dc8e-bb9c-491e-a0f3-54d22a7b224a service nova] Acquiring lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-14f0cfe4-b1a1-4e5c-b4f9-9d37e7f05ec6 req-b0e8dc8e-bb9c-491e-a0f3-54d22a7b224a service nova] Lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-14f0cfe4-b1a1-4e5c-b4f9-9d37e7f05ec6 req-b0e8dc8e-bb9c-491e-a0f3-54d22a7b224a service nova] Lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:26 user nova-compute[72150]: DEBUG nova.compute.manager [req-14f0cfe4-b1a1-4e5c-b4f9-9d37e7f05ec6 req-b0e8dc8e-bb9c-491e-a0f3-54d22a7b224a service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] No waiting events found dispatching network-vif-plugged-30bd4e9a-f1bf-48df-962e-296027da9d23 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:43:26 user nova-compute[72150]: WARNING nova.compute.manager [req-14f0cfe4-b1a1-4e5c-b4f9-9d37e7f05ec6 req-b0e8dc8e-bb9c-491e-a0f3-54d22a7b224a service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Received unexpected event network-vif-plugged-30bd4e9a-f1bf-48df-962e-296027da9d23 for instance with vm_state active and task_state None.
Aug 01 18:43:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:32 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915397.4928694, bf2d1f14-2227-41d1-bd73-a05ab3149aba => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:43:32 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] VM Stopped (Lifecycle Event)
Aug 01 18:43:32 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ebadef96-620d-4345-a3e5-4599d3618121 None None] [instance: bf2d1f14-2227-41d1-bd73-a05ab3149aba] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:43:32 user nova-compute[72150]: DEBUG nova.compute.manager [req-80f24b0d-67ee-4bc4-b89d-e98ba88dba6c req-cc1c119d-7ac0-4fa6-bdac-3f9f0f02c507 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Received event network-changed-b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:43:32 user nova-compute[72150]: DEBUG nova.compute.manager [req-80f24b0d-67ee-4bc4-b89d-e98ba88dba6c req-cc1c119d-7ac0-4fa6-bdac-3f9f0f02c507 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Refreshing instance network info cache due to event network-changed-b9e510dc-94be-4362-b3a8-4d68f1f769f3. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:43:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-80f24b0d-67ee-4bc4-b89d-e98ba88dba6c req-cc1c119d-7ac0-4fa6-bdac-3f9f0f02c507 service nova] Acquiring lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:43:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-80f24b0d-67ee-4bc4-b89d-e98ba88dba6c req-cc1c119d-7ac0-4fa6-bdac-3f9f0f02c507 service nova] Acquired lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:43:32 user nova-compute[72150]: DEBUG nova.network.neutron [req-80f24b0d-67ee-4bc4-b89d-e98ba88dba6c req-cc1c119d-7ac0-4fa6-bdac-3f9f0f02c507 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Refreshing network info cache for port b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:43:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "316953c9-42a9-4598-9385-0c138415ea6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "316953c9-42a9-4598-9385-0c138415ea6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "316953c9-42a9-4598-9385-0c138415ea6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:32 user nova-compute[72150]: INFO nova.compute.manager [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Terminating instance
Aug 01 18:43:32 user nova-compute[72150]: DEBUG nova.compute.manager [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:43:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquiring lock "07213597-fa7a-4422-956a-1b02737cc647" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "07213597-fa7a-4422-956a-1b02737cc647" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquiring lock "07213597-fa7a-4422-956a-1b02737cc647-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "07213597-fa7a-4422-956a-1b02737cc647-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "07213597-fa7a-4422-956a-1b02737cc647-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:33 user nova-compute[72150]: INFO nova.compute.manager [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Terminating instance
Aug 01 18:43:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:33 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:43:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:33 user nova-compute[72150]: DEBUG nova.network.neutron [req-80f24b0d-67ee-4bc4-b89d-e98ba88dba6c req-cc1c119d-7ac0-4fa6-bdac-3f9f0f02c507 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Updated VIF entry in instance network info cache for port b9e510dc-94be-4362-b3a8-4d68f1f769f3. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:43:33 user nova-compute[72150]: DEBUG nova.network.neutron [req-80f24b0d-67ee-4bc4-b89d-e98ba88dba6c req-cc1c119d-7ac0-4fa6-bdac-3f9f0f02c507 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Updating instance_info_cache with network_info: [{"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e510dc-94", "ovs_interfaceid": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:43:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-80f24b0d-67ee-4bc4-b89d-e98ba88dba6c req-cc1c119d-7ac0-4fa6-bdac-3f9f0f02c507 service nova] Releasing lock "refresh_cache-07213597-fa7a-4422-956a-1b02737cc647" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:43:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:34 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Instance destroyed successfully.
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.objects.instance [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'resources' on Instance uuid 316953c9-42a9-4598-9385-0c138415ea6f {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:37:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-441711796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-441711796',id=36,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:39:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ad8ef64d051424e9fe644a1fb40fcb4',ramdisk_id='',reservation_id='r-cwbwup3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-23372548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:41:48Z,user_data=None,user_id='cc00b9006f5842c6b875c5d25538b718',uuid=316953c9-42a9-4598-9385-0c138415ea6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed51a469-3095-4679-b038-c18153c8f95e", "address": "fa:16:3e:13:9f:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped51a469-30", "ovs_interfaceid": "ed51a469-3095-4679-b038-c18153c8f95e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converting VIF {"id": "ed51a469-3095-4679-b038-c18153c8f95e", "address": "fa:16:3e:13:9f:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped51a469-30", "ovs_interfaceid": "ed51a469-3095-4679-b038-c18153c8f95e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:9f:5a,bridge_name='br-int',has_traffic_filtering=True,id=ed51a469-3095-4679-b038-c18153c8f95e,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped51a469-30') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_vif [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:9f:5a,bridge_name='br-int',has_traffic_filtering=True,id=ed51a469-3095-4679-b038-c18153c8f95e,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped51a469-30') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped51a469-30, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:43:34 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Instance destroyed successfully.
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.objects.instance [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lazy-loading 'resources' on Instance uuid 07213597-fa7a-4422-956a-1b02737cc647 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T18:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-691830454',display_name='tempest-TestShelveInstance-server-691830454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-691830454',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyoTrCOpTYRiMQpfxAHrmgEh2IuXfKFd05eInP4gONn7Z6yLSlklJvNu/KixD0APbHlXD8tsKWypMmSvEXNQ7HC+5Bl+96BWCjszExqbYWAuUU70+cSHaxQ4fZmIre9ag==',key_name='tempest-TestShelveInstance-873495065',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:41:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96ebdfa1a1d744989c2ae19afba252a2',ramdisk_id='',reservation_id='r-0wlnrl2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-359406348',owner_user_name='tempest-TestShelveInstance-359406348-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:41:57Z,user_data=None,user_id='3e19b7bbe9bf473f8ce8d121dcaf5e35',uuid=07213597-fa7a-4422-956a-1b02737cc647,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e510dc-94", "ovs_interfaceid": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Converting VIF {"id": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "address": "fa:16:3e:3c:2f:8e", "network": {"id": "ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1478463117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ebdfa1a1d744989c2ae19afba252a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e510dc-94", "ovs_interfaceid": "b9e510dc-94be-4362-b3a8-4d68f1f769f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:2f:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9e510dc-94be-4362-b3a8-4d68f1f769f3,network=Network(ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e510dc-94') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_vif [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:2f:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9e510dc-94be-4362-b3a8-4d68f1f769f3,network=Network(ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e510dc-94') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9e510dc-94, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:43:34 user nova-compute[72150]: INFO os_vif [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:9f:5a,bridge_name='br-int',has_traffic_filtering=True,id=ed51a469-3095-4679-b038-c18153c8f95e,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped51a469-30')
Aug 01 18:43:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:43:34 user nova-compute[72150]: INFO os_vif [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:2f:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9e510dc-94be-4362-b3a8-4d68f1f769f3,network=Network(ed79f6f3-0ae6-4bd0-aac4-00fca32b5ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e510dc-94')
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oOkAyqjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:43:34 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdAEYcHK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:43:34 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7177a4-ace5-4e3d-a4de-d849f7a9cde4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2110ea74-3a21-4ba8-a78f-8a6171e5e3cc]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:43:34 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:43:34 user nova-compute[72150]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:43:34 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:43:34 user nova-compute[72150]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 (non-flash)
Aug 01 18:43:34 user nova-compute[72150]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:43:34 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c3c2e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688'): ({'sdg'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Removing single pathed devices sdg {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3fa0c3-8b61-4d99-9e1c-e19c45943bde]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12da7a8-bf63-46bb-8c1f-2220fdb95606]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Flushing IO for device /dev/sdg {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bfe96f-514b-4370-9b68-87109fb31586]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeec40d8-471c-41ca-a6bf-86130018367f]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] SCSI volumes sdg have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO9d7883d4-44ed2699dea886ab', '/dev/disk/by-id/scsi-23434656432363939', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9d7883d4') {{(pid=82940) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc6e208-33eb-4ce1-999a-3986a86327dd]: (4, None) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c851906-364e-402d-bfa8-d20970a52f18]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f862914-47e6-4ec6-98e5-12222e028f14]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688, portal: 172.16.0.220,3260]
Aug 01 18:43:34 user nova-compute[72150]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688, portal: 172.16.0.220,3260] successful.
Aug 01 18:43:34 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39b8b189-c5f4-4c2a-a973-ee3f807ea688 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[481bc244-c667-486d-b95e-f14d65731f35]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] <== disconnect_volume: return (348ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:43:34 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Deleting instance files /opt/stack/data/nova/instances/316953c9-42a9-4598-9385-0c138415ea6f_del
Aug 01 18:43:34 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Deletion of /opt/stack/data/nova/instances/316953c9-42a9-4598-9385-0c138415ea6f_del complete
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.347s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d0a9d6-aa05-4ce9-95f5-45260f734344]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc2d055-eb4d-4fca-9e46-fda7d7962f8c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:43:34 user nova-compute[72150]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:43:34 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:43:34 user nova-compute[72150]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 (non-flash)
Aug 01 18:43:34 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f471c0a09d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77'): ({'sde'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Removing single pathed devices sde {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:34 user nova-compute[72150]: INFO nova.compute.manager [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Took 1.60 seconds to destroy the instance on the hypervisor.
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc4802b-53bf-4b47-bc78-3425baa20a99]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39e9fd3-bc80-421d-af01-dfcf8f28aaf5]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Flushing IO for device /dev/sde {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d460cf6a-de16-4692-a954-4305a0a3af40]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f2fac9-9202-48e9-af64-2c4c2f8b45bc]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] SCSI volumes sde have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1786eab-c826-4ccc-a84f-827c2687380c]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d91ef82-fc42-4df2-8c06-1d873dfd4640]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77, portal: 172.16.0.220,3260]
Aug 01 18:43:34 user nova-compute[72150]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77, portal: 172.16.0.220,3260] successful.
Aug 01 18:43:34 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c747e83a-c5db-4737-a028-fd1e6024fe77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[91de6107-14f2-49b5-8b0b-f7496414a6f6]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] <== disconnect_volume: return (628ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:43:34 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Deleting instance files /opt/stack/data/nova/instances/07213597-fa7a-4422-956a-1b02737cc647_del
Aug 01 18:43:34 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Deletion of /opt/stack/data/nova/instances/07213597-fa7a-4422-956a-1b02737cc647_del complete
Aug 01 18:43:34 user nova-compute[72150]: INFO nova.compute.manager [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Took 1.85 seconds to destroy the instance on the hypervisor.
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 07213597-fa7a-4422-956a-1b02737cc647] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.compute.manager [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received event network-vif-unplugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] Acquiring lock "316953c9-42a9-4598-9385-0c138415ea6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.compute.manager [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] No waiting events found dispatching network-vif-unplugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.compute.manager [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received event network-vif-unplugged-ed51a469-3095-4679-b038-c18153c8f95e for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.compute.manager [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] Acquiring lock "316953c9-42a9-4598-9385-0c138415ea6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] Lock "316953c9-42a9-4598-9385-0c138415ea6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.compute.manager [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] No waiting events found dispatching network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:43:34 user nova-compute[72150]: WARNING nova.compute.manager [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received unexpected event network-vif-plugged-ed51a469-3095-4679-b038-c18153c8f95e for instance with vm_state active and task_state deleting.
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.compute.manager [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Received event network-vif-unplugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] Acquiring lock "07213597-fa7a-4422-956a-1b02737cc647-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] Lock "07213597-fa7a-4422-956a-1b02737cc647-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] Lock "07213597-fa7a-4422-956a-1b02737cc647-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.compute.manager [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] No waiting events found dispatching network-vif-unplugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.compute.manager [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Received event network-vif-unplugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.compute.manager [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Received event network-vif-plugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] Acquiring lock "07213597-fa7a-4422-956a-1b02737cc647-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] Lock "07213597-fa7a-4422-956a-1b02737cc647-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] Lock "07213597-fa7a-4422-956a-1b02737cc647-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:34 user nova-compute[72150]: DEBUG nova.compute.manager [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] No waiting events found dispatching network-vif-plugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:43:34 user nova-compute[72150]: WARNING nova.compute.manager [req-fcf35477-c1f0-49c4-8756-4a9f6060115b req-ec45baca-0a21-4999-bc90-c17ce8d3cbde service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Received unexpected event network-vif-plugged-b9e510dc-94be-4362-b3a8-4d68f1f769f3 for instance with vm_state active and task_state deleting.
Aug 01 18:43:35 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:43:35 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Took 0.60 seconds to deallocate network for instance.
Aug 01 18:43:35 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:43:35 user nova-compute[72150]: DEBUG nova.compute.manager [req-d2a35678-70ab-4e0c-abfa-c02a77cc9508 req-851f4ba6-94a7-4876-b7db-c0b2afdf4b01 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Received event network-vif-deleted-b9e510dc-94be-4362-b3a8-4d68f1f769f3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:43:35 user nova-compute[72150]: INFO nova.compute.manager [req-d2a35678-70ab-4e0c-abfa-c02a77cc9508 req-851f4ba6-94a7-4876-b7db-c0b2afdf4b01 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Neutron deleted interface b9e510dc-94be-4362-b3a8-4d68f1f769f3; detaching it from the instance and deleting it from the info cache
Aug 01 18:43:35 user nova-compute[72150]: DEBUG nova.network.neutron [req-d2a35678-70ab-4e0c-abfa-c02a77cc9508 req-851f4ba6-94a7-4876-b7db-c0b2afdf4b01 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:43:35 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Took 0.93 seconds to deallocate network for instance.
Aug 01 18:43:35 user nova-compute[72150]: DEBUG nova.compute.manager [req-d2a35678-70ab-4e0c-abfa-c02a77cc9508 req-851f4ba6-94a7-4876-b7db-c0b2afdf4b01 service nova] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Detach interface failed, port_id=b9e510dc-94be-4362-b3a8-4d68f1f769f3, reason: Instance 07213597-fa7a-4422-956a-1b02737cc647 could not be found. {{(pid=72150) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 18:43:35 user nova-compute[72150]: INFO nova.compute.manager [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Took 0.81 seconds to detach 1 volumes for instance.
Aug 01 18:43:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:36 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Refreshing inventories for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 18:43:36 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Updating ProviderTree inventory for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 18:43:36 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Updating inventory in ProviderTree for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 18:43:36 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Refreshing aggregate associations for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479, aggregates: None {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 18:43:36 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Refreshing trait associations for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 18:43:36 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:43:36 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:43:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.499s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:36 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Deleted allocations for instance 316953c9-42a9-4598-9385-0c138415ea6f
Aug 01 18:43:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-88c9be37-73d4-4f57-8731-0b2f07116314 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "316953c9-42a9-4598-9385-0c138415ea6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.771s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:36 user nova-compute[72150]: INFO nova.compute.manager [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Took 0.89 seconds to detach 1 volumes for instance.
Aug 01 18:43:36 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Deleting volume: c747e83a-c5db-4737-a028-fd1e6024fe77 {{(pid=72150) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 18:43:36 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:43:37 user nova-compute[72150]: DEBUG nova.compute.manager [req-c0aa480d-a75f-43ae-8ba1-25a8abc613b3 req-b0d31635-dbb2-48f0-805d-99bb065a8098 service nova] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Received event network-vif-deleted-ed51a469-3095-4679-b038-c18153c8f95e {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:43:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:37 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:43:37 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:43:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:37 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Deleted allocations for instance 07213597-fa7a-4422-956a-1b02737cc647
Aug 01 18:43:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d8b44639-f6ae-43dd-9ae4-cdd43856b4a5 tempest-TestShelveInstance-359406348 tempest-TestShelveInstance-359406348-project-member] Lock "07213597-fa7a-4422-956a-1b02737cc647" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.609s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:46 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:43:46 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:43:46 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:43:47 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:43:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:43:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:43:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:43:49 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915414.0465508, 316953c9-42a9-4598-9385-0c138415ea6f => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:43:49 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] VM Stopped (Lifecycle Event)
Aug 01 18:43:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-764fa757-aaf8-418d-a974-43c7d91cc9d8 None None] [instance: 316953c9-42a9-4598-9385-0c138415ea6f] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:43:49 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915414.0893269, 07213597-fa7a-4422-956a-1b02737cc647 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:43:49 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 07213597-fa7a-4422-956a-1b02737cc647] VM Stopped (Lifecycle Event)
Aug 01 18:43:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-198ce63c-9d33-4eb6-914b-03be805b86ed None None] [instance: 07213597-fa7a-4422-956a-1b02737cc647] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:43:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:43:49 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:43:49 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:43:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8172MB free_disk=25.233837127685547GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:43:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:43:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:43:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 08851ec4-6f71-4ec1-a092-42aab83ee87f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:43:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 42e75a98-beb1-4688-a375-affc63b14252 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:43:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance d2117837-5552-4ec3-9f9b-62629c1ff4cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:43:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 737a8853-f9b9-4a0b-95a1-200d72c4d806 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:43:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:43:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:43:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:43:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:49 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:43:49 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:43:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:43:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:43:50 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:43:50 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:43:50 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:43:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:43:51 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:43:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:43:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-d2117837-5552-4ec3-9f9b-62629c1ff4cb" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:43:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-d2117837-5552-4ec3-9f9b-62629c1ff4cb" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:43:51 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:43:52 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Updating instance_info_cache with network_info: [{"id": "4cc0118a-e179-46b8-916b-b705b8568daa", "address": "fa:16:3e:c7:1f:09", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0118a-e1", "ovs_interfaceid": "4cc0118a-e179-46b8-916b-b705b8568daa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:43:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-d2117837-5552-4ec3-9f9b-62629c1ff4cb" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:43:52 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:43:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:43:56 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:43:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "e6831e19-1dc8-470a-8151-9896d8fea013" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:44:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "e6831e19-1dc8-470a-8151-9896d8fea013" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:44:22 user nova-compute[72150]: DEBUG nova.compute.manager [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:44:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:44:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:44:22 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:44:22 user nova-compute[72150]: INFO nova.compute.claims [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Claim successful on node user
Aug 01 18:44:22 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:44:22 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG nova.compute.manager [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG nova.compute.manager [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG nova.network.neutron [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:44:23 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:44:23 user nova-compute[72150]: DEBUG nova.compute.manager [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG nova.policy [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '237fb5b4bd184868a610aaea2766fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac704a033c8b46328eeda139cd57a3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG nova.compute.manager [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:44:23 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Creating image(s)
Aug 01 18:44:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "/opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "/opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.156s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.143s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk 1073741824" returned: 0 in 0.070s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.149s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:44:23 user nova-compute[72150]: INFO nova.compute.manager [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Terminating instance
Aug 01 18:44:23 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG nova.compute.manager [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Cannot resize image /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:44:23 user nova-compute[72150]: DEBUG nova.objects.instance [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'migration_context' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Ensure instance console log exists: /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG nova.network.neutron [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Successfully created port: 34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG nova.compute.manager [req-2c7f0f05-339c-4526-b362-941c959c5b36 req-eaa248a0-b068-47e2-a538-1cb6befe86ca service nova] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Received event network-vif-unplugged-4cc0118a-e179-46b8-916b-b705b8568daa {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2c7f0f05-339c-4526-b362-941c959c5b36 req-eaa248a0-b068-47e2-a538-1cb6befe86ca service nova] Acquiring lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2c7f0f05-339c-4526-b362-941c959c5b36 req-eaa248a0-b068-47e2-a538-1cb6befe86ca service nova] Lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2c7f0f05-339c-4526-b362-941c959c5b36 req-eaa248a0-b068-47e2-a538-1cb6befe86ca service nova] Lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG nova.compute.manager [req-2c7f0f05-339c-4526-b362-941c959c5b36 req-eaa248a0-b068-47e2-a538-1cb6befe86ca service nova] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] No waiting events found dispatching network-vif-unplugged-4cc0118a-e179-46b8-916b-b705b8568daa {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG nova.compute.manager [req-2c7f0f05-339c-4526-b362-941c959c5b36 req-eaa248a0-b068-47e2-a538-1cb6befe86ca service nova] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Received event network-vif-unplugged-4cc0118a-e179-46b8-916b-b705b8568daa for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:24 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Instance destroyed successfully.
Aug 01 18:44:24 user nova-compute[72150]: DEBUG nova.objects.instance [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'resources' on Instance uuid d2117837-5552-4ec3-9f9b-62629c1ff4cb {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:34:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-900314610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-900314610',id=31,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:35:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ad8ef64d051424e9fe644a1fb40fcb4',ramdisk_id='',reservation_id='r-pq3gqg00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-23372548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:36:58Z,user_data=None,user_id='cc00b9006f5842c6b875c5d25538b718',uuid=d2117837-5552-4ec3-9f9b-62629c1ff4cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cc0118a-e179-46b8-916b-b705b8568daa", "address": "fa:16:3e:c7:1f:09", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0118a-e1", "ovs_interfaceid": "4cc0118a-e179-46b8-916b-b705b8568daa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converting VIF {"id": "4cc0118a-e179-46b8-916b-b705b8568daa", "address": "fa:16:3e:c7:1f:09", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc0118a-e1", "ovs_interfaceid": "4cc0118a-e179-46b8-916b-b705b8568daa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:1f:09,bridge_name='br-int',has_traffic_filtering=True,id=4cc0118a-e179-46b8-916b-b705b8568daa,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc0118a-e1') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG os_vif [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:1f:09,bridge_name='br-int',has_traffic_filtering=True,id=4cc0118a-e179-46b8-916b-b705b8568daa,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc0118a-e1') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cc0118a-e1, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:44:24 user nova-compute[72150]: INFO os_vif [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:1f:09,bridge_name='br-int',has_traffic_filtering=True,id=4cc0118a-e179-46b8-916b-b705b8568daa,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc0118a-e1')
Aug 01 18:44:24 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Deleting instance files /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb_del
Aug 01 18:44:24 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Deletion of /opt/stack/data/nova/instances/d2117837-5552-4ec3-9f9b-62629c1ff4cb_del complete
Aug 01 18:44:24 user nova-compute[72150]: INFO nova.compute.manager [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 01 18:44:24 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.network.neutron [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Successfully updated port: 34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquired lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.network.neutron [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.network.neutron [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:44:25 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Took 0.86 seconds to deallocate network for instance.
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.compute.manager [req-f351d2b7-1853-4ba0-8034-4cd575ee34f1 req-07f06ef1-1e60-4f74-8620-73f2209b43ac service nova] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Received event network-vif-deleted-4cc0118a-e179-46b8-916b-b705b8568daa {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.network.neutron [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Updating instance_info_cache with network_info: [{"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Releasing lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.compute.manager [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Instance network_info: |[{"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Start _get_guest_xml network_info=[{"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:44:25 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:44:25 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-332550401',display_name='tempest-AttachVolumeTestJSON-server-332550401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-332550401',id=42,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1Pv06QL+gB8akpzxvePS2xW6RCpVy2Ew7P1W7eruRMggchqt3ZwFOUtwpWrdLBnRyq6PjJd04/eUWvQrMOr+kepnE87SxCG13sR5q56un9VmgaCmcSVeQvqkCfksWPsQ==',key_name='tempest-keypair-133087547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac704a033c8b46328eeda139cd57a3aa',ramdisk_id='',reservation_id='r-82uxffm9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-961178577',owner_user_name='tempest-AttachVolumeTestJSON-961178577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:44:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='237fb5b4bd184868a610aaea2766fa0d',uuid=e6831e19-1dc8-470a-8151-9896d8fea013,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converting VIF {"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=34f12530-76e7-453e-b503-4756ee0cb4a5,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f12530-76') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.objects.instance [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'pci_devices' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:44:25 user nova-compute[72150]:   <uuid>e6831e19-1dc8-470a-8151-9896d8fea013</uuid>
Aug 01 18:44:25 user nova-compute[72150]:   <name>instance-0000002a</name>
Aug 01 18:44:25 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:44:25 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:44:25 user nova-compute[72150]:   <metadata>
Aug 01 18:44:25 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:44:25 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:44:25 user nova-compute[72150]:       <nova:name>tempest-AttachVolumeTestJSON-server-332550401</nova:name>
Aug 01 18:44:25 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:44:25</nova:creationTime>
Aug 01 18:44:25 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:44:25 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:44:25 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:44:25 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:44:25 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:44:25 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:44:25 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:44:25 user nova-compute[72150]:       <nova:owner>
Aug 01 18:44:25 user nova-compute[72150]:         <nova:user uuid="237fb5b4bd184868a610aaea2766fa0d">tempest-AttachVolumeTestJSON-961178577-project-member</nova:user>
Aug 01 18:44:25 user nova-compute[72150]:         <nova:project uuid="ac704a033c8b46328eeda139cd57a3aa">tempest-AttachVolumeTestJSON-961178577</nova:project>
Aug 01 18:44:25 user nova-compute[72150]:       </nova:owner>
Aug 01 18:44:25 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:44:25 user nova-compute[72150]:       <nova:ports>
Aug 01 18:44:25 user nova-compute[72150]:         <nova:port uuid="34f12530-76e7-453e-b503-4756ee0cb4a5">
Aug 01 18:44:25 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 18:44:25 user nova-compute[72150]:         </nova:port>
Aug 01 18:44:25 user nova-compute[72150]:       </nova:ports>
Aug 01 18:44:25 user nova-compute[72150]:     </nova:instance>
Aug 01 18:44:25 user nova-compute[72150]:   </metadata>
Aug 01 18:44:25 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:44:25 user nova-compute[72150]:     <system>
Aug 01 18:44:25 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:44:25 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:44:25 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:44:25 user nova-compute[72150]:       <entry name="serial">e6831e19-1dc8-470a-8151-9896d8fea013</entry>
Aug 01 18:44:25 user nova-compute[72150]:       <entry name="uuid">e6831e19-1dc8-470a-8151-9896d8fea013</entry>
Aug 01 18:44:25 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:44:25 user nova-compute[72150]:     </system>
Aug 01 18:44:25 user nova-compute[72150]:   </sysinfo>
Aug 01 18:44:25 user nova-compute[72150]:   <os>
Aug 01 18:44:25 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:44:25 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:44:25 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:44:25 user nova-compute[72150]:   </os>
Aug 01 18:44:25 user nova-compute[72150]:   <features>
Aug 01 18:44:25 user nova-compute[72150]:     <acpi/>
Aug 01 18:44:25 user nova-compute[72150]:     <apic/>
Aug 01 18:44:25 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:44:25 user nova-compute[72150]:   </features>
Aug 01 18:44:25 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:44:25 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:44:25 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:44:25 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:44:25 user nova-compute[72150]:   </clock>
Aug 01 18:44:25 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:44:25 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:44:25 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:44:25 user nova-compute[72150]:   </cpu>
Aug 01 18:44:25 user nova-compute[72150]:   <devices>
Aug 01 18:44:25 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:44:25 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:44:25 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk"/>
Aug 01 18:44:25 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:44:25 user nova-compute[72150]:     </disk>
Aug 01 18:44:25 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:44:25 user nova-compute[72150]:       <mac address="fa:16:3e:6a:16:f7"/>
Aug 01 18:44:25 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:44:25 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:44:25 user nova-compute[72150]:       <target dev="tap34f12530-76"/>
Aug 01 18:44:25 user nova-compute[72150]:     </interface>
Aug 01 18:44:25 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:44:25 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/console.log" append="off"/>
Aug 01 18:44:25 user nova-compute[72150]:     </serial>
Aug 01 18:44:25 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:44:25 user nova-compute[72150]:     <video>
Aug 01 18:44:25 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:44:25 user nova-compute[72150]:     </video>
Aug 01 18:44:25 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:44:25 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:44:25 user nova-compute[72150]:     </rng>
Aug 01 18:44:25 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:44:25 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:44:25 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:44:25 user nova-compute[72150]:     </memballoon>
Aug 01 18:44:25 user nova-compute[72150]:   </devices>
Aug 01 18:44:25 user nova-compute[72150]: </domain>
Aug 01 18:44:25 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-332550401',display_name='tempest-AttachVolumeTestJSON-server-332550401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-332550401',id=42,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1Pv06QL+gB8akpzxvePS2xW6RCpVy2Ew7P1W7eruRMggchqt3ZwFOUtwpWrdLBnRyq6PjJd04/eUWvQrMOr+kepnE87SxCG13sR5q56un9VmgaCmcSVeQvqkCfksWPsQ==',key_name='tempest-keypair-133087547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac704a033c8b46328eeda139cd57a3aa',ramdisk_id='',reservation_id='r-82uxffm9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-961178577',owner_user_name='tempest-AttachVolumeTestJSON-961178577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:44:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='237fb5b4bd184868a610aaea2766fa0d',uuid=e6831e19-1dc8-470a-8151-9896d8fea013,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converting VIF {"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=34f12530-76e7-453e-b503-4756ee0cb4a5,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f12530-76') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG os_vif [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=34f12530-76e7-453e-b503-4756ee0cb4a5,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f12530-76') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34f12530-76, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap34f12530-76, col_values=(('external_ids', {'iface-id': '34f12530-76e7-453e-b503-4756ee0cb4a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:16:f7', 'vm-uuid': 'e6831e19-1dc8-470a-8151-9896d8fea013'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:25 user nova-compute[72150]: INFO os_vif [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=34f12530-76e7-453e-b503-4756ee0cb4a5,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f12530-76')
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:44:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] No VIF found with MAC fa:16:3e:6a:16:f7, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:44:26 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:44:26 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:44:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:44:26 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Deleted allocations for instance d2117837-5552-4ec3-9f9b-62629c1ff4cb
Aug 01 18:44:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6128418a-68e5-422c-94ff-c079ae39dda3 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.370s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:44:26 user nova-compute[72150]: DEBUG nova.compute.manager [req-fac19278-2011-4deb-b5a3-e8dc27534ea2 req-a0691fb7-8532-4b71-8db4-4527db80aef5 service nova] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Received event network-vif-plugged-4cc0118a-e179-46b8-916b-b705b8568daa {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:44:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fac19278-2011-4deb-b5a3-e8dc27534ea2 req-a0691fb7-8532-4b71-8db4-4527db80aef5 service nova] Acquiring lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:44:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fac19278-2011-4deb-b5a3-e8dc27534ea2 req-a0691fb7-8532-4b71-8db4-4527db80aef5 service nova] Lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:44:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fac19278-2011-4deb-b5a3-e8dc27534ea2 req-a0691fb7-8532-4b71-8db4-4527db80aef5 service nova] Lock "d2117837-5552-4ec3-9f9b-62629c1ff4cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:44:26 user nova-compute[72150]: DEBUG nova.compute.manager [req-fac19278-2011-4deb-b5a3-e8dc27534ea2 req-a0691fb7-8532-4b71-8db4-4527db80aef5 service nova] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] No waiting events found dispatching network-vif-plugged-4cc0118a-e179-46b8-916b-b705b8568daa {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:44:26 user nova-compute[72150]: WARNING nova.compute.manager [req-fac19278-2011-4deb-b5a3-e8dc27534ea2 req-a0691fb7-8532-4b71-8db4-4527db80aef5 service nova] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Received unexpected event network-vif-plugged-4cc0118a-e179-46b8-916b-b705b8568daa for instance with vm_state deleted and task_state None.
Aug 01 18:44:26 user nova-compute[72150]: DEBUG nova.compute.manager [req-fac19278-2011-4deb-b5a3-e8dc27534ea2 req-a0691fb7-8532-4b71-8db4-4527db80aef5 service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received event network-changed-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:44:26 user nova-compute[72150]: DEBUG nova.compute.manager [req-fac19278-2011-4deb-b5a3-e8dc27534ea2 req-a0691fb7-8532-4b71-8db4-4527db80aef5 service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Refreshing instance network info cache due to event network-changed-34f12530-76e7-453e-b503-4756ee0cb4a5. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:44:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fac19278-2011-4deb-b5a3-e8dc27534ea2 req-a0691fb7-8532-4b71-8db4-4527db80aef5 service nova] Acquiring lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:44:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fac19278-2011-4deb-b5a3-e8dc27534ea2 req-a0691fb7-8532-4b71-8db4-4527db80aef5 service nova] Acquired lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:44:26 user nova-compute[72150]: DEBUG nova.network.neutron [req-fac19278-2011-4deb-b5a3-e8dc27534ea2 req-a0691fb7-8532-4b71-8db4-4527db80aef5 service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Refreshing network info cache for port 34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:44:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:27 user nova-compute[72150]: DEBUG nova.network.neutron [req-fac19278-2011-4deb-b5a3-e8dc27534ea2 req-a0691fb7-8532-4b71-8db4-4527db80aef5 service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Updated VIF entry in instance network info cache for port 34f12530-76e7-453e-b503-4756ee0cb4a5. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:44:27 user nova-compute[72150]: DEBUG nova.network.neutron [req-fac19278-2011-4deb-b5a3-e8dc27534ea2 req-a0691fb7-8532-4b71-8db4-4527db80aef5 service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Updating instance_info_cache with network_info: [{"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:44:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fac19278-2011-4deb-b5a3-e8dc27534ea2 req-a0691fb7-8532-4b71-8db4-4527db80aef5 service nova] Releasing lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:44:27 user nova-compute[72150]: DEBUG nova.compute.manager [req-03972f54-5b20-4022-8266-328ba064375b req-6a652700-2ee9-4aab-956f-3640b6c5b251 service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received event network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:44:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-03972f54-5b20-4022-8266-328ba064375b req-6a652700-2ee9-4aab-956f-3640b6c5b251 service nova] Acquiring lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:44:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-03972f54-5b20-4022-8266-328ba064375b req-6a652700-2ee9-4aab-956f-3640b6c5b251 service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:44:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-03972f54-5b20-4022-8266-328ba064375b req-6a652700-2ee9-4aab-956f-3640b6c5b251 service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:44:27 user nova-compute[72150]: DEBUG nova.compute.manager [req-03972f54-5b20-4022-8266-328ba064375b req-6a652700-2ee9-4aab-956f-3640b6c5b251 service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] No waiting events found dispatching network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:44:27 user nova-compute[72150]: WARNING nova.compute.manager [req-03972f54-5b20-4022-8266-328ba064375b req-6a652700-2ee9-4aab-956f-3640b6c5b251 service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received unexpected event network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 for instance with vm_state building and task_state spawning.
Aug 01 18:44:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:29 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915469.4260716, e6831e19-1dc8-470a-8151-9896d8fea013 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:44:29 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] VM Resumed (Lifecycle Event)
Aug 01 18:44:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:44:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:44:29 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Instance spawned successfully.
Aug 01 18:44:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:44:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:44:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:44:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:44:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:44:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:44:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:44:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:44:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:44:29 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:44:29 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915469.4294596, e6831e19-1dc8-470a-8151-9896d8fea013 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:44:29 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] VM Started (Lifecycle Event)
Aug 01 18:44:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:44:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:44:29 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:44:29 user nova-compute[72150]: INFO nova.compute.manager [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Took 6.40 seconds to spawn the instance on the hypervisor.
Aug 01 18:44:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:44:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:29 user nova-compute[72150]: INFO nova.compute.manager [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Took 7.12 seconds to build instance.
Aug 01 18:44:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-12021261-f743-439f-a5b8-ce2f685d7437 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "e6831e19-1dc8-470a-8151-9896d8fea013" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.214s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:44:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-5b24ba03-4b29-4f7a-9009-a62eaa4d50fb req-77f5984d-e924-4747-8feb-25ff297300cc service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received event network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:44:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b24ba03-4b29-4f7a-9009-a62eaa4d50fb req-77f5984d-e924-4747-8feb-25ff297300cc service nova] Acquiring lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:44:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b24ba03-4b29-4f7a-9009-a62eaa4d50fb req-77f5984d-e924-4747-8feb-25ff297300cc service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:44:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5b24ba03-4b29-4f7a-9009-a62eaa4d50fb req-77f5984d-e924-4747-8feb-25ff297300cc service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:44:29 user nova-compute[72150]: DEBUG nova.compute.manager [req-5b24ba03-4b29-4f7a-9009-a62eaa4d50fb req-77f5984d-e924-4747-8feb-25ff297300cc service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] No waiting events found dispatching network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:44:29 user nova-compute[72150]: WARNING nova.compute.manager [req-5b24ba03-4b29-4f7a-9009-a62eaa4d50fb req-77f5984d-e924-4747-8feb-25ff297300cc service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received unexpected event network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 for instance with vm_state active and task_state None.
Aug 01 18:44:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:36 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:44:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:39 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915464.659012, d2117837-5552-4ec3-9f9b-62629c1ff4cb => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:44:39 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] VM Stopped (Lifecycle Event)
Aug 01 18:44:39 user nova-compute[72150]: DEBUG nova.compute.manager [None req-5a36587d-750e-49c1-a9e7-1ed46fb449a7 None None] [instance: d2117837-5552-4ec3-9f9b-62629c1ff4cb] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:44:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Acquiring lock "e64da6da-a4db-4613-90a4-dff7ff5775e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:44:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:44:39 user nova-compute[72150]: DEBUG nova.compute.manager [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:44:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:44:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:44:40 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:44:40 user nova-compute[72150]: INFO nova.compute.claims [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Claim successful on node user
Aug 01 18:44:40 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:44:40 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:44:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:44:40 user nova-compute[72150]: DEBUG nova.compute.manager [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:44:40 user nova-compute[72150]: DEBUG nova.compute.manager [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:44:40 user nova-compute[72150]: DEBUG nova.network.neutron [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:44:40 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:44:40 user nova-compute[72150]: DEBUG nova.compute.manager [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:44:40 user nova-compute[72150]: DEBUG nova.policy [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa19fd85ab1c409d842a6724c16cf7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f93dc27fbe4d79a7950055315a42fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:44:40 user nova-compute[72150]: DEBUG nova.compute.manager [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:44:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:44:40 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Creating image(s)
Aug 01 18:44:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Acquiring lock "/opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:44:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "/opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:44:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "/opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:44:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:44:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.194s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:44:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:44:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:44:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:44:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.162s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:44:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:44:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/disk 1073741824" returned: 0 in 0.064s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:44:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:44:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:44:41 user nova-compute[72150]: DEBUG nova.network.neutron [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Successfully created port: 2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:44:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.160s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:44:41 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:44:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:44:41 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:44:41 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Cannot resize image /opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:44:41 user nova-compute[72150]: DEBUG nova.objects.instance [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lazy-loading 'migration_context' on Instance uuid e64da6da-a4db-4613-90a4-dff7ff5775e0 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:44:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:44:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Ensure instance console log exists: /opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:44:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:44:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:44:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.network.neutron [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Successfully updated port: 2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Acquiring lock "refresh_cache-e64da6da-a4db-4613-90a4-dff7ff5775e0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Acquired lock "refresh_cache-e64da6da-a4db-4613-90a4-dff7ff5775e0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.network.neutron [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.compute.manager [req-1c1aebd7-bddd-43de-b2a3-4003f97831d3 req-f4bbe67a-ef47-44d4-8b24-b11f43890e02 service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Received event network-changed-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.compute.manager [req-1c1aebd7-bddd-43de-b2a3-4003f97831d3 req-f4bbe67a-ef47-44d4-8b24-b11f43890e02 service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Refreshing instance network info cache due to event network-changed-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1c1aebd7-bddd-43de-b2a3-4003f97831d3 req-f4bbe67a-ef47-44d4-8b24-b11f43890e02 service nova] Acquiring lock "refresh_cache-e64da6da-a4db-4613-90a4-dff7ff5775e0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.network.neutron [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.network.neutron [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Updating instance_info_cache with network_info: [{"id": "2ed8a2b5-7991-4ad5-a16d-1bf4baab3452", "address": "fa:16:3e:4b:42:9f", "network": {"id": "15d3ad7b-8680-4b88-8bb9-8a684500c41b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1843181156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30f93dc27fbe4d79a7950055315a42fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed8a2b5-79", "ovs_interfaceid": "2ed8a2b5-7991-4ad5-a16d-1bf4baab3452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Releasing lock "refresh_cache-e64da6da-a4db-4613-90a4-dff7ff5775e0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.compute.manager [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Instance network_info: |[{"id": "2ed8a2b5-7991-4ad5-a16d-1bf4baab3452", "address": "fa:16:3e:4b:42:9f", "network": {"id": "15d3ad7b-8680-4b88-8bb9-8a684500c41b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1843181156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30f93dc27fbe4d79a7950055315a42fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed8a2b5-79", "ovs_interfaceid": "2ed8a2b5-7991-4ad5-a16d-1bf4baab3452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1c1aebd7-bddd-43de-b2a3-4003f97831d3 req-f4bbe67a-ef47-44d4-8b24-b11f43890e02 service nova] Acquired lock "refresh_cache-e64da6da-a4db-4613-90a4-dff7ff5775e0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.network.neutron [req-1c1aebd7-bddd-43de-b2a3-4003f97831d3 req-f4bbe67a-ef47-44d4-8b24-b11f43890e02 service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Refreshing network info cache for port 2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Start _get_guest_xml network_info=[{"id": "2ed8a2b5-7991-4ad5-a16d-1bf4baab3452", "address": "fa:16:3e:4b:42:9f", "network": {"id": "15d3ad7b-8680-4b88-8bb9-8a684500c41b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1843181156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30f93dc27fbe4d79a7950055315a42fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed8a2b5-79", "ovs_interfaceid": "2ed8a2b5-7991-4ad5-a16d-1bf4baab3452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:44:42 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:44:42 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:44:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1590811208',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1590811208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1590811',id=43,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFg6QG1y+Or8ZlKMfzQQM6hgNjVP1lnfhhcmM5IU+qSXD+6tb4RXpXAMXC/vvpOBF/7IDwBhGb5IKICj7Tbus4wQMDbJUfG0CHB1kQi3fXtgJ7wiH9pSg9Cjnyc3bY49Rw==',key_name='tempest-keypair-1384770106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30f93dc27fbe4d79a7950055315a42fc',ramdisk_id='',reservation_id='r-r1ld6ug6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-436966306',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:44:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa19fd85ab1c409d842a6724c16cf7fa',uuid=e64da6da-a4db-4613-90a4-dff7ff5775e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ed8a2b5-7991-4ad5-a16d-1bf4baab3452", "address": "fa:16:3e:4b:42:9f", "network": {"id": "15d3ad7b-8680-4b88-8bb9-8a684500c41b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1843181156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30f93dc27fbe4d79a7950055315a42fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed8a2b5-79", "ovs_interfaceid": "2ed8a2b5-7991-4ad5-a16d-1bf4baab3452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Converting VIF {"id": "2ed8a2b5-7991-4ad5-a16d-1bf4baab3452", "address": "fa:16:3e:4b:42:9f", "network": {"id": "15d3ad7b-8680-4b88-8bb9-8a684500c41b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1843181156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30f93dc27fbe4d79a7950055315a42fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed8a2b5-79", "ovs_interfaceid": "2ed8a2b5-7991-4ad5-a16d-1bf4baab3452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:42:9f,bridge_name='br-int',has_traffic_filtering=True,id=2ed8a2b5-7991-4ad5-a16d-1bf4baab3452,network=Network(15d3ad7b-8680-4b88-8bb9-8a684500c41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed8a2b5-79') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.objects.instance [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lazy-loading 'pci_devices' on Instance uuid e64da6da-a4db-4613-90a4-dff7ff5775e0 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:44:42 user nova-compute[72150]:   <uuid>e64da6da-a4db-4613-90a4-dff7ff5775e0</uuid>
Aug 01 18:44:42 user nova-compute[72150]:   <name>instance-0000002b</name>
Aug 01 18:44:42 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:44:42 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:44:42 user nova-compute[72150]:   <metadata>
Aug 01 18:44:42 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:44:42 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:44:42 user nova-compute[72150]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1590811208</nova:name>
Aug 01 18:44:42 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:44:42</nova:creationTime>
Aug 01 18:44:42 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:44:42 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:44:42 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:44:42 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:44:42 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:44:42 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:44:42 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:44:42 user nova-compute[72150]:       <nova:owner>
Aug 01 18:44:42 user nova-compute[72150]:         <nova:user uuid="fa19fd85ab1c409d842a6724c16cf7fa">tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member</nova:user>
Aug 01 18:44:42 user nova-compute[72150]:         <nova:project uuid="30f93dc27fbe4d79a7950055315a42fc">tempest-TestServerVolumeAttachScenarioOldVersion-436966306</nova:project>
Aug 01 18:44:42 user nova-compute[72150]:       </nova:owner>
Aug 01 18:44:42 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:44:42 user nova-compute[72150]:       <nova:ports>
Aug 01 18:44:42 user nova-compute[72150]:         <nova:port uuid="2ed8a2b5-7991-4ad5-a16d-1bf4baab3452">
Aug 01 18:44:42 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 18:44:42 user nova-compute[72150]:         </nova:port>
Aug 01 18:44:42 user nova-compute[72150]:       </nova:ports>
Aug 01 18:44:42 user nova-compute[72150]:     </nova:instance>
Aug 01 18:44:42 user nova-compute[72150]:   </metadata>
Aug 01 18:44:42 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:44:42 user nova-compute[72150]:     <system>
Aug 01 18:44:42 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:44:42 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:44:42 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:44:42 user nova-compute[72150]:       <entry name="serial">e64da6da-a4db-4613-90a4-dff7ff5775e0</entry>
Aug 01 18:44:42 user nova-compute[72150]:       <entry name="uuid">e64da6da-a4db-4613-90a4-dff7ff5775e0</entry>
Aug 01 18:44:42 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:44:42 user nova-compute[72150]:     </system>
Aug 01 18:44:42 user nova-compute[72150]:   </sysinfo>
Aug 01 18:44:42 user nova-compute[72150]:   <os>
Aug 01 18:44:42 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:44:42 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:44:42 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:44:42 user nova-compute[72150]:   </os>
Aug 01 18:44:42 user nova-compute[72150]:   <features>
Aug 01 18:44:42 user nova-compute[72150]:     <acpi/>
Aug 01 18:44:42 user nova-compute[72150]:     <apic/>
Aug 01 18:44:42 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:44:42 user nova-compute[72150]:   </features>
Aug 01 18:44:42 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:44:42 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:44:42 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:44:42 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:44:42 user nova-compute[72150]:   </clock>
Aug 01 18:44:42 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:44:42 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:44:42 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:44:42 user nova-compute[72150]:   </cpu>
Aug 01 18:44:42 user nova-compute[72150]:   <devices>
Aug 01 18:44:42 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:44:42 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:44:42 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/disk"/>
Aug 01 18:44:42 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:44:42 user nova-compute[72150]:     </disk>
Aug 01 18:44:42 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:44:42 user nova-compute[72150]:       <mac address="fa:16:3e:4b:42:9f"/>
Aug 01 18:44:42 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:44:42 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:44:42 user nova-compute[72150]:       <target dev="tap2ed8a2b5-79"/>
Aug 01 18:44:42 user nova-compute[72150]:     </interface>
Aug 01 18:44:42 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:44:42 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/console.log" append="off"/>
Aug 01 18:44:42 user nova-compute[72150]:     </serial>
Aug 01 18:44:42 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:44:42 user nova-compute[72150]:     <video>
Aug 01 18:44:42 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:44:42 user nova-compute[72150]:     </video>
Aug 01 18:44:42 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:44:42 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:44:42 user nova-compute[72150]:     </rng>
Aug 01 18:44:42 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:44:42 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:44:42 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:44:42 user nova-compute[72150]:     </memballoon>
Aug 01 18:44:42 user nova-compute[72150]:   </devices>
Aug 01 18:44:42 user nova-compute[72150]: </domain>
Aug 01 18:44:42 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:44:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1590811208',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1590811208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1590811',id=43,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFg6QG1y+Or8ZlKMfzQQM6hgNjVP1lnfhhcmM5IU+qSXD+6tb4RXpXAMXC/vvpOBF/7IDwBhGb5IKICj7Tbus4wQMDbJUfG0CHB1kQi3fXtgJ7wiH9pSg9Cjnyc3bY49Rw==',key_name='tempest-keypair-1384770106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30f93dc27fbe4d79a7950055315a42fc',ramdisk_id='',reservation_id='r-r1ld6ug6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-436966306',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:44:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa19fd85ab1c409d842a6724c16cf7fa',uuid=e64da6da-a4db-4613-90a4-dff7ff5775e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ed8a2b5-7991-4ad5-a16d-1bf4baab3452", "address": "fa:16:3e:4b:42:9f", "network": {"id": "15d3ad7b-8680-4b88-8bb9-8a684500c41b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1843181156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30f93dc27fbe4d79a7950055315a42fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed8a2b5-79", "ovs_interfaceid": "2ed8a2b5-7991-4ad5-a16d-1bf4baab3452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Converting VIF {"id": "2ed8a2b5-7991-4ad5-a16d-1bf4baab3452", "address": "fa:16:3e:4b:42:9f", "network": {"id": "15d3ad7b-8680-4b88-8bb9-8a684500c41b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1843181156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30f93dc27fbe4d79a7950055315a42fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed8a2b5-79", "ovs_interfaceid": "2ed8a2b5-7991-4ad5-a16d-1bf4baab3452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:42:9f,bridge_name='br-int',has_traffic_filtering=True,id=2ed8a2b5-7991-4ad5-a16d-1bf4baab3452,network=Network(15d3ad7b-8680-4b88-8bb9-8a684500c41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed8a2b5-79') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG os_vif [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:42:9f,bridge_name='br-int',has_traffic_filtering=True,id=2ed8a2b5-7991-4ad5-a16d-1bf4baab3452,network=Network(15d3ad7b-8680-4b88-8bb9-8a684500c41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed8a2b5-79') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ed8a2b5-79, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ed8a2b5-79, col_values=(('external_ids', {'iface-id': '2ed8a2b5-7991-4ad5-a16d-1bf4baab3452', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:42:9f', 'vm-uuid': 'e64da6da-a4db-4613-90a4-dff7ff5775e0'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:42 user nova-compute[72150]: INFO os_vif [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:42:9f,bridge_name='br-int',has_traffic_filtering=True,id=2ed8a2b5-7991-4ad5-a16d-1bf4baab3452,network=Network(15d3ad7b-8680-4b88-8bb9-8a684500c41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed8a2b5-79')
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] No VIF found with MAC fa:16:3e:4b:42:9f, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.network.neutron [req-1c1aebd7-bddd-43de-b2a3-4003f97831d3 req-f4bbe67a-ef47-44d4-8b24-b11f43890e02 service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Updated VIF entry in instance network info cache for port 2ed8a2b5-7991-4ad5-a16d-1bf4baab3452. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG nova.network.neutron [req-1c1aebd7-bddd-43de-b2a3-4003f97831d3 req-f4bbe67a-ef47-44d4-8b24-b11f43890e02 service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Updating instance_info_cache with network_info: [{"id": "2ed8a2b5-7991-4ad5-a16d-1bf4baab3452", "address": "fa:16:3e:4b:42:9f", "network": {"id": "15d3ad7b-8680-4b88-8bb9-8a684500c41b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1843181156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30f93dc27fbe4d79a7950055315a42fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed8a2b5-79", "ovs_interfaceid": "2ed8a2b5-7991-4ad5-a16d-1bf4baab3452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:44:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1c1aebd7-bddd-43de-b2a3-4003f97831d3 req-f4bbe67a-ef47-44d4-8b24-b11f43890e02 service nova] Releasing lock "refresh_cache-e64da6da-a4db-4613-90a4-dff7ff5775e0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:44:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-29c4e3dd-daf0-49bf-9b9a-71700e1127ed req-f982ab8d-2bf7-4ad4-b81a-79aa37b7f249 service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Received event network-vif-plugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:44:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-29c4e3dd-daf0-49bf-9b9a-71700e1127ed req-f982ab8d-2bf7-4ad4-b81a-79aa37b7f249 service nova] Acquiring lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:44:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-29c4e3dd-daf0-49bf-9b9a-71700e1127ed req-f982ab8d-2bf7-4ad4-b81a-79aa37b7f249 service nova] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:44:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-29c4e3dd-daf0-49bf-9b9a-71700e1127ed req-f982ab8d-2bf7-4ad4-b81a-79aa37b7f249 service nova] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:44:44 user nova-compute[72150]: DEBUG nova.compute.manager [req-29c4e3dd-daf0-49bf-9b9a-71700e1127ed req-f982ab8d-2bf7-4ad4-b81a-79aa37b7f249 service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] No waiting events found dispatching network-vif-plugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:44:44 user nova-compute[72150]: WARNING nova.compute.manager [req-29c4e3dd-daf0-49bf-9b9a-71700e1127ed req-f982ab8d-2bf7-4ad4-b81a-79aa37b7f249 service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Received unexpected event network-vif-plugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 for instance with vm_state building and task_state spawning.
Aug 01 18:44:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:46 user nova-compute[72150]: DEBUG nova.compute.manager [req-f5c333c3-f691-4d44-8789-f0303878b39a req-2f0a7a6a-fd3d-4400-afee-6594ce217510 service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Received event network-vif-plugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:44:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f5c333c3-f691-4d44-8789-f0303878b39a req-2f0a7a6a-fd3d-4400-afee-6594ce217510 service nova] Acquiring lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:44:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f5c333c3-f691-4d44-8789-f0303878b39a req-2f0a7a6a-fd3d-4400-afee-6594ce217510 service nova] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:44:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f5c333c3-f691-4d44-8789-f0303878b39a req-2f0a7a6a-fd3d-4400-afee-6594ce217510 service nova] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:44:46 user nova-compute[72150]: DEBUG nova.compute.manager [req-f5c333c3-f691-4d44-8789-f0303878b39a req-2f0a7a6a-fd3d-4400-afee-6594ce217510 service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] No waiting events found dispatching network-vif-plugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:44:46 user nova-compute[72150]: WARNING nova.compute.manager [req-f5c333c3-f691-4d44-8789-f0303878b39a req-2f0a7a6a-fd3d-4400-afee-6594ce217510 service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Received unexpected event network-vif-plugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 for instance with vm_state building and task_state spawning.
Aug 01 18:44:46 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915486.3782315, e64da6da-a4db-4613-90a4-dff7ff5775e0 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:44:46 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] VM Resumed (Lifecycle Event)
Aug 01 18:44:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:44:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:44:46 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Instance spawned successfully.
Aug 01 18:44:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:44:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:44:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:44:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:44:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:44:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:44:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:44:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:44:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:44:46 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:44:46 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915486.3800368, e64da6da-a4db-4613-90a4-dff7ff5775e0 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:44:46 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] VM Started (Lifecycle Event)
Aug 01 18:44:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:44:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:44:46 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:44:46 user nova-compute[72150]: INFO nova.compute.manager [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Took 5.81 seconds to spawn the instance on the hypervisor.
Aug 01 18:44:46 user nova-compute[72150]: DEBUG nova.compute.manager [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:44:46 user nova-compute[72150]: INFO nova.compute.manager [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Took 6.57 seconds to build instance.
Aug 01 18:44:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-af03841c-db25-4678-868e-7fca0a6c4513 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.789s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:44:46 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:44:46 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:44:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:47 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:44:47 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:44:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:44:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:44:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:44:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:44:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:44:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:44:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:44:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:44:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:44:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:44:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:44:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:44:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:44:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:44:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:44:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:44:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:44:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:44:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:44:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:44:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:44:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:44:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:44:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:44:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:44:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:50 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:44:50 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:44:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8132MB free_disk=25.315967559814453GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:44:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:44:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:44:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 08851ec4-6f71-4ec1-a092-42aab83ee87f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:44:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 42e75a98-beb1-4688-a375-affc63b14252 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:44:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 737a8853-f9b9-4a0b-95a1-200d72c4d806 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:44:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:44:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance e6831e19-1dc8-470a-8151-9896d8fea013 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:44:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance e64da6da-a4db-4613-90a4-dff7ff5775e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:44:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:44:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:44:50 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:44:50 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:44:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:44:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:44:52 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:44:52 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:44:52 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:44:52 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:44:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:52 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:44:52 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:44:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-737a8853-f9b9-4a0b-95a1-200d72c4d806" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:44:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-737a8853-f9b9-4a0b-95a1-200d72c4d806" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:44:52 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:44:53 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Updating instance_info_cache with network_info: [{"id": "67195cf7-c741-410b-9937-c55bc570631f", "address": "fa:16:3e:ae:2a:f2", "network": {"id": "c7354620-f943-40a7-a673-5e6e9103498d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205923950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871994ab4c4848dfbe070a8d9c8d1d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67195cf7-c7", "ovs_interfaceid": "67195cf7-c741-410b-9937-c55bc570631f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:44:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-737a8853-f9b9-4a0b-95a1-200d72c4d806" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:44:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:44:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:44:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-f631e524-1614-42ba-9623-fe459f4f3171 req-562b58f8-4b85-41d0-a0e1-a9b1c165a4e7 service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Received event network-changed-30bd4e9a-f1bf-48df-962e-296027da9d23 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:45:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-f631e524-1614-42ba-9623-fe459f4f3171 req-562b58f8-4b85-41d0-a0e1-a9b1c165a4e7 service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Refreshing instance network info cache due to event network-changed-30bd4e9a-f1bf-48df-962e-296027da9d23. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:45:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f631e524-1614-42ba-9623-fe459f4f3171 req-562b58f8-4b85-41d0-a0e1-a9b1c165a4e7 service nova] Acquiring lock "refresh_cache-ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:45:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f631e524-1614-42ba-9623-fe459f4f3171 req-562b58f8-4b85-41d0-a0e1-a9b1c165a4e7 service nova] Acquired lock "refresh_cache-ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:45:10 user nova-compute[72150]: DEBUG nova.network.neutron [req-f631e524-1614-42ba-9623-fe459f4f3171 req-562b58f8-4b85-41d0-a0e1-a9b1c165a4e7 service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Refreshing network info cache for port 30bd4e9a-f1bf-48df-962e-296027da9d23 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:45:11 user nova-compute[72150]: DEBUG nova.network.neutron [req-f631e524-1614-42ba-9623-fe459f4f3171 req-562b58f8-4b85-41d0-a0e1-a9b1c165a4e7 service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Updated VIF entry in instance network info cache for port 30bd4e9a-f1bf-48df-962e-296027da9d23. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:45:11 user nova-compute[72150]: DEBUG nova.network.neutron [req-f631e524-1614-42ba-9623-fe459f4f3171 req-562b58f8-4b85-41d0-a0e1-a9b1c165a4e7 service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Updating instance_info_cache with network_info: [{"id": "30bd4e9a-f1bf-48df-962e-296027da9d23", "address": "fa:16:3e:9d:a6:13", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bd4e9a-f1", "ovs_interfaceid": "30bd4e9a-f1bf-48df-962e-296027da9d23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:45:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-f631e524-1614-42ba-9623-fe459f4f3171 req-562b58f8-4b85-41d0-a0e1-a9b1c165a4e7 service nova] Releasing lock "refresh_cache-ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:45:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "42e75a98-beb1-4688-a375-affc63b14252" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "42e75a98-beb1-4688-a375-affc63b14252" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "42e75a98-beb1-4688-a375-affc63b14252-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:45:14 user nova-compute[72150]: INFO nova.compute.manager [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Terminating instance
Aug 01 18:45:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG nova.objects.instance [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lazy-loading 'flavor' on Instance uuid ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:45:14 user nova-compute[72150]: INFO nova.compute.manager [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Attaching volume 7d973040-1553-4600-b982-ed6110491d44 to /dev/vdb
Aug 01 18:45:14 user nova-compute[72150]: DEBUG nova.compute.manager [req-37d05cf1-6e75-4802-81c8-13f2345d46f5 req-4454db0b-1ee6-4400-a413-17e54ded19d5 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received event network-vif-unplugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-37d05cf1-6e75-4802-81c8-13f2345d46f5 req-4454db0b-1ee6-4400-a413-17e54ded19d5 service nova] Acquiring lock "42e75a98-beb1-4688-a375-affc63b14252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-37d05cf1-6e75-4802-81c8-13f2345d46f5 req-4454db0b-1ee6-4400-a413-17e54ded19d5 service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-37d05cf1-6e75-4802-81c8-13f2345d46f5 req-4454db0b-1ee6-4400-a413-17e54ded19d5 service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG nova.compute.manager [req-37d05cf1-6e75-4802-81c8-13f2345d46f5 req-4454db0b-1ee6-4400-a413-17e54ded19d5 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] No waiting events found dispatching network-vif-unplugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG nova.compute.manager [req-37d05cf1-6e75-4802-81c8-13f2345d46f5 req-4454db0b-1ee6-4400-a413-17e54ded19d5 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received event network-vif-unplugged-10529340-a252-4604-accb-19f26670f125 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG os_brick.utils [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9706e746-6a36-45bc-bf54-3f3499698c60]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0274afa1-494c-4f2b-9574-de4bb31fbdf9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5ada1b-746f-492c-9777-d8084a28664d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4287eb-4f39-4fa4-9fc9-5c1c1f473ee1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:45:14 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:45:14 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b29d66-fbf8-473f-8dcd-46b3cde550bf]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_brick.utils [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Updating existing volume attachment record: 4e47a2a6-72c0-44e9-88ed-81afe5af80c7 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:15 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Instance destroyed successfully.
Aug 01 18:45:15 user nova-compute[72150]: DEBUG nova.objects.instance [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'resources' on Instance uuid 42e75a98-beb1-4688-a375-affc63b14252 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-295206461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-295206461',id=22,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:31:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ad8ef64d051424e9fe644a1fb40fcb4',ramdisk_id='',reservation_id='r-r7xnryv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-23372548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:33:13Z,user_data=None,user_id='cc00b9006f5842c6b875c5d25538b718',uuid=42e75a98-beb1-4688-a375-affc63b14252,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10529340-a252-4604-accb-19f26670f125", "address": "fa:16:3e:56:f4:53", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10529340-a2", "ovs_interfaceid": "10529340-a252-4604-accb-19f26670f125", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converting VIF {"id": "10529340-a252-4604-accb-19f26670f125", "address": "fa:16:3e:56:f4:53", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10529340-a2", "ovs_interfaceid": "10529340-a252-4604-accb-19f26670f125", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:f4:53,bridge_name='br-int',has_traffic_filtering=True,id=10529340-a252-4604-accb-19f26670f125,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10529340-a2') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_vif [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:f4:53,bridge_name='br-int',has_traffic_filtering=True,id=10529340-a252-4604-accb-19f26670f125,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10529340-a2') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10529340-a2, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:45:15 user nova-compute[72150]: INFO os_vif [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:f4:53,bridge_name='br-int',has_traffic_filtering=True,id=10529340-a252-4604-accb-19f26670f125,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10529340-a2')
Aug 01 18:45:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qRsPIbfH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:45:15 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb18759-d4e8-47a5-9120-cf7107ed1b3a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca6c8b3-a677-498b-85ca-138166c04039]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:45:15 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e (non-flash)
Aug 01 18:45:15 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c48da20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e'): ({'sdc'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Removing single pathed devices sdc {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18a4a74-1172-4541-bca8-059e1227b348]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[308761e6-eec0-4ed2-81a7-9c8c08e295c3]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Flushing IO for device /dev/sdc {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[396ec8a9-2955-4cb5-98b9-3d07c9e27f3d]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9693d70-a268-4fea-bec8-d040ab05164e]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] SCSI volumes sdc have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c83e74-8785-468e-9638-464f3c2fe30c]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83ca3d7-f6f8-40c6-9486-0511e89af7c9]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e, portal: 172.16.0.220,3260]
Aug 01 18:45:15 user nova-compute[72150]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e, portal: 172.16.0.220,3260] successful.
Aug 01 18:45:15 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630abcbe-8adc-4bfd-9acb-228c83952d0e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f78c8c-6b2a-4207-80cd-7ac71e0184ec]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.247s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] <== disconnect_volume: return (250ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:45:15 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Deleting instance files /opt/stack/data/nova/instances/42e75a98-beb1-4688-a375-affc63b14252_del
Aug 01 18:45:15 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Deletion of /opt/stack/data/nova/instances/42e75a98-beb1-4688-a375-affc63b14252_del complete
Aug 01 18:45:15 user nova-compute[72150]: INFO nova.compute.manager [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 01 18:45:15 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 42e75a98-beb1-4688-a375-affc63b14252] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:16 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:45:16 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Took 0.51 seconds to deallocate network for instance.
Aug 01 18:45:16 user nova-compute[72150]: DEBUG nova.compute.manager [req-f3817da3-f7f3-4e2e-89b6-f9fac5d922cb req-b169523a-79e1-42df-88c1-9063617cabb1 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received event network-vif-deleted-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:45:16 user nova-compute[72150]: INFO nova.compute.manager [req-f3817da3-f7f3-4e2e-89b6-f9fac5d922cb req-b169523a-79e1-42df-88c1-9063617cabb1 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Neutron deleted interface 10529340-a252-4604-accb-19f26670f125; detaching it from the instance and deleting it from the info cache
Aug 01 18:45:16 user nova-compute[72150]: DEBUG nova.network.neutron [req-f3817da3-f7f3-4e2e-89b6-f9fac5d922cb req-b169523a-79e1-42df-88c1-9063617cabb1 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:45:16 user nova-compute[72150]: DEBUG nova.compute.manager [req-f3817da3-f7f3-4e2e-89b6-f9fac5d922cb req-b169523a-79e1-42df-88c1-9063617cabb1 service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Detach interface failed, port_id=10529340-a252-4604-accb-19f26670f125, reason: Instance 42e75a98-beb1-4688-a375-affc63b14252 could not be found. {{(pid=72150) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 18:45:16 user nova-compute[72150]: DEBUG nova.compute.manager [req-4b666dcd-6225-4ade-8185-7d6b843c8e1c req-3b4f5c42-4c9a-4615-a1e0-e97b64ff1f5d service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:45:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4b666dcd-6225-4ade-8185-7d6b843c8e1c req-3b4f5c42-4c9a-4615-a1e0-e97b64ff1f5d service nova] Acquiring lock "42e75a98-beb1-4688-a375-affc63b14252-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:45:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4b666dcd-6225-4ade-8185-7d6b843c8e1c req-3b4f5c42-4c9a-4615-a1e0-e97b64ff1f5d service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:45:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4b666dcd-6225-4ade-8185-7d6b843c8e1c req-3b4f5c42-4c9a-4615-a1e0-e97b64ff1f5d service nova] Lock "42e75a98-beb1-4688-a375-affc63b14252-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:45:16 user nova-compute[72150]: DEBUG nova.compute.manager [req-4b666dcd-6225-4ade-8185-7d6b843c8e1c req-3b4f5c42-4c9a-4615-a1e0-e97b64ff1f5d service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] No waiting events found dispatching network-vif-plugged-10529340-a252-4604-accb-19f26670f125 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:45:16 user nova-compute[72150]: WARNING nova.compute.manager [req-4b666dcd-6225-4ade-8185-7d6b843c8e1c req-3b4f5c42-4c9a-4615-a1e0-e97b64ff1f5d service nova] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Received unexpected event network-vif-plugged-10529340-a252-4604-accb-19f26670f125 for instance with vm_state active and task_state deleting.
Aug 01 18:45:17 user nova-compute[72150]: INFO nova.compute.manager [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Took 0.91 seconds to detach 1 volumes for instance.
Aug 01 18:45:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:45:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:45:17 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:45:17 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:45:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:45:17 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Deleted allocations for instance 42e75a98-beb1-4688-a375-affc63b14252
Aug 01 18:45:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cbe223ef-1d62-48e7-bd0d-553cc7ebf8b1 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "42e75a98-beb1-4688-a375-affc63b14252" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.061s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:45:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UHNErDtC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:45:22 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:45:22 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:45:22 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8545c749-0e4a-454f-a8a3-c46057cfb20f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:45:22 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[194b0a33-ff8f-4b52-b951-0fe08f9673b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44] added
Aug 01 18:45:22 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[808056b6-bca4-4f07-9c38-beb0a63c552a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3e3676-e068-4e56-9edb-88b460442ed2]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UHNErDtC {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UHNErDtC" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa8d5bb-19b8-4af5-888e-2ea3dcd3baf1]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UHNErDtC'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b71013-ceb9-49d8-b03d-3cbb0fb0e8a6]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d1fae4-ffc6-4762-ad96-e873fc9e0c65]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 18:45:22 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 18:45:22 user nova-compute[72150]:  {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:45:22 user nova-compute[72150]: WARNING os_brick.initiator.connectors.iscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 18:45:22 user nova-compute[72150]: 
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1da6465-67c1-45d0-875e-eb7854bb1e3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44, portal: 172.16.0.220,3260]
Aug 01 18:45:22 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44, portal: 172.16.0.220,3260] successful.
Aug 01 18:45:22 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c33857d-8e65-4b22-a685-5803d28d4241]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3342dae3-1f79-405d-95c5-4e93dc03667d]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 (non-flash)
Aug 01 18:45:22 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 (non-flash)
Aug 01 18:45:22 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4ae2d3-6942-4aa7-af5e-ef309701b9a8]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:45:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UHNErDtC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:45:23 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:45:23 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23737663461396261', 'path': '/dev/sdb'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:45:23 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737663461396261', 'path': '/dev/sdb'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:45:23 user nova-compute[72150]: DEBUG nova.objects.instance [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lazy-loading 'flavor' on Instance uuid ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:45:23 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:45:23 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:45:23 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 18:45:23 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:45:23 user nova-compute[72150]:   <serial>7d973040-1553-4600-b982-ed6110491d44</serial>
Aug 01 18:45:23 user nova-compute[72150]: </disk>
Aug 01 18:45:23 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:45:23 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:45:23 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:45:23 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] No VIF found with MAC fa:16:3e:9d:a6:13, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:45:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e1595724-a31a-45b6-b30d-a0c45b397677 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.309s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:45:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:45:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:45:24 user nova-compute[72150]: INFO nova.compute.manager [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Detaching volume 7d973040-1553-4600-b982-ed6110491d44
Aug 01 18:45:24 user nova-compute[72150]: INFO nova.virt.block_device [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Attempting to driver detach volume 7d973040-1553-4600-b982-ed6110491d44 from mountpoint /dev/vdb
Aug 01 18:45:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Attempting to detach device vdb from instance ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:45:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:45:24 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:45:24 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 18:45:24 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:45:24 user nova-compute[72150]:   <serial>7d973040-1553-4600-b982-ed6110491d44</serial>
Aug 01 18:45:24 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:45:24 user nova-compute[72150]: </disk>
Aug 01 18:45:24 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:45:24 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Successfully detached device vdb from instance ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c from the persistent domain config.
Aug 01 18:45:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:45:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:45:24 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:45:24 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 18:45:24 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:45:24 user nova-compute[72150]:   <serial>7d973040-1553-4600-b982-ed6110491d44</serial>
Aug 01 18:45:24 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:45:24 user nova-compute[72150]: </disk>
Aug 01 18:45:24 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690915525.3722777, ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:45:25 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Successfully detached device vdb from instance ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c from the live domain config.
Aug 01 18:45:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UHNErDtC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:45:25 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:45:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3b7e52-c4ae-4edf-bb08-34cade1d29b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3284ff02-3b10-46ea-a487-82f0ee964536]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 (non-flash)
Aug 01 18:45:25 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 (non-flash)
Aug 01 18:45:25 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c1a97e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44'): ({'sdb'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Removing single pathed devices sdb {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[316cc529-4347-44e1-b739-27cbd07b29a1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6785db76-5613-4096-a9dc-636007d0bfde]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Flushing IO for device /dev/sdb {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f0fdf3-4938-4696-ba42-cdf94740b33e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[797230ee-08fa-49af-8904-c4527f833761]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e38c32-5ed8-4f69-a4c0-beb82a571ff2]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a217eca7-6e6f-4706-95eb-65a0feacdf82]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44, portal: 172.16.0.220,3260]
Aug 01 18:45:25 user nova-compute[72150]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44, portal: 172.16.0.220,3260] successful.
Aug 01 18:45:25 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d973040-1553-4600-b982-ed6110491d44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d98312-96fc-4689-802f-11536bc8ab03]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.247s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] <== disconnect_volume: return (248ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:45:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:45:26 user nova-compute[72150]: DEBUG nova.objects.instance [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lazy-loading 'flavor' on Instance uuid ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:45:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7b3ba58e-23b1-4ffe-9d32-8bdfea194e12 tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.728s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:45:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:30 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915515.3146482, 42e75a98-beb1-4688-a375-affc63b14252 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:45:30 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 42e75a98-beb1-4688-a375-affc63b14252] VM Stopped (Lifecycle Event)
Aug 01 18:45:30 user nova-compute[72150]: DEBUG nova.compute.manager [None req-5e897691-1f91-4155-bef0-9cb033895bb5 None None] [instance: 42e75a98-beb1-4688-a375-affc63b14252] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:45:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:45:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:45:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:45:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:45:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:45:38 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:45:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:45:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:45:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:45:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:45:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:46 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:45:46 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:45:47 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:45:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:45:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:45:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:45:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:45:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:45:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:45:49 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:45:49 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:45:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8222MB free_disk=25.284587860107422GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:45:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:45:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:45:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 08851ec4-6f71-4ec1-a092-42aab83ee87f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:45:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 737a8853-f9b9-4a0b-95a1-200d72c4d806 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:45:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:45:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance e6831e19-1dc8-470a-8151-9896d8fea013 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:45:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance e64da6da-a4db-4613-90a4-dff7ff5775e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:45:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:45:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:45:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:45:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:45:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:45:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:45:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:45:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:50 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:45:50 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:45:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:45:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.563s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:45:52 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:45:52 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:45:52 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:45:52 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:45:52 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:45:52 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:45:52 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:45:52 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Didn't find any instances for network info cache update. {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 18:45:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:45:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Acquiring lock "737a8853-f9b9-4a0b-95a1-200d72c4d806" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:45:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "737a8853-f9b9-4a0b-95a1-200d72c4d806" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:45:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Acquiring lock "737a8853-f9b9-4a0b-95a1-200d72c4d806-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:45:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "737a8853-f9b9-4a0b-95a1-200d72c4d806-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:45:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "737a8853-f9b9-4a0b-95a1-200d72c4d806-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:45:56 user nova-compute[72150]: INFO nova.compute.manager [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Terminating instance
Aug 01 18:45:56 user nova-compute[72150]: DEBUG nova.compute.manager [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:45:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-48716933-f4d6-476b-bef7-c673bb9f9c80 req-c0855b44-ba9b-4f8f-8d91-28a61ad1df17 service nova] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Received event network-vif-unplugged-67195cf7-c741-410b-9937-c55bc570631f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:45:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-48716933-f4d6-476b-bef7-c673bb9f9c80 req-c0855b44-ba9b-4f8f-8d91-28a61ad1df17 service nova] Acquiring lock "737a8853-f9b9-4a0b-95a1-200d72c4d806-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:45:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-48716933-f4d6-476b-bef7-c673bb9f9c80 req-c0855b44-ba9b-4f8f-8d91-28a61ad1df17 service nova] Lock "737a8853-f9b9-4a0b-95a1-200d72c4d806-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:45:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-48716933-f4d6-476b-bef7-c673bb9f9c80 req-c0855b44-ba9b-4f8f-8d91-28a61ad1df17 service nova] Lock "737a8853-f9b9-4a0b-95a1-200d72c4d806-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:45:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-48716933-f4d6-476b-bef7-c673bb9f9c80 req-c0855b44-ba9b-4f8f-8d91-28a61ad1df17 service nova] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] No waiting events found dispatching network-vif-unplugged-67195cf7-c741-410b-9937-c55bc570631f {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:45:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-48716933-f4d6-476b-bef7-c673bb9f9c80 req-c0855b44-ba9b-4f8f-8d91-28a61ad1df17 service nova] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Received event network-vif-unplugged-67195cf7-c741-410b-9937-c55bc570631f for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:45:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:57 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Instance destroyed successfully.
Aug 01 18:45:57 user nova-compute[72150]: DEBUG nova.objects.instance [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lazy-loading 'resources' on Instance uuid 737a8853-f9b9-4a0b-95a1-200d72c4d806 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:45:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:37:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1874196053',display_name='tempest-ServersNegativeTestJSON-server-1874196053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1874196053',id=34,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:37:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='871994ab4c4848dfbe070a8d9c8d1d4e',ramdisk_id='',reservation_id='r-6744yyrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1642498340',owner_user_name='tempest-ServersNegativeTestJSON-1642498340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:37:15Z,user_data=None,user_id='dccfa49288a945b9b0707c140b0b2cbb',uuid=737a8853-f9b9-4a0b-95a1-200d72c4d806,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67195cf7-c741-410b-9937-c55bc570631f", "address": "fa:16:3e:ae:2a:f2", "network": {"id": "c7354620-f943-40a7-a673-5e6e9103498d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205923950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871994ab4c4848dfbe070a8d9c8d1d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67195cf7-c7", "ovs_interfaceid": "67195cf7-c741-410b-9937-c55bc570631f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:45:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Converting VIF {"id": "67195cf7-c741-410b-9937-c55bc570631f", "address": "fa:16:3e:ae:2a:f2", "network": {"id": "c7354620-f943-40a7-a673-5e6e9103498d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205923950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871994ab4c4848dfbe070a8d9c8d1d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67195cf7-c7", "ovs_interfaceid": "67195cf7-c741-410b-9937-c55bc570631f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:45:57 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:2a:f2,bridge_name='br-int',has_traffic_filtering=True,id=67195cf7-c741-410b-9937-c55bc570631f,network=Network(c7354620-f943-40a7-a673-5e6e9103498d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67195cf7-c7') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:45:57 user nova-compute[72150]: DEBUG os_vif [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:2a:f2,bridge_name='br-int',has_traffic_filtering=True,id=67195cf7-c741-410b-9937-c55bc570631f,network=Network(c7354620-f943-40a7-a673-5e6e9103498d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67195cf7-c7') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:45:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67195cf7-c7, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:45:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:45:57 user nova-compute[72150]: INFO os_vif [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:2a:f2,bridge_name='br-int',has_traffic_filtering=True,id=67195cf7-c741-410b-9937-c55bc570631f,network=Network(c7354620-f943-40a7-a673-5e6e9103498d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67195cf7-c7')
Aug 01 18:45:57 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Deleting instance files /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806_del
Aug 01 18:45:57 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Deletion of /opt/stack/data/nova/instances/737a8853-f9b9-4a0b-95a1-200d72c4d806_del complete
Aug 01 18:45:57 user nova-compute[72150]: INFO nova.compute.manager [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 01 18:45:57 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:45:57 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:45:57 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:45:57 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:45:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:45:57 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:45:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-e711ac86-1483-488c-8f78-fbbff335a7d3 req-4329012d-f2e8-453e-af7f-d8f7a82aac16 service nova] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Received event network-vif-deleted-67195cf7-c741-410b-9937-c55bc570631f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:45:57 user nova-compute[72150]: INFO nova.compute.manager [req-e711ac86-1483-488c-8f78-fbbff335a7d3 req-4329012d-f2e8-453e-af7f-d8f7a82aac16 service nova] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Neutron deleted interface 67195cf7-c741-410b-9937-c55bc570631f; detaching it from the instance and deleting it from the info cache
Aug 01 18:45:57 user nova-compute[72150]: DEBUG nova.network.neutron [req-e711ac86-1483-488c-8f78-fbbff335a7d3 req-4329012d-f2e8-453e-af7f-d8f7a82aac16 service nova] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:45:57 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Took 0.55 seconds to deallocate network for instance.
Aug 01 18:45:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-e711ac86-1483-488c-8f78-fbbff335a7d3 req-4329012d-f2e8-453e-af7f-d8f7a82aac16 service nova] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Detach interface failed, port_id=67195cf7-c741-410b-9937-c55bc570631f, reason: Instance 737a8853-f9b9-4a0b-95a1-200d72c4d806 could not be found. {{(pid=72150) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 18:45:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:45:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:45:58 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:45:58 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:45:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:45:58 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Deleted allocations for instance 737a8853-f9b9-4a0b-95a1-200d72c4d806
Aug 01 18:45:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c93c1612-8bac-47d8-9c96-130d47e00317 tempest-ServersNegativeTestJSON-1642498340 tempest-ServersNegativeTestJSON-1642498340-project-member] Lock "737a8853-f9b9-4a0b-95a1-200d72c4d806" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.797s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:45:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-9b9cafed-48bb-44ae-9dd0-4d7ee85401ac req-2d9934e2-6477-478e-82cb-34dac0a3f6b7 service nova] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Received event network-vif-plugged-67195cf7-c741-410b-9937-c55bc570631f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:45:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9b9cafed-48bb-44ae-9dd0-4d7ee85401ac req-2d9934e2-6477-478e-82cb-34dac0a3f6b7 service nova] Acquiring lock "737a8853-f9b9-4a0b-95a1-200d72c4d806-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:45:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9b9cafed-48bb-44ae-9dd0-4d7ee85401ac req-2d9934e2-6477-478e-82cb-34dac0a3f6b7 service nova] Lock "737a8853-f9b9-4a0b-95a1-200d72c4d806-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:45:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9b9cafed-48bb-44ae-9dd0-4d7ee85401ac req-2d9934e2-6477-478e-82cb-34dac0a3f6b7 service nova] Lock "737a8853-f9b9-4a0b-95a1-200d72c4d806-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:45:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-9b9cafed-48bb-44ae-9dd0-4d7ee85401ac req-2d9934e2-6477-478e-82cb-34dac0a3f6b7 service nova] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] No waiting events found dispatching network-vif-plugged-67195cf7-c741-410b-9937-c55bc570631f {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:45:58 user nova-compute[72150]: WARNING nova.compute.manager [req-9b9cafed-48bb-44ae-9dd0-4d7ee85401ac req-2d9934e2-6477-478e-82cb-34dac0a3f6b7 service nova] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Received unexpected event network-vif-plugged-67195cf7-c741-410b-9937-c55bc570631f for instance with vm_state deleted and task_state None.
Aug 01 18:46:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "08851ec4-6f71-4ec1-a092-42aab83ee87f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:46:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "08851ec4-6f71-4ec1-a092-42aab83ee87f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:46:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "08851ec4-6f71-4ec1-a092-42aab83ee87f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:46:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "08851ec4-6f71-4ec1-a092-42aab83ee87f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:46:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "08851ec4-6f71-4ec1-a092-42aab83ee87f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:46:05 user nova-compute[72150]: INFO nova.compute.manager [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Terminating instance
Aug 01 18:46:05 user nova-compute[72150]: DEBUG nova.compute.manager [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:46:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:05 user nova-compute[72150]: DEBUG nova.compute.manager [req-0f195754-f743-4f11-a8b4-0762e1f6f6c7 req-0de63b86-e6b4-48a4-bf2f-1bd55976e49d service nova] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Received event network-vif-unplugged-8c860dfa-7333-4fec-8d5c-573c1c53063f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:46:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0f195754-f743-4f11-a8b4-0762e1f6f6c7 req-0de63b86-e6b4-48a4-bf2f-1bd55976e49d service nova] Acquiring lock "08851ec4-6f71-4ec1-a092-42aab83ee87f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:46:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0f195754-f743-4f11-a8b4-0762e1f6f6c7 req-0de63b86-e6b4-48a4-bf2f-1bd55976e49d service nova] Lock "08851ec4-6f71-4ec1-a092-42aab83ee87f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:46:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0f195754-f743-4f11-a8b4-0762e1f6f6c7 req-0de63b86-e6b4-48a4-bf2f-1bd55976e49d service nova] Lock "08851ec4-6f71-4ec1-a092-42aab83ee87f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:46:05 user nova-compute[72150]: DEBUG nova.compute.manager [req-0f195754-f743-4f11-a8b4-0762e1f6f6c7 req-0de63b86-e6b4-48a4-bf2f-1bd55976e49d service nova] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] No waiting events found dispatching network-vif-unplugged-8c860dfa-7333-4fec-8d5c-573c1c53063f {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:46:05 user nova-compute[72150]: DEBUG nova.compute.manager [req-0f195754-f743-4f11-a8b4-0762e1f6f6c7 req-0de63b86-e6b4-48a4-bf2f-1bd55976e49d service nova] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Received event network-vif-unplugged-8c860dfa-7333-4fec-8d5c-573c1c53063f for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:46:06 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Instance destroyed successfully.
Aug 01 18:46:06 user nova-compute[72150]: DEBUG nova.objects.instance [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lazy-loading 'resources' on Instance uuid 08851ec4-6f71-4ec1-a092-42aab83ee87f {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:46:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-242653114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-242653114',id=15,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:26:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ad8ef64d051424e9fe644a1fb40fcb4',ramdisk_id='',reservation_id='r-by3s1hi8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-23372548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:28:24Z,user_data=None,user_id='cc00b9006f5842c6b875c5d25538b718',uuid=08851ec4-6f71-4ec1-a092-42aab83ee87f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "address": "fa:16:3e:e4:fb:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c860dfa-73", "ovs_interfaceid": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:46:06 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converting VIF {"id": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "address": "fa:16:3e:e4:fb:5a", "network": {"id": "3f0d6d76-eb36-4b93-81b0-87efecb71545", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-862766735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ad8ef64d051424e9fe644a1fb40fcb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c860dfa-73", "ovs_interfaceid": "8c860dfa-7333-4fec-8d5c-573c1c53063f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:46:06 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:fb:5a,bridge_name='br-int',has_traffic_filtering=True,id=8c860dfa-7333-4fec-8d5c-573c1c53063f,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c860dfa-73') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:46:06 user nova-compute[72150]: DEBUG os_vif [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:fb:5a,bridge_name='br-int',has_traffic_filtering=True,id=8c860dfa-7333-4fec-8d5c-573c1c53063f,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c860dfa-73') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:46:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c860dfa-73, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:46:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:46:06 user nova-compute[72150]: INFO os_vif [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:fb:5a,bridge_name='br-int',has_traffic_filtering=True,id=8c860dfa-7333-4fec-8d5c-573c1c53063f,network=Network(3f0d6d76-eb36-4b93-81b0-87efecb71545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c860dfa-73')
Aug 01 18:46:06 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Deleting instance files /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f_del
Aug 01 18:46:06 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Deletion of /opt/stack/data/nova/instances/08851ec4-6f71-4ec1-a092-42aab83ee87f_del complete
Aug 01 18:46:06 user nova-compute[72150]: INFO nova.compute.manager [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 01 18:46:06 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:46:06 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:46:06 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:46:06 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:46:06 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Took 0.48 seconds to deallocate network for instance.
Aug 01 18:46:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:46:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:46:06 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:46:06 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:46:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:46:06 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Deleted allocations for instance 08851ec4-6f71-4ec1-a092-42aab83ee87f
Aug 01 18:46:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-4cebbcff-cb80-41b4-a0f6-d2b35c54d723 tempest-ServerBootFromVolumeStableRescueTest-23372548 tempest-ServerBootFromVolumeStableRescueTest-23372548-project-member] Lock "08851ec4-6f71-4ec1-a092-42aab83ee87f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.706s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:46:07 user nova-compute[72150]: DEBUG nova.compute.manager [req-0a8d1904-50a1-482b-b159-ef4f830e049b req-08770de0-dac0-4742-9f14-c438bf002957 service nova] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Received event network-vif-plugged-8c860dfa-7333-4fec-8d5c-573c1c53063f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:46:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0a8d1904-50a1-482b-b159-ef4f830e049b req-08770de0-dac0-4742-9f14-c438bf002957 service nova] Acquiring lock "08851ec4-6f71-4ec1-a092-42aab83ee87f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:46:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0a8d1904-50a1-482b-b159-ef4f830e049b req-08770de0-dac0-4742-9f14-c438bf002957 service nova] Lock "08851ec4-6f71-4ec1-a092-42aab83ee87f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:46:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0a8d1904-50a1-482b-b159-ef4f830e049b req-08770de0-dac0-4742-9f14-c438bf002957 service nova] Lock "08851ec4-6f71-4ec1-a092-42aab83ee87f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:46:07 user nova-compute[72150]: DEBUG nova.compute.manager [req-0a8d1904-50a1-482b-b159-ef4f830e049b req-08770de0-dac0-4742-9f14-c438bf002957 service nova] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] No waiting events found dispatching network-vif-plugged-8c860dfa-7333-4fec-8d5c-573c1c53063f {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:46:07 user nova-compute[72150]: WARNING nova.compute.manager [req-0a8d1904-50a1-482b-b159-ef4f830e049b req-08770de0-dac0-4742-9f14-c438bf002957 service nova] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Received unexpected event network-vif-plugged-8c860dfa-7333-4fec-8d5c-573c1c53063f for instance with vm_state deleted and task_state None.
Aug 01 18:46:07 user nova-compute[72150]: DEBUG nova.compute.manager [req-0a8d1904-50a1-482b-b159-ef4f830e049b req-08770de0-dac0-4742-9f14-c438bf002957 service nova] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Received event network-vif-deleted-8c860dfa-7333-4fec-8d5c-573c1c53063f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:46:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:12 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915557.2943044, 737a8853-f9b9-4a0b-95a1-200d72c4d806 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:46:12 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] VM Stopped (Lifecycle Event)
Aug 01 18:46:12 user nova-compute[72150]: DEBUG nova.compute.manager [None req-291a9a15-aa1e-410b-ab8b-01f7a54fb5bb None None] [instance: 737a8853-f9b9-4a0b-95a1-200d72c4d806] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:46:13 user nova-compute[72150]: DEBUG nova.compute.manager [req-d564e022-af35-4f70-a0b6-6c1037d0b371 req-01bcfe88-31e0-4cd8-898f-73b337ed1597 service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received event network-changed-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:46:13 user nova-compute[72150]: DEBUG nova.compute.manager [req-d564e022-af35-4f70-a0b6-6c1037d0b371 req-01bcfe88-31e0-4cd8-898f-73b337ed1597 service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Refreshing instance network info cache due to event network-changed-34f12530-76e7-453e-b503-4756ee0cb4a5. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:46:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d564e022-af35-4f70-a0b6-6c1037d0b371 req-01bcfe88-31e0-4cd8-898f-73b337ed1597 service nova] Acquiring lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:46:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d564e022-af35-4f70-a0b6-6c1037d0b371 req-01bcfe88-31e0-4cd8-898f-73b337ed1597 service nova] Acquired lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:46:13 user nova-compute[72150]: DEBUG nova.network.neutron [req-d564e022-af35-4f70-a0b6-6c1037d0b371 req-01bcfe88-31e0-4cd8-898f-73b337ed1597 service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Refreshing network info cache for port 34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:46:14 user nova-compute[72150]: DEBUG nova.network.neutron [req-d564e022-af35-4f70-a0b6-6c1037d0b371 req-01bcfe88-31e0-4cd8-898f-73b337ed1597 service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Updated VIF entry in instance network info cache for port 34f12530-76e7-453e-b503-4756ee0cb4a5. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:46:14 user nova-compute[72150]: DEBUG nova.network.neutron [req-d564e022-af35-4f70-a0b6-6c1037d0b371 req-01bcfe88-31e0-4cd8-898f-73b337ed1597 service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Updating instance_info_cache with network_info: [{"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:46:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d564e022-af35-4f70-a0b6-6c1037d0b371 req-01bcfe88-31e0-4cd8-898f-73b337ed1597 service nova] Releasing lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:46:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:46:15 user nova-compute[72150]: INFO nova.compute.manager [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Terminating instance
Aug 01 18:46:15 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG nova.compute.manager [req-8c82ec08-e02b-4a60-9a8a-4c1c25061670 req-14025ddc-3eee-4cce-aaa9-5ae5e215b2cb service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Received event network-vif-unplugged-30bd4e9a-f1bf-48df-962e-296027da9d23 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8c82ec08-e02b-4a60-9a8a-4c1c25061670 req-14025ddc-3eee-4cce-aaa9-5ae5e215b2cb service nova] Acquiring lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8c82ec08-e02b-4a60-9a8a-4c1c25061670 req-14025ddc-3eee-4cce-aaa9-5ae5e215b2cb service nova] Lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8c82ec08-e02b-4a60-9a8a-4c1c25061670 req-14025ddc-3eee-4cce-aaa9-5ae5e215b2cb service nova] Lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG nova.compute.manager [req-8c82ec08-e02b-4a60-9a8a-4c1c25061670 req-14025ddc-3eee-4cce-aaa9-5ae5e215b2cb service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] No waiting events found dispatching network-vif-unplugged-30bd4e9a-f1bf-48df-962e-296027da9d23 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG nova.compute.manager [req-8c82ec08-e02b-4a60-9a8a-4c1c25061670 req-14025ddc-3eee-4cce-aaa9-5ae5e215b2cb service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Received event network-vif-unplugged-30bd4e9a-f1bf-48df-962e-296027da9d23 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:46:15 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Instance destroyed successfully.
Aug 01 18:46:15 user nova-compute[72150]: DEBUG nova.objects.instance [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lazy-loading 'resources' on Instance uuid ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:43:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-781594077',display_name='tempest-AttachVolumeNegativeTest-server-781594077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-781594077',id=41,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuhVndNcFL+FbuRIiXcrjQKYEZMopDrfzbSyRmTXbwlWPruP4brHBU0paY2niEuKDw1Af6QDlB1kblWNkXZbDcnPjXUyWyDd9tZvbIQvdjZ6D5zbIJVLIq319ytxVtYJQ==',key_name='tempest-keypair-1472158408',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:43:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66bad8c4e2a74caf8d35ad98e7888266',ramdisk_id='',reservation_id='r-5inistdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-504132593',owner_user_name='tempest-AttachVolumeNegativeTest-504132593-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:43:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f11bcc2f9cc048beb928fc0d3c30403e',uuid=ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30bd4e9a-f1bf-48df-962e-296027da9d23", "address": "fa:16:3e:9d:a6:13", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bd4e9a-f1", "ovs_interfaceid": "30bd4e9a-f1bf-48df-962e-296027da9d23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converting VIF {"id": "30bd4e9a-f1bf-48df-962e-296027da9d23", "address": "fa:16:3e:9d:a6:13", "network": {"id": "2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-220845033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bad8c4e2a74caf8d35ad98e7888266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bd4e9a-f1", "ovs_interfaceid": "30bd4e9a-f1bf-48df-962e-296027da9d23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:a6:13,bridge_name='br-int',has_traffic_filtering=True,id=30bd4e9a-f1bf-48df-962e-296027da9d23,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bd4e9a-f1') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG os_vif [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:a6:13,bridge_name='br-int',has_traffic_filtering=True,id=30bd4e9a-f1bf-48df-962e-296027da9d23,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bd4e9a-f1') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30bd4e9a-f1, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:46:15 user nova-compute[72150]: INFO os_vif [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:a6:13,bridge_name='br-int',has_traffic_filtering=True,id=30bd4e9a-f1bf-48df-962e-296027da9d23,network=Network(2cbdcb2b-066b-4a93-a52e-a6dbbefc05ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bd4e9a-f1')
Aug 01 18:46:15 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Deleting instance files /opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c_del
Aug 01 18:46:15 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Deletion of /opt/stack/data/nova/instances/ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c_del complete
Aug 01 18:46:16 user nova-compute[72150]: INFO nova.compute.manager [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 18:46:16 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:46:16 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:46:16 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:46:17 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:46:17 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Took 1.14 seconds to deallocate network for instance.
Aug 01 18:46:17 user nova-compute[72150]: DEBUG nova.compute.manager [req-90c3891c-c1b4-459f-b53d-400a6d7cb22d req-a19cd832-7700-4b45-9f6c-6241707dc61d service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Received event network-vif-deleted-30bd4e9a-f1bf-48df-962e-296027da9d23 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:46:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:46:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:46:17 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:46:17 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:46:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:46:17 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Deleted allocations for instance ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c
Aug 01 18:46:17 user nova-compute[72150]: DEBUG nova.compute.manager [req-44252fc5-a923-4cbc-8968-7759c5e038a8 req-cf87ce1d-484f-489f-beb1-f0f4ed37811e service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Received event network-vif-plugged-30bd4e9a-f1bf-48df-962e-296027da9d23 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:46:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-44252fc5-a923-4cbc-8968-7759c5e038a8 req-cf87ce1d-484f-489f-beb1-f0f4ed37811e service nova] Acquiring lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:46:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-44252fc5-a923-4cbc-8968-7759c5e038a8 req-cf87ce1d-484f-489f-beb1-f0f4ed37811e service nova] Lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:46:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-44252fc5-a923-4cbc-8968-7759c5e038a8 req-cf87ce1d-484f-489f-beb1-f0f4ed37811e service nova] Lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:46:17 user nova-compute[72150]: DEBUG nova.compute.manager [req-44252fc5-a923-4cbc-8968-7759c5e038a8 req-cf87ce1d-484f-489f-beb1-f0f4ed37811e service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] No waiting events found dispatching network-vif-plugged-30bd4e9a-f1bf-48df-962e-296027da9d23 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:46:17 user nova-compute[72150]: WARNING nova.compute.manager [req-44252fc5-a923-4cbc-8968-7759c5e038a8 req-cf87ce1d-484f-489f-beb1-f0f4ed37811e service nova] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Received unexpected event network-vif-plugged-30bd4e9a-f1bf-48df-962e-296027da9d23 for instance with vm_state deleted and task_state None.
Aug 01 18:46:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ee67d179-3999-48b2-9bc2-35c8b4eeb76d tempest-AttachVolumeNegativeTest-504132593 tempest-AttachVolumeNegativeTest-504132593-project-member] Lock "ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.350s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:46:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "e6831e19-1dc8-470a-8151-9896d8fea013" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:46:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "e6831e19-1dc8-470a-8151-9896d8fea013" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:46:17 user nova-compute[72150]: DEBUG nova.objects.instance [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'flavor' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:46:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "e6831e19-1dc8-470a-8151-9896d8fea013" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:46:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "e6831e19-1dc8-470a-8151-9896d8fea013" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:46:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "e6831e19-1dc8-470a-8151-9896d8fea013" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:46:18 user nova-compute[72150]: INFO nova.compute.manager [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Attaching volume a0d0b3ed-5b7f-4e57-8bb6-62c773875896 to /dev/vdb
Aug 01 18:46:18 user nova-compute[72150]: DEBUG os_brick.utils [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:46:18 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:18 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:18 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b27dae-c5dc-4597-ba76-49899ff8b151]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:18 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:18 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:18 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0567a5a4-b2e6-4c90-8285-fedbc7808ac4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:18 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:18 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:18 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[290d245f-6734-463b-b30e-ad4d457b0e96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:18 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb85ce6-f06b-4b1a-a76a-932ca45491f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:18 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:18 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:46:18 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:46:18 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:18 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:46:18 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:46:18 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[044aafd9-fa65-4ff6-8170-981667e2e4bc]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:18 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:46:18 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:46:18 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:46:18 user nova-compute[72150]: DEBUG os_brick.utils [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:46:18 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Updating existing volume attachment record: 93a88fc9-82b7-4b38-b7c7-f10a00540c0e {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:46:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:21 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915566.0508285, 08851ec4-6f71-4ec1-a092-42aab83ee87f => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:46:21 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] VM Stopped (Lifecycle Event)
Aug 01 18:46:21 user nova-compute[72150]: DEBUG nova.compute.manager [None req-3377ae40-27df-4a45-879c-08a3eeab8da4 None None] [instance: 08851ec4-6f71-4ec1-a092-42aab83ee87f] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:46:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaYDNLOM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:46:25 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:46:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:46:25 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:46:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:46:25 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b020c8c-ebd1-4a30-850a-2c927fd2f119]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:46:25 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b446e21c-f5a2-42a2-9dee-88dbce259636]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896] added
Aug 01 18:46:25 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8554bec7-1c5a-4a62-841a-05619edfb650]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead0a360-b920-40d7-9408-c5f348a313ba]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AaYDNLOM {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AaYDNLOM" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5712f52b-5910-4a61-b7d0-68c5962e6374]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AaYDNLOM'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[13627e8d-caae-48f5-ac7c-491c13bf9d60]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e2ed49-dc94-4f88-85ab-36dfd427d362]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 18:46:25 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 18:46:25 user nova-compute[72150]:  {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:46:25 user nova-compute[72150]: WARNING os_brick.initiator.connectors.iscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 18:46:25 user nova-compute[72150]: 
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbe2084-2acc-4840-a815-6914897354c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896, portal: 172.16.0.220,3260]
Aug 01 18:46:25 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896, portal: 172.16.0.220,3260] successful.
Aug 01 18:46:25 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[53095e90-b33a-4289-8dc0-5ef7c76216a6]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb92cbf-a894-4b2f-becd-ecb500d15b5d]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)
Aug 01 18:46:25 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)
Aug 01 18:46:25 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8404fe01-6b20-4a07-94e0-9d7d739140b9]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:46:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:26 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:46:26 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaYDNLOM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:46:26 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:46:26 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23464393239343333', 'path': '/dev/sdb'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:46:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464393239343333', 'path': '/dev/sdb'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:46:26 user nova-compute[72150]: DEBUG nova.objects.instance [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'flavor' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:46:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:46:26 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:46:26 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 18:46:26 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:46:26 user nova-compute[72150]:   <serial>a0d0b3ed-5b7f-4e57-8bb6-62c773875896</serial>
Aug 01 18:46:26 user nova-compute[72150]: </disk>
Aug 01 18:46:26 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:46:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:46:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:46:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] No VIF found with MAC fa:16:3e:6a:16:f7, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:46:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6e46523e-9ad1-4efd-adba-306dbfdfdfad tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "e6831e19-1dc8-470a-8151-9896d8fea013" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.938s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:46:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bc9a88f7-dc8b-4283-a584-0d4b48dd61a6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "e6831e19-1dc8-470a-8151-9896d8fea013" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:46:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bc9a88f7-dc8b-4283-a584-0d4b48dd61a6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "e6831e19-1dc8-470a-8151-9896d8fea013" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:46:27 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bc9a88f7-dc8b-4283-a584-0d4b48dd61a6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:46:27 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bc9a88f7-dc8b-4283-a584-0d4b48dd61a6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72150) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 01 18:46:27 user nova-compute[72150]: DEBUG nova.objects.instance [None req-bc9a88f7-dc8b-4283-a584-0d4b48dd61a6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'flavor' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:46:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:28 user nova-compute[72150]: DEBUG nova.compute.manager [req-6614785b-8647-4cfc-8cbb-91c54ca218f2 req-c4e11cba-5eb5-4b67-8375-a6fe8e06bc5e service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received event network-vif-unplugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:46:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6614785b-8647-4cfc-8cbb-91c54ca218f2 req-c4e11cba-5eb5-4b67-8375-a6fe8e06bc5e service nova] Acquiring lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:46:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6614785b-8647-4cfc-8cbb-91c54ca218f2 req-c4e11cba-5eb5-4b67-8375-a6fe8e06bc5e service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:46:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6614785b-8647-4cfc-8cbb-91c54ca218f2 req-c4e11cba-5eb5-4b67-8375-a6fe8e06bc5e service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:46:28 user nova-compute[72150]: DEBUG nova.compute.manager [req-6614785b-8647-4cfc-8cbb-91c54ca218f2 req-c4e11cba-5eb5-4b67-8375-a6fe8e06bc5e service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] No waiting events found dispatching network-vif-unplugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:46:28 user nova-compute[72150]: WARNING nova.compute.manager [req-6614785b-8647-4cfc-8cbb-91c54ca218f2 req-c4e11cba-5eb5-4b67-8375-a6fe8e06bc5e service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received unexpected event network-vif-unplugged-34f12530-76e7-453e-b503-4756ee0cb4a5 for instance with vm_state active and task_state powering-off.
Aug 01 18:46:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:28 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Instance destroyed successfully.
Aug 01 18:46:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bc9a88f7-dc8b-4283-a584-0d4b48dd61a6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:46:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bc9a88f7-dc8b-4283-a584-0d4b48dd61a6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "e6831e19-1dc8-470a-8151-9896d8fea013" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.850s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:46:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:30 user nova-compute[72150]: DEBUG nova.compute.manager [req-d276e3cb-64cf-464e-b3af-fd67253888b2 req-459cf00a-a5b8-42ab-9242-64be9f1a1a3b service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received event network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:46:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d276e3cb-64cf-464e-b3af-fd67253888b2 req-459cf00a-a5b8-42ab-9242-64be9f1a1a3b service nova] Acquiring lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:46:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d276e3cb-64cf-464e-b3af-fd67253888b2 req-459cf00a-a5b8-42ab-9242-64be9f1a1a3b service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:46:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d276e3cb-64cf-464e-b3af-fd67253888b2 req-459cf00a-a5b8-42ab-9242-64be9f1a1a3b service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:46:30 user nova-compute[72150]: DEBUG nova.compute.manager [req-d276e3cb-64cf-464e-b3af-fd67253888b2 req-459cf00a-a5b8-42ab-9242-64be9f1a1a3b service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] No waiting events found dispatching network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:46:30 user nova-compute[72150]: WARNING nova.compute.manager [req-d276e3cb-64cf-464e-b3af-fd67253888b2 req-459cf00a-a5b8-42ab-9242-64be9f1a1a3b service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received unexpected event network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 for instance with vm_state stopped and task_state None.
Aug 01 18:46:30 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915575.9624538, ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:46:30 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] VM Stopped (Lifecycle Event)
Aug 01 18:46:30 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d29df651-ddc4-4c56-a432-99af951cfc84 None None] [instance: ddbdf253-e97a-46b4-8b5c-f3ff33d5a28c] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:46:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:31 user nova-compute[72150]: DEBUG nova.compute.manager [req-8418780b-067e-43ab-93dc-ec084ed18b82 req-beb0dae4-1f41-47b9-85ea-a9afeb658dba service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Received event network-changed-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:46:31 user nova-compute[72150]: DEBUG nova.compute.manager [req-8418780b-067e-43ab-93dc-ec084ed18b82 req-beb0dae4-1f41-47b9-85ea-a9afeb658dba service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Refreshing instance network info cache due to event network-changed-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:46:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8418780b-067e-43ab-93dc-ec084ed18b82 req-beb0dae4-1f41-47b9-85ea-a9afeb658dba service nova] Acquiring lock "refresh_cache-e64da6da-a4db-4613-90a4-dff7ff5775e0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:46:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8418780b-067e-43ab-93dc-ec084ed18b82 req-beb0dae4-1f41-47b9-85ea-a9afeb658dba service nova] Acquired lock "refresh_cache-e64da6da-a4db-4613-90a4-dff7ff5775e0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:46:31 user nova-compute[72150]: DEBUG nova.network.neutron [req-8418780b-067e-43ab-93dc-ec084ed18b82 req-beb0dae4-1f41-47b9-85ea-a9afeb658dba service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Refreshing network info cache for port 2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:46:32 user nova-compute[72150]: DEBUG nova.network.neutron [req-8418780b-067e-43ab-93dc-ec084ed18b82 req-beb0dae4-1f41-47b9-85ea-a9afeb658dba service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Updated VIF entry in instance network info cache for port 2ed8a2b5-7991-4ad5-a16d-1bf4baab3452. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:46:32 user nova-compute[72150]: DEBUG nova.network.neutron [req-8418780b-067e-43ab-93dc-ec084ed18b82 req-beb0dae4-1f41-47b9-85ea-a9afeb658dba service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Updating instance_info_cache with network_info: [{"id": "2ed8a2b5-7991-4ad5-a16d-1bf4baab3452", "address": "fa:16:3e:4b:42:9f", "network": {"id": "15d3ad7b-8680-4b88-8bb9-8a684500c41b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1843181156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30f93dc27fbe4d79a7950055315a42fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed8a2b5-79", "ovs_interfaceid": "2ed8a2b5-7991-4ad5-a16d-1bf4baab3452", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:46:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8418780b-067e-43ab-93dc-ec084ed18b82 req-beb0dae4-1f41-47b9-85ea-a9afeb658dba service nova] Releasing lock "refresh_cache-e64da6da-a4db-4613-90a4-dff7ff5775e0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:46:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Acquiring lock "e64da6da-a4db-4613-90a4-dff7ff5775e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:46:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:46:35 user nova-compute[72150]: DEBUG nova.objects.instance [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lazy-loading 'flavor' on Instance uuid e64da6da-a4db-4613-90a4-dff7ff5775e0 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:46:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:46:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Acquiring lock "e64da6da-a4db-4613-90a4-dff7ff5775e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:46:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:46:36 user nova-compute[72150]: INFO nova.compute.manager [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Attaching volume 91619d63-3aed-4794-845d-cd80266d3a4e to /dev/vdb
Aug 01 18:46:36 user nova-compute[72150]: DEBUG os_brick.utils [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:46:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d3298b-ad11-4c09-b7b8-0d6a226df103]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9fc414-6625-42e8-adbb-8671b99255e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[711119f0-bee6-49a4-8b35-de5051462042]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff28fa9-241e-4318-b660-d7bac8f9d9a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:46:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:46:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:36 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:46:36 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:46:36 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea16d27e-a1d0-4fe0-9091-df70a74757a8]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:46:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:46:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:46:36 user nova-compute[72150]: DEBUG os_brick.utils [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:46:36 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Updating existing volume attachment record: 2d2589dc-aa95-48d8-af7e-050cb5eafbfd {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:46:39 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:46:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrLpysVn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:46:43 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:46:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:46:43 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:46:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:46:43 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1481256f-1f0f-4267-81c4-744f7b19abe7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:46:43 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbc3f92-e669-483f-989f-58c474b81b53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e] added
Aug 01 18:46:43 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c46aab-7b8b-4964-8b7a-4c0168ba8505]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915588.5544956, e6831e19-1dc8-470a-8151-9896d8fea013 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:46:43 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] VM Stopped (Lifecycle Event)
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[07851c9e-69c8-430d-a4a3-f219de3fdabf]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qrLpysVn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG nova.compute.manager [None req-6ded6f49-c148-4907-86b4-9eb1ff13d5cf None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG nova.compute.manager [None req-6ded6f49-c148-4907-86b4-9eb1ff13d5cf None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qrLpysVn" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ab362d-261b-4789-944e-7aa9cdfe4a27]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qrLpysVn'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[51472bb0-a481-467d-bcdd-1d32ecf2a731]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[07841ec0-5cf2-4f15-ac38-e3086481c367]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)
Aug 01 18:46:43 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)
Aug 01 18:46:43 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e -p 172.16.0.220:3260 --login" returned: 0 in 0.114s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ffc723-c39e-4681-ac4c-20b4165163fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e, portal: 172.16.0.220,3260]
Aug 01 18:46:43 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e, portal: 172.16.0.220,3260] successful.
Aug 01 18:46:43 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.057s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d64fbf-003d-4391-b9a4-13f8f4c24bc1]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b75dbe5-229b-491c-a211-d3b4d15e4eca]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)
Aug 01 18:46:43 user nova-compute[72150]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e (non-flash)
Aug 01 18:46:43 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)
Aug 01 18:46:43 user nova-compute[72150]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e (non-flash)
Aug 01 18:46:43 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc1c764-99ba-48a1-ad88-e9c50a347e1d]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:43 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: None {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:46:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:44 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:46:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrLpysVn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:46:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:46:44 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '26361613534643163', 'path': '/dev/sdc'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:46:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361613534643163', 'path': '/dev/sdc'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:46:44 user nova-compute[72150]: DEBUG nova.objects.instance [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lazy-loading 'flavor' on Instance uuid e64da6da-a4db-4613-90a4-dff7ff5775e0 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:46:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:46:44 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:46:44 user nova-compute[72150]:   <source dev="/dev/sdc"/>
Aug 01 18:46:44 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:46:44 user nova-compute[72150]:   <serial>91619d63-3aed-4794-845d-cd80266d3a4e</serial>
Aug 01 18:46:44 user nova-compute[72150]: </disk>
Aug 01 18:46:44 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:46:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:46:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:46:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] No VIF found with MAC fa:16:3e:4b:42:9f, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:46:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-229d132b-7452-4064-bcc1-be55dc088e16 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.438s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:46:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:46 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Acquiring lock "e64da6da-a4db-4613-90a4-dff7ff5775e0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:46:47 user nova-compute[72150]: INFO nova.compute.manager [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Detaching volume 91619d63-3aed-4794-845d-cd80266d3a4e
Aug 01 18:46:47 user nova-compute[72150]: INFO nova.virt.block_device [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Attempting to driver detach volume 91619d63-3aed-4794-845d-cd80266d3a4e from mountpoint /dev/vdb
Aug 01 18:46:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Attempting to detach device vdb from instance e64da6da-a4db-4613-90a4-dff7ff5775e0 from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:46:47 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:46:47 user nova-compute[72150]:   <source dev="/dev/sdc"/>
Aug 01 18:46:47 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:46:47 user nova-compute[72150]:   <serial>91619d63-3aed-4794-845d-cd80266d3a4e</serial>
Aug 01 18:46:47 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:46:47 user nova-compute[72150]: </disk>
Aug 01 18:46:47 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:46:47 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Successfully detached device vdb from instance e64da6da-a4db-4613-90a4-dff7ff5775e0 from the persistent domain config.
Aug 01 18:46:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e64da6da-a4db-4613-90a4-dff7ff5775e0 from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:46:47 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:46:47 user nova-compute[72150]:   <source dev="/dev/sdc"/>
Aug 01 18:46:47 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:46:47 user nova-compute[72150]:   <serial>91619d63-3aed-4794-845d-cd80266d3a4e</serial>
Aug 01 18:46:47 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:46:47 user nova-compute[72150]: </disk>
Aug 01 18:46:47 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690915607.854628, e64da6da-a4db-4613-90a4-dff7ff5775e0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e64da6da-a4db-4613-90a4-dff7ff5775e0 {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:46:47 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Successfully detached device vdb from instance e64da6da-a4db-4613-90a4-dff7ff5775e0 from the live domain config.
Aug 01 18:46:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrLpysVn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:46:47 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:46:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9b9e56-003b-496d-92d3-c4ff98ca2a27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9cebc6-278b-43b2-bd02-75dba59b0f13]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)
Aug 01 18:46:47 user nova-compute[72150]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e (non-flash)
Aug 01 18:46:47 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)
Aug 01 18:46:47 user nova-compute[72150]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e (non-flash)
Aug 01 18:46:47 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c4537f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e'): ({'sdc'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Removing single pathed devices sdc {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a01043-96d7-4602-a5da-503ef58e8584]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fde2277-6314-4b7d-a952-9bd60c8c14fd]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Flushing IO for device /dev/sdc {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:46:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e39576-6e35-41c9-859e-9d87b408ac5e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e95fa7-f8b6-4293-8eea-1f5a76bba192]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] SCSI volumes sdc have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d835594-3747-4215-a5af-467726c8e93e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24b0ca8-d77b-47c4-901c-0a868fbc8d48]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e, portal: 172.16.0.220,3260]
Aug 01 18:46:48 user nova-compute[72150]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e, portal: 172.16.0.220,3260] successful.
Aug 01 18:46:48 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91619d63-3aed-4794-845d-cd80266d3a4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bf6798-6cba-4c93-a81b-7343e6b581de]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] <== disconnect_volume: return (308ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:46:48 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:46:48 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:46:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8650MB free_disk=25.463443756103516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG nova.objects.instance [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lazy-loading 'flavor' on Instance uuid e64da6da-a4db-4613-90a4-dff7ff5775e0 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance e6831e19-1dc8-470a-8151-9896d8fea013 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance e64da6da-a4db-4613-90a4-dff7ff5775e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:46:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3726a328-e6b4-4052-88e1-4d2b1ac42f49 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.723s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:46:49 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:46:49 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:46:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:46:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:46:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:50 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:46:50 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:46:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:51 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:46:52 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:46:53 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:46:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:46:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 18:46:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:46:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:46:54 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:46:54 user nova-compute[72150]: DEBUG nova.objects.instance [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lazy-loading 'info_cache' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:46:54 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Updating instance_info_cache with network_info: [{"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:46:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:46:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:46:54 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:46:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:46:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:46:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:46:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:46:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:46:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:46:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:47:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:47:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:47:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:47:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Acquiring lock "8187fa8f-cd78-46ce-887a-e9582f16fea9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "8187fa8f-cd78-46ce-887a-e9582f16fea9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:33 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:47:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:33 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:47:33 user nova-compute[72150]: INFO nova.compute.claims [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Claim successful on node user
Aug 01 18:47:33 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:47:33 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:47:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:33 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:47:33 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:47:33 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:47:33 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:47:33 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:47:33 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:47:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:47:33 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Creating image(s)
Aug 01 18:47:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Acquiring lock "/opt/stack/data/nova/instances/8187fa8f-cd78-46ce-887a-e9582f16fea9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "/opt/stack/data/nova/instances/8187fa8f-cd78-46ce-887a-e9582f16fea9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "/opt/stack/data/nova/instances/8187fa8f-cd78-46ce-887a-e9582f16fea9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:33 user nova-compute[72150]: DEBUG nova.policy [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '487eb09a6aa148c18ba2070972457616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fef6c64f0545ef99e0c2e8059cd267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:47:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:47:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:47:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:47:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:47:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/8187fa8f-cd78-46ce-887a-e9582f16fea9/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:47:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/8187fa8f-cd78-46ce-887a-e9582f16fea9/disk 1073741824" returned: 0 in 0.141s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:47:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:47:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.178s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:47:34 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8187fa8f-cd78-46ce-887a-e9582f16fea9/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:47:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8187fa8f-cd78-46ce-887a-e9582f16fea9/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:47:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8187fa8f-cd78-46ce-887a-e9582f16fea9/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:47:34 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Cannot resize image /opt/stack/data/nova/instances/8187fa8f-cd78-46ce-887a-e9582f16fea9/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:47:34 user nova-compute[72150]: DEBUG nova.objects.instance [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lazy-loading 'migration_context' on Instance uuid 8187fa8f-cd78-46ce-887a-e9582f16fea9 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:47:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:47:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Ensure instance console log exists: /opt/stack/data/nova/instances/8187fa8f-cd78-46ce-887a-e9582f16fea9/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:47:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:35 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Successfully created port: 952573e9-4c7c-4c17-b64f-21193b63b080 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Successfully updated port: 952573e9-4c7c-4c17-b64f-21193b63b080 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Acquiring lock "refresh_cache-8187fa8f-cd78-46ce-887a-e9582f16fea9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Acquired lock "refresh_cache-8187fa8f-cd78-46ce-887a-e9582f16fea9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.compute.manager [req-6b7e3f36-3483-4a33-8e58-0c02df09dc25 req-ba160908-64a1-4e2c-8b10-5ffcf11fb353 service nova] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Received event network-changed-952573e9-4c7c-4c17-b64f-21193b63b080 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.compute.manager [req-6b7e3f36-3483-4a33-8e58-0c02df09dc25 req-ba160908-64a1-4e2c-8b10-5ffcf11fb353 service nova] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Refreshing instance network info cache due to event network-changed-952573e9-4c7c-4c17-b64f-21193b63b080. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6b7e3f36-3483-4a33-8e58-0c02df09dc25 req-ba160908-64a1-4e2c-8b10-5ffcf11fb353 service nova] Acquiring lock "refresh_cache-8187fa8f-cd78-46ce-887a-e9582f16fea9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Updating instance_info_cache with network_info: [{"id": "952573e9-4c7c-4c17-b64f-21193b63b080", "address": "fa:16:3e:46:e1:3d", "network": {"id": "2468551a-06dc-44c4-82fe-7ed843e90920", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1864190400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9fef6c64f0545ef99e0c2e8059cd267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap952573e9-4c", "ovs_interfaceid": "952573e9-4c7c-4c17-b64f-21193b63b080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Releasing lock "refresh_cache-8187fa8f-cd78-46ce-887a-e9582f16fea9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Instance network_info: |[{"id": "952573e9-4c7c-4c17-b64f-21193b63b080", "address": "fa:16:3e:46:e1:3d", "network": {"id": "2468551a-06dc-44c4-82fe-7ed843e90920", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1864190400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9fef6c64f0545ef99e0c2e8059cd267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap952573e9-4c", "ovs_interfaceid": "952573e9-4c7c-4c17-b64f-21193b63b080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6b7e3f36-3483-4a33-8e58-0c02df09dc25 req-ba160908-64a1-4e2c-8b10-5ffcf11fb353 service nova] Acquired lock "refresh_cache-8187fa8f-cd78-46ce-887a-e9582f16fea9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.network.neutron [req-6b7e3f36-3483-4a33-8e58-0c02df09dc25 req-ba160908-64a1-4e2c-8b10-5ffcf11fb353 service nova] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Refreshing network info cache for port 952573e9-4c7c-4c17-b64f-21193b63b080 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Start _get_guest_xml network_info=[{"id": "952573e9-4c7c-4c17-b64f-21193b63b080", "address": "fa:16:3e:46:e1:3d", "network": {"id": "2468551a-06dc-44c4-82fe-7ed843e90920", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1864190400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9fef6c64f0545ef99e0c2e8059cd267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap952573e9-4c", "ovs_interfaceid": "952573e9-4c7c-4c17-b64f-21193b63b080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:47:36 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:47:36 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2121774926',display_name='tempest-VolumesActionsTest-instance-2121774926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2121774926',id=44,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9fef6c64f0545ef99e0c2e8059cd267',ramdisk_id='',reservation_id='r-n2ukka74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1283477154',owner_user_name='tempest-VolumesActionsTest-1283477154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:47:34Z,user_data=None,user_id='487eb09a6aa148c18ba2070972457616',uuid=8187fa8f-cd78-46ce-887a-e9582f16fea9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "952573e9-4c7c-4c17-b64f-21193b63b080", "address": "fa:16:3e:46:e1:3d", "network": {"id": "2468551a-06dc-44c4-82fe-7ed843e90920", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1864190400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9fef6c64f0545ef99e0c2e8059cd267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap952573e9-4c", "ovs_interfaceid": "952573e9-4c7c-4c17-b64f-21193b63b080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Converting VIF {"id": "952573e9-4c7c-4c17-b64f-21193b63b080", "address": "fa:16:3e:46:e1:3d", "network": {"id": "2468551a-06dc-44c4-82fe-7ed843e90920", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1864190400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9fef6c64f0545ef99e0c2e8059cd267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap952573e9-4c", "ovs_interfaceid": "952573e9-4c7c-4c17-b64f-21193b63b080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:e1:3d,bridge_name='br-int',has_traffic_filtering=True,id=952573e9-4c7c-4c17-b64f-21193b63b080,network=Network(2468551a-06dc-44c4-82fe-7ed843e90920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap952573e9-4c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:47:36 user nova-compute[72150]: DEBUG nova.objects.instance [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lazy-loading 'pci_devices' on Instance uuid 8187fa8f-cd78-46ce-887a-e9582f16fea9 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:47:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:47:37 user nova-compute[72150]:   <uuid>8187fa8f-cd78-46ce-887a-e9582f16fea9</uuid>
Aug 01 18:47:37 user nova-compute[72150]:   <name>instance-0000002c</name>
Aug 01 18:47:37 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:47:37 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:47:37 user nova-compute[72150]:   <metadata>
Aug 01 18:47:37 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:47:37 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:47:37 user nova-compute[72150]:       <nova:name>tempest-VolumesActionsTest-instance-2121774926</nova:name>
Aug 01 18:47:37 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:47:36</nova:creationTime>
Aug 01 18:47:37 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:47:37 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:47:37 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:47:37 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:47:37 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:47:37 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:47:37 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:47:37 user nova-compute[72150]:       <nova:owner>
Aug 01 18:47:37 user nova-compute[72150]:         <nova:user uuid="487eb09a6aa148c18ba2070972457616">tempest-VolumesActionsTest-1283477154-project-member</nova:user>
Aug 01 18:47:37 user nova-compute[72150]:         <nova:project uuid="b9fef6c64f0545ef99e0c2e8059cd267">tempest-VolumesActionsTest-1283477154</nova:project>
Aug 01 18:47:37 user nova-compute[72150]:       </nova:owner>
Aug 01 18:47:37 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:47:37 user nova-compute[72150]:       <nova:ports>
Aug 01 18:47:37 user nova-compute[72150]:         <nova:port uuid="952573e9-4c7c-4c17-b64f-21193b63b080">
Aug 01 18:47:37 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 18:47:37 user nova-compute[72150]:         </nova:port>
Aug 01 18:47:37 user nova-compute[72150]:       </nova:ports>
Aug 01 18:47:37 user nova-compute[72150]:     </nova:instance>
Aug 01 18:47:37 user nova-compute[72150]:   </metadata>
Aug 01 18:47:37 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:47:37 user nova-compute[72150]:     <system>
Aug 01 18:47:37 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:47:37 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:47:37 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:47:37 user nova-compute[72150]:       <entry name="serial">8187fa8f-cd78-46ce-887a-e9582f16fea9</entry>
Aug 01 18:47:37 user nova-compute[72150]:       <entry name="uuid">8187fa8f-cd78-46ce-887a-e9582f16fea9</entry>
Aug 01 18:47:37 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:47:37 user nova-compute[72150]:     </system>
Aug 01 18:47:37 user nova-compute[72150]:   </sysinfo>
Aug 01 18:47:37 user nova-compute[72150]:   <os>
Aug 01 18:47:37 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:47:37 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:47:37 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:47:37 user nova-compute[72150]:   </os>
Aug 01 18:47:37 user nova-compute[72150]:   <features>
Aug 01 18:47:37 user nova-compute[72150]:     <acpi/>
Aug 01 18:47:37 user nova-compute[72150]:     <apic/>
Aug 01 18:47:37 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:47:37 user nova-compute[72150]:   </features>
Aug 01 18:47:37 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:47:37 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:47:37 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:47:37 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:47:37 user nova-compute[72150]:   </clock>
Aug 01 18:47:37 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:47:37 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:47:37 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:47:37 user nova-compute[72150]:   </cpu>
Aug 01 18:47:37 user nova-compute[72150]:   <devices>
Aug 01 18:47:37 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:47:37 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:47:37 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/8187fa8f-cd78-46ce-887a-e9582f16fea9/disk"/>
Aug 01 18:47:37 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:47:37 user nova-compute[72150]:     </disk>
Aug 01 18:47:37 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:47:37 user nova-compute[72150]:       <mac address="fa:16:3e:46:e1:3d"/>
Aug 01 18:47:37 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:47:37 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:47:37 user nova-compute[72150]:       <target dev="tap952573e9-4c"/>
Aug 01 18:47:37 user nova-compute[72150]:     </interface>
Aug 01 18:47:37 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:47:37 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/8187fa8f-cd78-46ce-887a-e9582f16fea9/console.log" append="off"/>
Aug 01 18:47:37 user nova-compute[72150]:     </serial>
Aug 01 18:47:37 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:47:37 user nova-compute[72150]:     <video>
Aug 01 18:47:37 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:47:37 user nova-compute[72150]:     </video>
Aug 01 18:47:37 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:47:37 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:47:37 user nova-compute[72150]:     </rng>
Aug 01 18:47:37 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:47:37 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:47:37 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:47:37 user nova-compute[72150]:     </memballoon>
Aug 01 18:47:37 user nova-compute[72150]:   </devices>
Aug 01 18:47:37 user nova-compute[72150]: </domain>
Aug 01 18:47:37 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:47:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2121774926',display_name='tempest-VolumesActionsTest-instance-2121774926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2121774926',id=44,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9fef6c64f0545ef99e0c2e8059cd267',ramdisk_id='',reservation_id='r-n2ukka74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1283477154',owner_user_name='tempest-VolumesActionsTest-1283477154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:47:34Z,user_data=None,user_id='487eb09a6aa148c18ba2070972457616',uuid=8187fa8f-cd78-46ce-887a-e9582f16fea9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "952573e9-4c7c-4c17-b64f-21193b63b080", "address": "fa:16:3e:46:e1:3d", "network": {"id": "2468551a-06dc-44c4-82fe-7ed843e90920", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1864190400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9fef6c64f0545ef99e0c2e8059cd267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap952573e9-4c", "ovs_interfaceid": "952573e9-4c7c-4c17-b64f-21193b63b080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:47:37 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Converting VIF {"id": "952573e9-4c7c-4c17-b64f-21193b63b080", "address": "fa:16:3e:46:e1:3d", "network": {"id": "2468551a-06dc-44c4-82fe-7ed843e90920", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1864190400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9fef6c64f0545ef99e0c2e8059cd267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap952573e9-4c", "ovs_interfaceid": "952573e9-4c7c-4c17-b64f-21193b63b080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:47:37 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:e1:3d,bridge_name='br-int',has_traffic_filtering=True,id=952573e9-4c7c-4c17-b64f-21193b63b080,network=Network(2468551a-06dc-44c4-82fe-7ed843e90920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap952573e9-4c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:47:37 user nova-compute[72150]: DEBUG os_vif [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:e1:3d,bridge_name='br-int',has_traffic_filtering=True,id=952573e9-4c7c-4c17-b64f-21193b63b080,network=Network(2468551a-06dc-44c4-82fe-7ed843e90920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap952573e9-4c') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:47:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:47:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:47:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap952573e9-4c, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:47:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap952573e9-4c, col_values=(('external_ids', {'iface-id': '952573e9-4c7c-4c17-b64f-21193b63b080', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:e1:3d', 'vm-uuid': '8187fa8f-cd78-46ce-887a-e9582f16fea9'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:47:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:47:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:37 user nova-compute[72150]: INFO os_vif [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:e1:3d,bridge_name='br-int',has_traffic_filtering=True,id=952573e9-4c7c-4c17-b64f-21193b63b080,network=Network(2468551a-06dc-44c4-82fe-7ed843e90920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap952573e9-4c')
Aug 01 18:47:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:47:37 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] No VIF found with MAC fa:16:3e:46:e1:3d, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:47:37 user nova-compute[72150]: DEBUG nova.network.neutron [req-6b7e3f36-3483-4a33-8e58-0c02df09dc25 req-ba160908-64a1-4e2c-8b10-5ffcf11fb353 service nova] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Updated VIF entry in instance network info cache for port 952573e9-4c7c-4c17-b64f-21193b63b080. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:47:37 user nova-compute[72150]: DEBUG nova.network.neutron [req-6b7e3f36-3483-4a33-8e58-0c02df09dc25 req-ba160908-64a1-4e2c-8b10-5ffcf11fb353 service nova] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Updating instance_info_cache with network_info: [{"id": "952573e9-4c7c-4c17-b64f-21193b63b080", "address": "fa:16:3e:46:e1:3d", "network": {"id": "2468551a-06dc-44c4-82fe-7ed843e90920", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1864190400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9fef6c64f0545ef99e0c2e8059cd267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap952573e9-4c", "ovs_interfaceid": "952573e9-4c7c-4c17-b64f-21193b63b080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:47:37 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6b7e3f36-3483-4a33-8e58-0c02df09dc25 req-ba160908-64a1-4e2c-8b10-5ffcf11fb353 service nova] Releasing lock "refresh_cache-8187fa8f-cd78-46ce-887a-e9582f16fea9" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:47:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:38 user nova-compute[72150]: DEBUG nova.compute.manager [req-d5c3211d-dfbf-4ed6-b248-d518359a7602 req-51c42cb2-cbbb-4123-8fc5-19dee6cf5c5f service nova] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Received event network-vif-plugged-952573e9-4c7c-4c17-b64f-21193b63b080 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:47:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d5c3211d-dfbf-4ed6-b248-d518359a7602 req-51c42cb2-cbbb-4123-8fc5-19dee6cf5c5f service nova] Acquiring lock "8187fa8f-cd78-46ce-887a-e9582f16fea9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d5c3211d-dfbf-4ed6-b248-d518359a7602 req-51c42cb2-cbbb-4123-8fc5-19dee6cf5c5f service nova] Lock "8187fa8f-cd78-46ce-887a-e9582f16fea9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d5c3211d-dfbf-4ed6-b248-d518359a7602 req-51c42cb2-cbbb-4123-8fc5-19dee6cf5c5f service nova] Lock "8187fa8f-cd78-46ce-887a-e9582f16fea9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:38 user nova-compute[72150]: DEBUG nova.compute.manager [req-d5c3211d-dfbf-4ed6-b248-d518359a7602 req-51c42cb2-cbbb-4123-8fc5-19dee6cf5c5f service nova] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] No waiting events found dispatching network-vif-plugged-952573e9-4c7c-4c17-b64f-21193b63b080 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:47:38 user nova-compute[72150]: WARNING nova.compute.manager [req-d5c3211d-dfbf-4ed6-b248-d518359a7602 req-51c42cb2-cbbb-4123-8fc5-19dee6cf5c5f service nova] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Received unexpected event network-vif-plugged-952573e9-4c7c-4c17-b64f-21193b63b080 for instance with vm_state building and task_state spawning.
Aug 01 18:47:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:40 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915660.6338606, 8187fa8f-cd78-46ce-887a-e9582f16fea9 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:47:40 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] VM Resumed (Lifecycle Event)
Aug 01 18:47:40 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:47:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:47:40 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Instance spawned successfully.
Aug 01 18:47:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:47:40 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:47:40 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:47:40 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:47:40 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915660.6354845, 8187fa8f-cd78-46ce-887a-e9582f16fea9 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:47:40 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] VM Started (Lifecycle Event)
Aug 01 18:47:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:47:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:47:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:47:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:47:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:47:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:47:40 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:47:40 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:47:40 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:47:40 user nova-compute[72150]: INFO nova.compute.manager [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Took 7.22 seconds to spawn the instance on the hypervisor.
Aug 01 18:47:40 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:47:40 user nova-compute[72150]: INFO nova.compute.manager [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Took 7.80 seconds to build instance.
Aug 01 18:47:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ada47d8f-7048-4ebe-9a97-79ad71494ab1 tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "8187fa8f-cd78-46ce-887a-e9582f16fea9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.937s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:40 user nova-compute[72150]: DEBUG nova.compute.manager [req-1c24e253-04b5-4c2a-87d5-199a17de69c7 req-3a477274-feb0-47ed-bd54-251cf2975f0e service nova] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Received event network-vif-plugged-952573e9-4c7c-4c17-b64f-21193b63b080 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:47:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1c24e253-04b5-4c2a-87d5-199a17de69c7 req-3a477274-feb0-47ed-bd54-251cf2975f0e service nova] Acquiring lock "8187fa8f-cd78-46ce-887a-e9582f16fea9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1c24e253-04b5-4c2a-87d5-199a17de69c7 req-3a477274-feb0-47ed-bd54-251cf2975f0e service nova] Lock "8187fa8f-cd78-46ce-887a-e9582f16fea9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1c24e253-04b5-4c2a-87d5-199a17de69c7 req-3a477274-feb0-47ed-bd54-251cf2975f0e service nova] Lock "8187fa8f-cd78-46ce-887a-e9582f16fea9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:40 user nova-compute[72150]: DEBUG nova.compute.manager [req-1c24e253-04b5-4c2a-87d5-199a17de69c7 req-3a477274-feb0-47ed-bd54-251cf2975f0e service nova] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] No waiting events found dispatching network-vif-plugged-952573e9-4c7c-4c17-b64f-21193b63b080 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:47:40 user nova-compute[72150]: WARNING nova.compute.manager [req-1c24e253-04b5-4c2a-87d5-199a17de69c7 req-3a477274-feb0-47ed-bd54-251cf2975f0e service nova] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Received unexpected event network-vif-plugged-952573e9-4c7c-4c17-b64f-21193b63b080 for instance with vm_state active and task_state None.
Aug 01 18:47:41 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:47:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Acquiring lock "e64da6da-a4db-4613-90a4-dff7ff5775e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Acquiring lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:43 user nova-compute[72150]: INFO nova.compute.manager [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Terminating instance
Aug 01 18:47:43 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG nova.compute.manager [req-235c41af-0eab-4bf3-8b14-1a4fb86c8762 req-1e3b1143-97d0-4dd9-ba6e-a29b3a3c9e8f service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Received event network-vif-unplugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-235c41af-0eab-4bf3-8b14-1a4fb86c8762 req-1e3b1143-97d0-4dd9-ba6e-a29b3a3c9e8f service nova] Acquiring lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-235c41af-0eab-4bf3-8b14-1a4fb86c8762 req-1e3b1143-97d0-4dd9-ba6e-a29b3a3c9e8f service nova] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-235c41af-0eab-4bf3-8b14-1a4fb86c8762 req-1e3b1143-97d0-4dd9-ba6e-a29b3a3c9e8f service nova] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG nova.compute.manager [req-235c41af-0eab-4bf3-8b14-1a4fb86c8762 req-1e3b1143-97d0-4dd9-ba6e-a29b3a3c9e8f service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] No waiting events found dispatching network-vif-unplugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG nova.compute.manager [req-235c41af-0eab-4bf3-8b14-1a4fb86c8762 req-1e3b1143-97d0-4dd9-ba6e-a29b3a3c9e8f service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Received event network-vif-unplugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:43 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Instance destroyed successfully.
Aug 01 18:47:43 user nova-compute[72150]: DEBUG nova.objects.instance [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lazy-loading 'resources' on Instance uuid e64da6da-a4db-4613-90a4-dff7ff5775e0 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:44:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1590811208',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1590811208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1590811',id=43,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFg6QG1y+Or8ZlKMfzQQM6hgNjVP1lnfhhcmM5IU+qSXD+6tb4RXpXAMXC/vvpOBF/7IDwBhGb5IKICj7Tbus4wQMDbJUfG0CHB1kQi3fXtgJ7wiH9pSg9Cjnyc3bY49Rw==',key_name='tempest-keypair-1384770106',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:44:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30f93dc27fbe4d79a7950055315a42fc',ramdisk_id='',reservation_id='r-r1ld6ug6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-436966306',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:44:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa19fd85ab1c409d842a6724c16cf7fa',uuid=e64da6da-a4db-4613-90a4-dff7ff5775e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ed8a2b5-7991-4ad5-a16d-1bf4baab3452", "address": "fa:16:3e:4b:42:9f", "network": {"id": "15d3ad7b-8680-4b88-8bb9-8a684500c41b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1843181156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30f93dc27fbe4d79a7950055315a42fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed8a2b5-79", "ovs_interfaceid": "2ed8a2b5-7991-4ad5-a16d-1bf4baab3452", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Converting VIF {"id": "2ed8a2b5-7991-4ad5-a16d-1bf4baab3452", "address": "fa:16:3e:4b:42:9f", "network": {"id": "15d3ad7b-8680-4b88-8bb9-8a684500c41b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1843181156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30f93dc27fbe4d79a7950055315a42fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed8a2b5-79", "ovs_interfaceid": "2ed8a2b5-7991-4ad5-a16d-1bf4baab3452", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:42:9f,bridge_name='br-int',has_traffic_filtering=True,id=2ed8a2b5-7991-4ad5-a16d-1bf4baab3452,network=Network(15d3ad7b-8680-4b88-8bb9-8a684500c41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed8a2b5-79') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG os_vif [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:42:9f,bridge_name='br-int',has_traffic_filtering=True,id=2ed8a2b5-7991-4ad5-a16d-1bf4baab3452,network=Network(15d3ad7b-8680-4b88-8bb9-8a684500c41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed8a2b5-79') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ed8a2b5-79, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:43 user nova-compute[72150]: INFO os_vif [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:42:9f,bridge_name='br-int',has_traffic_filtering=True,id=2ed8a2b5-7991-4ad5-a16d-1bf4baab3452,network=Network(15d3ad7b-8680-4b88-8bb9-8a684500c41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed8a2b5-79')
Aug 01 18:47:43 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Deleting instance files /opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0_del
Aug 01 18:47:43 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Deletion of /opt/stack/data/nova/instances/e64da6da-a4db-4613-90a4-dff7ff5775e0_del complete
Aug 01 18:47:44 user nova-compute[72150]: INFO nova.compute.manager [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 01 18:47:44 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:47:44 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:47:44 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:47:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-a2377c5b-27b3-4580-a2af-bdbebca5a362 req-3ca9e95f-eca0-4a19-b43d-1da6bbfe80ec service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Received event network-vif-plugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:47:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a2377c5b-27b3-4580-a2af-bdbebca5a362 req-3ca9e95f-eca0-4a19-b43d-1da6bbfe80ec service nova] Acquiring lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a2377c5b-27b3-4580-a2af-bdbebca5a362 req-3ca9e95f-eca0-4a19-b43d-1da6bbfe80ec service nova] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a2377c5b-27b3-4580-a2af-bdbebca5a362 req-3ca9e95f-eca0-4a19-b43d-1da6bbfe80ec service nova] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-a2377c5b-27b3-4580-a2af-bdbebca5a362 req-3ca9e95f-eca0-4a19-b43d-1da6bbfe80ec service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] No waiting events found dispatching network-vif-plugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:47:45 user nova-compute[72150]: WARNING nova.compute.manager [req-a2377c5b-27b3-4580-a2af-bdbebca5a362 req-3ca9e95f-eca0-4a19-b43d-1da6bbfe80ec service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Received unexpected event network-vif-plugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 for instance with vm_state active and task_state deleting.
Aug 01 18:47:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-a2377c5b-27b3-4580-a2af-bdbebca5a362 req-3ca9e95f-eca0-4a19-b43d-1da6bbfe80ec service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Received event network-vif-plugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:47:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a2377c5b-27b3-4580-a2af-bdbebca5a362 req-3ca9e95f-eca0-4a19-b43d-1da6bbfe80ec service nova] Acquiring lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a2377c5b-27b3-4580-a2af-bdbebca5a362 req-3ca9e95f-eca0-4a19-b43d-1da6bbfe80ec service nova] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a2377c5b-27b3-4580-a2af-bdbebca5a362 req-3ca9e95f-eca0-4a19-b43d-1da6bbfe80ec service nova] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-a2377c5b-27b3-4580-a2af-bdbebca5a362 req-3ca9e95f-eca0-4a19-b43d-1da6bbfe80ec service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] No waiting events found dispatching network-vif-plugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:47:45 user nova-compute[72150]: WARNING nova.compute.manager [req-a2377c5b-27b3-4580-a2af-bdbebca5a362 req-3ca9e95f-eca0-4a19-b43d-1da6bbfe80ec service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Received unexpected event network-vif-plugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 for instance with vm_state active and task_state deleting.
Aug 01 18:47:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-a2377c5b-27b3-4580-a2af-bdbebca5a362 req-3ca9e95f-eca0-4a19-b43d-1da6bbfe80ec service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Received event network-vif-plugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:47:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a2377c5b-27b3-4580-a2af-bdbebca5a362 req-3ca9e95f-eca0-4a19-b43d-1da6bbfe80ec service nova] Acquiring lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a2377c5b-27b3-4580-a2af-bdbebca5a362 req-3ca9e95f-eca0-4a19-b43d-1da6bbfe80ec service nova] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:45 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a2377c5b-27b3-4580-a2af-bdbebca5a362 req-3ca9e95f-eca0-4a19-b43d-1da6bbfe80ec service nova] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:45 user nova-compute[72150]: DEBUG nova.compute.manager [req-a2377c5b-27b3-4580-a2af-bdbebca5a362 req-3ca9e95f-eca0-4a19-b43d-1da6bbfe80ec service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] No waiting events found dispatching network-vif-plugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:47:45 user nova-compute[72150]: WARNING nova.compute.manager [req-a2377c5b-27b3-4580-a2af-bdbebca5a362 req-3ca9e95f-eca0-4a19-b43d-1da6bbfe80ec service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Received unexpected event network-vif-plugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 for instance with vm_state active and task_state deleting.
Aug 01 18:47:46 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:47:46 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Took 2.40 seconds to deallocate network for instance.
Aug 01 18:47:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:46 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:47:46 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:47:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:46 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Deleted allocations for instance e64da6da-a4db-4613-90a4-dff7ff5775e0
Aug 01 18:47:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ea3167fb-6056-4a71-a015-b3141e870134 tempest-TestServerVolumeAttachScenarioOldVersion-436966306 tempest-TestServerVolumeAttachScenarioOldVersion-436966306-project-member] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.825s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:47:47 user nova-compute[72150]: INFO nova.compute.claims [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Claim successful on node user
Aug 01 18:47:47 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG nova.network.neutron [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:47:47 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:47:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG nova.policy [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e18c2b7f1714542bb4f14be70c46194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fca32199d5c458ab4bd52d15c27509b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG nova.compute.manager [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:47:47 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Creating image(s)
Aug 01 18:47:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "/opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "/opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "/opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-9467bbde-fa5d-4210-81fd-05d5d8035cb8 req-91a994e9-9367-4f60-b723-ce94d48386e5 service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Received event network-vif-unplugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9467bbde-fa5d-4210-81fd-05d5d8035cb8 req-91a994e9-9367-4f60-b723-ce94d48386e5 service nova] Acquiring lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9467bbde-fa5d-4210-81fd-05d5d8035cb8 req-91a994e9-9367-4f60-b723-ce94d48386e5 service nova] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9467bbde-fa5d-4210-81fd-05d5d8035cb8 req-91a994e9-9367-4f60-b723-ce94d48386e5 service nova] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-9467bbde-fa5d-4210-81fd-05d5d8035cb8 req-91a994e9-9367-4f60-b723-ce94d48386e5 service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] No waiting events found dispatching network-vif-unplugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:47:47 user nova-compute[72150]: WARNING nova.compute.manager [req-9467bbde-fa5d-4210-81fd-05d5d8035cb8 req-91a994e9-9367-4f60-b723-ce94d48386e5 service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Received unexpected event network-vif-unplugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 for instance with vm_state deleted and task_state None.
Aug 01 18:47:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-9467bbde-fa5d-4210-81fd-05d5d8035cb8 req-91a994e9-9367-4f60-b723-ce94d48386e5 service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Received event network-vif-plugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9467bbde-fa5d-4210-81fd-05d5d8035cb8 req-91a994e9-9367-4f60-b723-ce94d48386e5 service nova] Acquiring lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9467bbde-fa5d-4210-81fd-05d5d8035cb8 req-91a994e9-9367-4f60-b723-ce94d48386e5 service nova] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9467bbde-fa5d-4210-81fd-05d5d8035cb8 req-91a994e9-9367-4f60-b723-ce94d48386e5 service nova] Lock "e64da6da-a4db-4613-90a4-dff7ff5775e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-9467bbde-fa5d-4210-81fd-05d5d8035cb8 req-91a994e9-9367-4f60-b723-ce94d48386e5 service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] No waiting events found dispatching network-vif-plugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:47:47 user nova-compute[72150]: WARNING nova.compute.manager [req-9467bbde-fa5d-4210-81fd-05d5d8035cb8 req-91a994e9-9367-4f60-b723-ce94d48386e5 service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Received unexpected event network-vif-plugged-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 for instance with vm_state deleted and task_state None.
Aug 01 18:47:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-9467bbde-fa5d-4210-81fd-05d5d8035cb8 req-91a994e9-9367-4f60-b723-ce94d48386e5 service nova] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Received event network-vif-deleted-2ed8a2b5-7991-4ad5-a16d-1bf4baab3452 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.156s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk 1073741824" returned: 0 in 0.053s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Checking if we can resize image /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG nova.network.neutron [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Successfully created port: c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Cannot resize image /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG nova.objects.instance [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lazy-loading 'migration_context' on Instance uuid 760ec148-92e3-49a3-93e6-5343f6e6b8c0 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Ensure instance console log exists: /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:47:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.network.neutron [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Successfully updated port: c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "refresh_cache-760ec148-92e3-49a3-93e6-5343f6e6b8c0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquired lock "refresh_cache-760ec148-92e3-49a3-93e6-5343f6e6b8c0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.network.neutron [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.network.neutron [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8187fa8f-cd78-46ce-887a-e9582f16fea9/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8187fa8f-cd78-46ce-887a-e9582f16fea9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8187fa8f-cd78-46ce-887a-e9582f16fea9/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.network.neutron [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Updating instance_info_cache with network_info: [{"id": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "address": "fa:16:3e:e3:ad:06", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ac02e1-ad", "ovs_interfaceid": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Releasing lock "refresh_cache-760ec148-92e3-49a3-93e6-5343f6e6b8c0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.compute.manager [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Instance network_info: |[{"id": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "address": "fa:16:3e:e3:ad:06", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ac02e1-ad", "ovs_interfaceid": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Start _get_guest_xml network_info=[{"id": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "address": "fa:16:3e:e3:ad:06", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ac02e1-ad", "ovs_interfaceid": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:47:49 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:47:49 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:47:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-422576796',display_name='tempest-TestStampPattern-server-422576796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-422576796',id=45,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZy2wVCHd7vEtiOS/HYac+tq78O0CA/dgbnZhwl2N6J70l2eXFgL43fhOucY/uXMm4OefFrQ4HuyqEQUOsD22aJwn95LDZVUWnVjJnV8RCkRBcjCwyi2bzx0ZZbSdwYQA==',key_name='tempest-TestStampPattern-1877833599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fca32199d5c458ab4bd52d15c27509b',ramdisk_id='',reservation_id='r-3ghksjfd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-958709342',owner_user_name='tempest-TestStampPattern-958709342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:47:48Z,user_data=None,user_id='1e18c2b7f1714542bb4f14be70c46194',uuid=760ec148-92e3-49a3-93e6-5343f6e6b8c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "address": "fa:16:3e:e3:ad:06", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ac02e1-ad", "ovs_interfaceid": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Converting VIF {"id": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "address": "fa:16:3e:e3:ad:06", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ac02e1-ad", "ovs_interfaceid": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:ad:06,bridge_name='br-int',has_traffic_filtering=True,id=c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3,network=Network(662f2fa8-b862-434c-bf1f-1804ac5e04ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ac02e1-ad') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.objects.instance [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lazy-loading 'pci_devices' on Instance uuid 760ec148-92e3-49a3-93e6-5343f6e6b8c0 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:47:49 user nova-compute[72150]:   <uuid>760ec148-92e3-49a3-93e6-5343f6e6b8c0</uuid>
Aug 01 18:47:49 user nova-compute[72150]:   <name>instance-0000002d</name>
Aug 01 18:47:49 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:47:49 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:47:49 user nova-compute[72150]:   <metadata>
Aug 01 18:47:49 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:47:49 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:47:49 user nova-compute[72150]:       <nova:name>tempest-TestStampPattern-server-422576796</nova:name>
Aug 01 18:47:49 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:47:49</nova:creationTime>
Aug 01 18:47:49 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:47:49 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:47:49 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:47:49 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:47:49 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:47:49 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:47:49 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:47:49 user nova-compute[72150]:       <nova:owner>
Aug 01 18:47:49 user nova-compute[72150]:         <nova:user uuid="1e18c2b7f1714542bb4f14be70c46194">tempest-TestStampPattern-958709342-project-member</nova:user>
Aug 01 18:47:49 user nova-compute[72150]:         <nova:project uuid="4fca32199d5c458ab4bd52d15c27509b">tempest-TestStampPattern-958709342</nova:project>
Aug 01 18:47:49 user nova-compute[72150]:       </nova:owner>
Aug 01 18:47:49 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:47:49 user nova-compute[72150]:       <nova:ports>
Aug 01 18:47:49 user nova-compute[72150]:         <nova:port uuid="c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3">
Aug 01 18:47:49 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 18:47:49 user nova-compute[72150]:         </nova:port>
Aug 01 18:47:49 user nova-compute[72150]:       </nova:ports>
Aug 01 18:47:49 user nova-compute[72150]:     </nova:instance>
Aug 01 18:47:49 user nova-compute[72150]:   </metadata>
Aug 01 18:47:49 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:47:49 user nova-compute[72150]:     <system>
Aug 01 18:47:49 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:47:49 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:47:49 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:47:49 user nova-compute[72150]:       <entry name="serial">760ec148-92e3-49a3-93e6-5343f6e6b8c0</entry>
Aug 01 18:47:49 user nova-compute[72150]:       <entry name="uuid">760ec148-92e3-49a3-93e6-5343f6e6b8c0</entry>
Aug 01 18:47:49 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:47:49 user nova-compute[72150]:     </system>
Aug 01 18:47:49 user nova-compute[72150]:   </sysinfo>
Aug 01 18:47:49 user nova-compute[72150]:   <os>
Aug 01 18:47:49 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:47:49 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:47:49 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:47:49 user nova-compute[72150]:   </os>
Aug 01 18:47:49 user nova-compute[72150]:   <features>
Aug 01 18:47:49 user nova-compute[72150]:     <acpi/>
Aug 01 18:47:49 user nova-compute[72150]:     <apic/>
Aug 01 18:47:49 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:47:49 user nova-compute[72150]:   </features>
Aug 01 18:47:49 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:47:49 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:47:49 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:47:49 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:47:49 user nova-compute[72150]:   </clock>
Aug 01 18:47:49 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:47:49 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:47:49 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:47:49 user nova-compute[72150]:   </cpu>
Aug 01 18:47:49 user nova-compute[72150]:   <devices>
Aug 01 18:47:49 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:47:49 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:47:49 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk"/>
Aug 01 18:47:49 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:47:49 user nova-compute[72150]:     </disk>
Aug 01 18:47:49 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:47:49 user nova-compute[72150]:       <mac address="fa:16:3e:e3:ad:06"/>
Aug 01 18:47:49 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:47:49 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:47:49 user nova-compute[72150]:       <target dev="tapc9ac02e1-ad"/>
Aug 01 18:47:49 user nova-compute[72150]:     </interface>
Aug 01 18:47:49 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:47:49 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/console.log" append="off"/>
Aug 01 18:47:49 user nova-compute[72150]:     </serial>
Aug 01 18:47:49 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:47:49 user nova-compute[72150]:     <video>
Aug 01 18:47:49 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:47:49 user nova-compute[72150]:     </video>
Aug 01 18:47:49 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:47:49 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:47:49 user nova-compute[72150]:     </rng>
Aug 01 18:47:49 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:47:49 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:47:49 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:47:49 user nova-compute[72150]:     </memballoon>
Aug 01 18:47:49 user nova-compute[72150]:   </devices>
Aug 01 18:47:49 user nova-compute[72150]: </domain>
Aug 01 18:47:49 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:47:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-422576796',display_name='tempest-TestStampPattern-server-422576796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-422576796',id=45,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZy2wVCHd7vEtiOS/HYac+tq78O0CA/dgbnZhwl2N6J70l2eXFgL43fhOucY/uXMm4OefFrQ4HuyqEQUOsD22aJwn95LDZVUWnVjJnV8RCkRBcjCwyi2bzx0ZZbSdwYQA==',key_name='tempest-TestStampPattern-1877833599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fca32199d5c458ab4bd52d15c27509b',ramdisk_id='',reservation_id='r-3ghksjfd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-958709342',owner_user_name='tempest-TestStampPattern-958709342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:47:48Z,user_data=None,user_id='1e18c2b7f1714542bb4f14be70c46194',uuid=760ec148-92e3-49a3-93e6-5343f6e6b8c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "address": "fa:16:3e:e3:ad:06", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ac02e1-ad", "ovs_interfaceid": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Converting VIF {"id": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "address": "fa:16:3e:e3:ad:06", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ac02e1-ad", "ovs_interfaceid": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:ad:06,bridge_name='br-int',has_traffic_filtering=True,id=c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3,network=Network(662f2fa8-b862-434c-bf1f-1804ac5e04ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ac02e1-ad') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG os_vif [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:ad:06,bridge_name='br-int',has_traffic_filtering=True,id=c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3,network=Network(662f2fa8-b862-434c-bf1f-1804ac5e04ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ac02e1-ad') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8187fa8f-cd78-46ce-887a-e9582f16fea9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9ac02e1-ad, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc9ac02e1-ad, col_values=(('external_ids', {'iface-id': 'c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:ad:06', 'vm-uuid': '760ec148-92e3-49a3-93e6-5343f6e6b8c0'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:47:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:49 user nova-compute[72150]: INFO os_vif [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:ad:06,bridge_name='br-int',has_traffic_filtering=True,id=c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3,network=Network(662f2fa8-b862-434c-bf1f-1804ac5e04ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ac02e1-ad')
Aug 01 18:47:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-7efe187e-cfcf-40f7-8c44-09eeac7a6f9e req-ba1c39dc-8030-49bf-ad87-663b58d3991a service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Received event network-changed-c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-7efe187e-cfcf-40f7-8c44-09eeac7a6f9e req-ba1c39dc-8030-49bf-ad87-663b58d3991a service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Refreshing instance network info cache due to event network-changed-c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7efe187e-cfcf-40f7-8c44-09eeac7a6f9e req-ba1c39dc-8030-49bf-ad87-663b58d3991a service nova] Acquiring lock "refresh_cache-760ec148-92e3-49a3-93e6-5343f6e6b8c0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7efe187e-cfcf-40f7-8c44-09eeac7a6f9e req-ba1c39dc-8030-49bf-ad87-663b58d3991a service nova] Acquired lock "refresh_cache-760ec148-92e3-49a3-93e6-5343f6e6b8c0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG nova.network.neutron [req-7efe187e-cfcf-40f7-8c44-09eeac7a6f9e req-ba1c39dc-8030-49bf-ad87-663b58d3991a service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Refreshing network info cache for port c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:47:50 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:47:50 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:47:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8643MB free_disk=25.460948944091797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] No VIF found with MAC fa:16:3e:e3:ad:06, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance e6831e19-1dc8-470a-8151-9896d8fea013 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 8187fa8f-cd78-46ce-887a-e9582f16fea9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 760ec148-92e3-49a3-93e6-5343f6e6b8c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72150) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG nova.network.neutron [req-7efe187e-cfcf-40f7-8c44-09eeac7a6f9e req-ba1c39dc-8030-49bf-ad87-663b58d3991a service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Updated VIF entry in instance network info cache for port c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG nova.network.neutron [req-7efe187e-cfcf-40f7-8c44-09eeac7a6f9e req-ba1c39dc-8030-49bf-ad87-663b58d3991a service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Updating instance_info_cache with network_info: [{"id": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "address": "fa:16:3e:e3:ad:06", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ac02e1-ad", "ovs_interfaceid": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:47:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7efe187e-cfcf-40f7-8c44-09eeac7a6f9e req-ba1c39dc-8030-49bf-ad87-663b58d3991a service nova] Releasing lock "refresh_cache-760ec148-92e3-49a3-93e6-5343f6e6b8c0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:47:51 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:47:51 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:47:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-c6005b5c-b678-4712-856c-35c7376a2d5f req-06b18f77-33a7-487d-ba3a-e4e6cf7fe7ba service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Received event network-vif-plugged-c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:47:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c6005b5c-b678-4712-856c-35c7376a2d5f req-06b18f77-33a7-487d-ba3a-e4e6cf7fe7ba service nova] Acquiring lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c6005b5c-b678-4712-856c-35c7376a2d5f req-06b18f77-33a7-487d-ba3a-e4e6cf7fe7ba service nova] Lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c6005b5c-b678-4712-856c-35c7376a2d5f req-06b18f77-33a7-487d-ba3a-e4e6cf7fe7ba service nova] Lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-c6005b5c-b678-4712-856c-35c7376a2d5f req-06b18f77-33a7-487d-ba3a-e4e6cf7fe7ba service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] No waiting events found dispatching network-vif-plugged-c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:47:51 user nova-compute[72150]: WARNING nova.compute.manager [req-c6005b5c-b678-4712-856c-35c7376a2d5f req-06b18f77-33a7-487d-ba3a-e4e6cf7fe7ba service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Received unexpected event network-vif-plugged-c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3 for instance with vm_state building and task_state spawning.
Aug 01 18:47:51 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:47:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:53 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915673.732301, 760ec148-92e3-49a3-93e6-5343f6e6b8c0 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:47:53 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] VM Resumed (Lifecycle Event)
Aug 01 18:47:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:47:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:47:53 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Instance spawned successfully.
Aug 01 18:47:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:47:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:47:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:47:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:47:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:47:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:47:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:47:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:47:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:47:53 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:47:53 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915673.7327287, 760ec148-92e3-49a3-93e6-5343f6e6b8c0 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:47:53 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] VM Started (Lifecycle Event)
Aug 01 18:47:53 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:47:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:47:53 user nova-compute[72150]: DEBUG nova.compute.manager [req-db94441b-7a8c-49b8-b0dc-a11fda5c0f55 req-bfccf223-c2ef-4814-b8be-a4544d9319e5 service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Received event network-vif-plugged-c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:47:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-db94441b-7a8c-49b8-b0dc-a11fda5c0f55 req-bfccf223-c2ef-4814-b8be-a4544d9319e5 service nova] Acquiring lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:47:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-db94441b-7a8c-49b8-b0dc-a11fda5c0f55 req-bfccf223-c2ef-4814-b8be-a4544d9319e5 service nova] Lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:47:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-db94441b-7a8c-49b8-b0dc-a11fda5c0f55 req-bfccf223-c2ef-4814-b8be-a4544d9319e5 service nova] Lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:53 user nova-compute[72150]: DEBUG nova.compute.manager [req-db94441b-7a8c-49b8-b0dc-a11fda5c0f55 req-bfccf223-c2ef-4814-b8be-a4544d9319e5 service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] No waiting events found dispatching network-vif-plugged-c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:47:53 user nova-compute[72150]: WARNING nova.compute.manager [req-db94441b-7a8c-49b8-b0dc-a11fda5c0f55 req-bfccf223-c2ef-4814-b8be-a4544d9319e5 service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Received unexpected event network-vif-plugged-c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3 for instance with vm_state building and task_state spawning.
Aug 01 18:47:53 user nova-compute[72150]: INFO nova.compute.manager [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Took 5.98 seconds to spawn the instance on the hypervisor.
Aug 01 18:47:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:47:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:47:53 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:47:53 user nova-compute[72150]: INFO nova.compute.manager [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Took 6.67 seconds to build instance.
Aug 01 18:47:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-76020b20-3121-47ae-aa46-451da57c26a1 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.780s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:47:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:54 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:47:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:47:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Didn't find any instances for network info cache update. {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 18:47:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:55 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:47:55 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:47:57 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:47:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Cleaning up deleted instances {{(pid=72150) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 18:47:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] There are 0 instances to clean {{(pid=72150) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 18:47:58 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:47:58 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915663.8946135, e64da6da-a4db-4613-90a4-dff7ff5775e0 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:47:58 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] VM Stopped (Lifecycle Event)
Aug 01 18:47:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-239d078e-70a4-49a0-9ad9-0da80664ad6c None None] [instance: e64da6da-a4db-4613-90a4-dff7ff5775e0] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:47:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:47:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:02 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:48:02 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:48:02 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:48:02 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid 8187fa8f-cd78-46ce-887a-e9582f16fea9 {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:48:02 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Triggering sync for uuid 760ec148-92e3-49a3-93e6-5343f6e6b8c0 {{(pid=72150) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 18:48:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "e6831e19-1dc8-470a-8151-9896d8fea013" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:48:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "e6831e19-1dc8-470a-8151-9896d8fea013" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:48:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "8187fa8f-cd78-46ce-887a-e9582f16fea9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:48:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "8187fa8f-cd78-46ce-887a-e9582f16fea9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:48:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:48:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:48:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "e6831e19-1dc8-470a-8151-9896d8fea013" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:48:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:48:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "8187fa8f-cd78-46ce-887a-e9582f16fea9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:48:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:18 user nova-compute[72150]: DEBUG nova.objects.instance [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'flavor' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:48:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:48:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquired lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:48:18 user nova-compute[72150]: DEBUG nova.network.neutron [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:48:18 user nova-compute[72150]: DEBUG nova.objects.instance [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'info_cache' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.network.neutron [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Updating instance_info_cache with network_info: [{"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Releasing lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:48:19 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Instance destroyed successfully.
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.objects.instance [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'resources' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-332550401',display_name='tempest-AttachVolumeTestJSON-server-332550401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-332550401',id=42,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1Pv06QL+gB8akpzxvePS2xW6RCpVy2Ew7P1W7eruRMggchqt3ZwFOUtwpWrdLBnRyq6PjJd04/eUWvQrMOr+kepnE87SxCG13sR5q56un9VmgaCmcSVeQvqkCfksWPsQ==',key_name='tempest-keypair-133087547',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ac704a033c8b46328eeda139cd57a3aa',ramdisk_id='',reservation_id='r-82uxffm9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-961178577',owner_user_name='tempest-AttachVolumeTestJSON-961178577-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:46:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='237fb5b4bd184868a610aaea2766fa0d',uuid=e6831e19-1dc8-470a-8151-9896d8fea013,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converting VIF {"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=34f12530-76e7-453e-b503-4756ee0cb4a5,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f12530-76') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_vif [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=34f12530-76e7-453e-b503-4756ee0cb4a5,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f12530-76') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34f12530-76, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:19 user nova-compute[72150]: INFO os_vif [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=34f12530-76e7-453e-b503-4756ee0cb4a5,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f12530-76')
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaYDNLOM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:48:19 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[41511fdb-d20a-41e4-a03d-eebaeeaa5037]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19a95bc-9895-4432-8915-e42034db2f02]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)
Aug 01 18:48:19 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)
Aug 01 18:48:19 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c2b4280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896'): ({'sdb'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Removing single pathed devices sdb {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99a8314-886d-44d8-83ff-292b894ce3b5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[007f381b-6a1b-46d9-aa52-fc046277b1b4]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Flushing IO for device /dev/sdb {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc97ab1-ab45-4cd2-81c9-d8488add545a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e097c5-22e1-4c40-84ba-225b30b183cb]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ec68d4-809c-4316-a111-e705199fac2a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae94e5e-ba79-4462-bf77-e46b258a959f]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896, portal: 172.16.0.220,3260]
Aug 01 18:48:19 user nova-compute[72150]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896, portal: 172.16.0.220,3260] successful.
Aug 01 18:48:19 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64958e6-906d-40f5-ac45-ddf365dc355d]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] <== disconnect_volume: return (255ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Start _get_guest_xml network_info=[{"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '93a88fc9-82b7-4b38-b7c7-f10a00540c0e', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaYDNLOM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e6831e19-1dc8-470a-8151-9896d8fea013', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0d0b3ed-5b7f-4e57-8bb6-62c773875896', 'serial': 'a0d0b3ed-5b7f-4e57-8bb6-62c773875896'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.objects.instance [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'numa_topology' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:48:19 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:48:19 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.objects.instance [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'vcpu_model' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaYDNLOM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:48:19 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:48:19 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:48:19 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f05866-ed69-41a6-bf73-8b3809eea875]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:48:19 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2710e93e-3ddf-4904-b02c-4c454f163019]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896] added
Aug 01 18:48:19 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8745f0-99f6-48d0-ab2d-8b3e3a58d508]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3925233-21de-42a3-9325-ccedd4594507]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AaYDNLOM {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AaYDNLOM" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9bbcd7-7a9b-45f4-bd79-be6acea953eb]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AaYDNLOM'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4abe1b8-fcb7-4a69-bc15-b33669e391ae]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f09dae2-f2c4-4b63-9e65-d5da22819b2c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 18:48:19 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 18:48:19 user nova-compute[72150]:  {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:48:19 user nova-compute[72150]: WARNING os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 18:48:19 user nova-compute[72150]: 
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ce40c8-7618-443e-a27d-1f634ec67ecf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896, portal: 172.16.0.220,3260]
Aug 01 18:48:19 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896, portal: 172.16.0.220,3260] successful.
Aug 01 18:48:19 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e752e009-3b92-4e93-977b-4c162b2f0a06]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fa527d-96c0-41ef-9f8c-caec656643ac]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)
Aug 01 18:48:19 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)
Aug 01 18:48:19 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb531ec-0f3a-4fca-8660-95feed76b31a]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:48:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:20 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:48:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaYDNLOM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:48:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:48:20 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23464393239343333', 'path': '/dev/sdb'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:48:20 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464393239343333', 'path': '/dev/sdb'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:48:20 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-332550401',display_name='tempest-AttachVolumeTestJSON-server-332550401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-332550401',id=42,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1Pv06QL+gB8akpzxvePS2xW6RCpVy2Ew7P1W7eruRMggchqt3ZwFOUtwpWrdLBnRyq6PjJd04/eUWvQrMOr+kepnE87SxCG13sR5q56un9VmgaCmcSVeQvqkCfksWPsQ==',key_name='tempest-keypair-133087547',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ac704a033c8b46328eeda139cd57a3aa',ramdisk_id='',reservation_id='r-82uxffm9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-961178577',owner_user_name='tempest-AttachVolumeTestJSON-961178577-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:46:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='237fb5b4bd184868a610aaea2766fa0d',uuid=e6831e19-1dc8-470a-8151-9896d8fea013,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:48:20 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converting VIF {"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:48:20 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=34f12530-76e7-453e-b503-4756ee0cb4a5,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f12530-76') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:48:20 user nova-compute[72150]: DEBUG nova.objects.instance [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'pci_devices' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:48:20 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:48:20 user nova-compute[72150]:   <uuid>e6831e19-1dc8-470a-8151-9896d8fea013</uuid>
Aug 01 18:48:20 user nova-compute[72150]:   <name>instance-0000002a</name>
Aug 01 18:48:20 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:48:20 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:48:20 user nova-compute[72150]:   <metadata>
Aug 01 18:48:20 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:48:20 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:48:20 user nova-compute[72150]:       <nova:name>tempest-AttachVolumeTestJSON-server-332550401</nova:name>
Aug 01 18:48:20 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:48:19</nova:creationTime>
Aug 01 18:48:20 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:48:20 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:48:20 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:48:20 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:48:20 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:48:20 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:48:20 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:48:20 user nova-compute[72150]:       <nova:owner>
Aug 01 18:48:20 user nova-compute[72150]:         <nova:user uuid="237fb5b4bd184868a610aaea2766fa0d">tempest-AttachVolumeTestJSON-961178577-project-member</nova:user>
Aug 01 18:48:20 user nova-compute[72150]:         <nova:project uuid="ac704a033c8b46328eeda139cd57a3aa">tempest-AttachVolumeTestJSON-961178577</nova:project>
Aug 01 18:48:20 user nova-compute[72150]:       </nova:owner>
Aug 01 18:48:20 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:48:20 user nova-compute[72150]:       <nova:ports>
Aug 01 18:48:20 user nova-compute[72150]:         <nova:port uuid="34f12530-76e7-453e-b503-4756ee0cb4a5">
Aug 01 18:48:20 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 18:48:20 user nova-compute[72150]:         </nova:port>
Aug 01 18:48:20 user nova-compute[72150]:       </nova:ports>
Aug 01 18:48:20 user nova-compute[72150]:     </nova:instance>
Aug 01 18:48:20 user nova-compute[72150]:   </metadata>
Aug 01 18:48:20 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:48:20 user nova-compute[72150]:     <system>
Aug 01 18:48:20 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:48:20 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:48:20 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:48:20 user nova-compute[72150]:       <entry name="serial">e6831e19-1dc8-470a-8151-9896d8fea013</entry>
Aug 01 18:48:20 user nova-compute[72150]:       <entry name="uuid">e6831e19-1dc8-470a-8151-9896d8fea013</entry>
Aug 01 18:48:20 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:48:20 user nova-compute[72150]:     </system>
Aug 01 18:48:20 user nova-compute[72150]:   </sysinfo>
Aug 01 18:48:20 user nova-compute[72150]:   <os>
Aug 01 18:48:20 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:48:20 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:48:20 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:48:20 user nova-compute[72150]:   </os>
Aug 01 18:48:20 user nova-compute[72150]:   <features>
Aug 01 18:48:20 user nova-compute[72150]:     <acpi/>
Aug 01 18:48:20 user nova-compute[72150]:     <apic/>
Aug 01 18:48:20 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:48:20 user nova-compute[72150]:   </features>
Aug 01 18:48:20 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:48:20 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:48:20 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:48:20 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:48:20 user nova-compute[72150]:   </clock>
Aug 01 18:48:20 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:48:20 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:48:20 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:48:20 user nova-compute[72150]:   </cpu>
Aug 01 18:48:20 user nova-compute[72150]:   <devices>
Aug 01 18:48:20 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:48:20 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:48:20 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk"/>
Aug 01 18:48:20 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:48:20 user nova-compute[72150]:     </disk>
Aug 01 18:48:20 user nova-compute[72150]:     <disk type="block" device="disk">
Aug 01 18:48:20 user nova-compute[72150]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:48:20 user nova-compute[72150]:       <source dev="/dev/sdb"/>
Aug 01 18:48:20 user nova-compute[72150]:       <target dev="vdb" bus="virtio"/>
Aug 01 18:48:20 user nova-compute[72150]:       <serial>a0d0b3ed-5b7f-4e57-8bb6-62c773875896</serial>
Aug 01 18:48:20 user nova-compute[72150]:     </disk>
Aug 01 18:48:20 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:48:20 user nova-compute[72150]:       <mac address="fa:16:3e:6a:16:f7"/>
Aug 01 18:48:20 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:48:20 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:48:20 user nova-compute[72150]:       <target dev="tap34f12530-76"/>
Aug 01 18:48:20 user nova-compute[72150]:     </interface>
Aug 01 18:48:20 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:48:20 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/console.log" append="off"/>
Aug 01 18:48:20 user nova-compute[72150]:     </serial>
Aug 01 18:48:20 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:48:20 user nova-compute[72150]:     <video>
Aug 01 18:48:20 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:48:20 user nova-compute[72150]:     </video>
Aug 01 18:48:20 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:48:20 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:48:20 user nova-compute[72150]:     </rng>
Aug 01 18:48:20 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:48:20 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:48:20 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:48:20 user nova-compute[72150]:     </memballoon>
Aug 01 18:48:20 user nova-compute[72150]:   </devices>
Aug 01 18:48:20 user nova-compute[72150]: </domain>
Aug 01 18:48:20 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:48:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG nova.objects.instance [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'trusted_certs' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.143s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Cannot resize image /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG nova.objects.instance [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'migration_context' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-332550401',display_name='tempest-AttachVolumeTestJSON-server-332550401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-332550401',id=42,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1Pv06QL+gB8akpzxvePS2xW6RCpVy2Ew7P1W7eruRMggchqt3ZwFOUtwpWrdLBnRyq6PjJd04/eUWvQrMOr+kepnE87SxCG13sR5q56un9VmgaCmcSVeQvqkCfksWPsQ==',key_name='tempest-keypair-133087547',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='ac704a033c8b46328eeda139cd57a3aa',ramdisk_id='',reservation_id='r-82uxffm9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-961178577',owner_user_name='tempest-AttachVolumeTestJSON-961178577-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:46:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='237fb5b4bd184868a610aaea2766fa0d',uuid=e6831e19-1dc8-470a-8151-9896d8fea013,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converting VIF {"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=34f12530-76e7-453e-b503-4756ee0cb4a5,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f12530-76') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG os_vif [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=34f12530-76e7-453e-b503-4756ee0cb4a5,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f12530-76') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34f12530-76, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap34f12530-76, col_values=(('external_ids', {'iface-id': '34f12530-76e7-453e-b503-4756ee0cb4a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:16:f7', 'vm-uuid': 'e6831e19-1dc8-470a-8151-9896d8fea013'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:48:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:21 user nova-compute[72150]: INFO os_vif [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=34f12530-76e7-453e-b503-4756ee0cb4a5,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f12530-76')
Aug 01 18:48:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:23 user nova-compute[72150]: DEBUG nova.compute.manager [req-fefdb91f-0ae0-4629-ba0a-f6f71f11a8b7 req-d07e1201-b52f-40a5-9def-e91540ee9f81 service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received event network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:48:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fefdb91f-0ae0-4629-ba0a-f6f71f11a8b7 req-d07e1201-b52f-40a5-9def-e91540ee9f81 service nova] Acquiring lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:48:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fefdb91f-0ae0-4629-ba0a-f6f71f11a8b7 req-d07e1201-b52f-40a5-9def-e91540ee9f81 service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:48:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fefdb91f-0ae0-4629-ba0a-f6f71f11a8b7 req-d07e1201-b52f-40a5-9def-e91540ee9f81 service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:48:23 user nova-compute[72150]: DEBUG nova.compute.manager [req-fefdb91f-0ae0-4629-ba0a-f6f71f11a8b7 req-d07e1201-b52f-40a5-9def-e91540ee9f81 service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] No waiting events found dispatching network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:48:23 user nova-compute[72150]: WARNING nova.compute.manager [req-fefdb91f-0ae0-4629-ba0a-f6f71f11a8b7 req-d07e1201-b52f-40a5-9def-e91540ee9f81 service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received unexpected event network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 for instance with vm_state stopped and task_state powering-on.
Aug 01 18:48:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:25 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915705.035313, e6831e19-1dc8-470a-8151-9896d8fea013 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:48:25 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] VM Resumed (Lifecycle Event)
Aug 01 18:48:25 user nova-compute[72150]: DEBUG nova.compute.manager [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:48:25 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Instance rebooted successfully.
Aug 01 18:48:25 user nova-compute[72150]: DEBUG nova.compute.manager [None req-baaa2626-303c-4db0-a2a9-c40ba1ea98c7 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:48:25 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:48:25 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:48:25 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 01 18:48:25 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915705.0366628, e6831e19-1dc8-470a-8151-9896d8fea013 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:48:25 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] VM Started (Lifecycle Event)
Aug 01 18:48:25 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:48:25 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:48:25 user nova-compute[72150]: DEBUG nova.compute.manager [req-0ae83f7b-e2d6-4d93-b5d0-2d5924b5a64f req-7875ecfd-c65f-4d17-9c78-98b851c75c4b service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received event network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:48:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0ae83f7b-e2d6-4d93-b5d0-2d5924b5a64f req-7875ecfd-c65f-4d17-9c78-98b851c75c4b service nova] Acquiring lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:48:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0ae83f7b-e2d6-4d93-b5d0-2d5924b5a64f req-7875ecfd-c65f-4d17-9c78-98b851c75c4b service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:48:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0ae83f7b-e2d6-4d93-b5d0-2d5924b5a64f req-7875ecfd-c65f-4d17-9c78-98b851c75c4b service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:48:25 user nova-compute[72150]: DEBUG nova.compute.manager [req-0ae83f7b-e2d6-4d93-b5d0-2d5924b5a64f req-7875ecfd-c65f-4d17-9c78-98b851c75c4b service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] No waiting events found dispatching network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:48:25 user nova-compute[72150]: WARNING nova.compute.manager [req-0ae83f7b-e2d6-4d93-b5d0-2d5924b5a64f req-7875ecfd-c65f-4d17-9c78-98b851c75c4b service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received unexpected event network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 for instance with vm_state active and task_state None.
Aug 01 18:48:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:42 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:48:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:48 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:48:49 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:48:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:48:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:48:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:48:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:48:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:48:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8187fa8f-cd78-46ce-887a-e9582f16fea9/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8187fa8f-cd78-46ce-887a-e9582f16fea9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8187fa8f-cd78-46ce-887a-e9582f16fea9/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8187fa8f-cd78-46ce-887a-e9582f16fea9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:48:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:48:51 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:48:51 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:48:51 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8350MB free_disk=25.401172637939453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:48:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:48:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:48:51 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance e6831e19-1dc8-470a-8151-9896d8fea013 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:48:51 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 8187fa8f-cd78-46ce-887a-e9582f16fea9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:48:51 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 760ec148-92e3-49a3-93e6-5343f6e6b8c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:48:51 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:48:51 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:48:51 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Refreshing inventories for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 18:48:51 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Updating ProviderTree inventory for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 18:48:51 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Updating inventory in ProviderTree for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 18:48:51 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Refreshing aggregate associations for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479, aggregates: None {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 18:48:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:51 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Refreshing trait associations for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 18:48:51 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:48:51 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:48:51 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:48:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.591s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:48:53 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:48:53 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:48:53 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:48:54 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:48:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:55 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:48:55 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:48:55 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 18:48:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:48:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:48:55 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:48:55 user nova-compute[72150]: DEBUG nova.objects.instance [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lazy-loading 'info_cache' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:48:56 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Updating instance_info_cache with network_info: [{"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:48:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:48:56 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:48:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:48:57 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:48:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:49:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:49:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:49:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:49:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:49:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:49:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:49:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:49:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:49:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:49:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:49:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Acquiring lock "8187fa8f-cd78-46ce-887a-e9582f16fea9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:49:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "8187fa8f-cd78-46ce-887a-e9582f16fea9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:49:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Acquiring lock "8187fa8f-cd78-46ce-887a-e9582f16fea9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:49:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "8187fa8f-cd78-46ce-887a-e9582f16fea9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:49:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "8187fa8f-cd78-46ce-887a-e9582f16fea9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:49:23 user nova-compute[72150]: INFO nova.compute.manager [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Terminating instance
Aug 01 18:49:23 user nova-compute[72150]: DEBUG nova.compute.manager [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:49:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:49:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:49:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:49:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:49:24 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Instance destroyed successfully.
Aug 01 18:49:24 user nova-compute[72150]: DEBUG nova.objects.instance [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lazy-loading 'resources' on Instance uuid 8187fa8f-cd78-46ce-887a-e9582f16fea9 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:49:24 user nova-compute[72150]: DEBUG nova.compute.manager [req-e19a770f-e057-4a0e-81f6-2a55e043d703 req-147fc206-de3d-472f-a689-55ce371f01ba service nova] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Received event network-vif-unplugged-952573e9-4c7c-4c17-b64f-21193b63b080 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:49:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e19a770f-e057-4a0e-81f6-2a55e043d703 req-147fc206-de3d-472f-a689-55ce371f01ba service nova] Acquiring lock "8187fa8f-cd78-46ce-887a-e9582f16fea9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:49:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e19a770f-e057-4a0e-81f6-2a55e043d703 req-147fc206-de3d-472f-a689-55ce371f01ba service nova] Lock "8187fa8f-cd78-46ce-887a-e9582f16fea9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:49:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e19a770f-e057-4a0e-81f6-2a55e043d703 req-147fc206-de3d-472f-a689-55ce371f01ba service nova] Lock "8187fa8f-cd78-46ce-887a-e9582f16fea9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:49:24 user nova-compute[72150]: DEBUG nova.compute.manager [req-e19a770f-e057-4a0e-81f6-2a55e043d703 req-147fc206-de3d-472f-a689-55ce371f01ba service nova] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] No waiting events found dispatching network-vif-unplugged-952573e9-4c7c-4c17-b64f-21193b63b080 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:49:24 user nova-compute[72150]: DEBUG nova.compute.manager [req-e19a770f-e057-4a0e-81f6-2a55e043d703 req-147fc206-de3d-472f-a689-55ce371f01ba service nova] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Received event network-vif-unplugged-952573e9-4c7c-4c17-b64f-21193b63b080 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:49:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2121774926',display_name='tempest-VolumesActionsTest-instance-2121774926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2121774926',id=44,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:47:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9fef6c64f0545ef99e0c2e8059cd267',ramdisk_id='',reservation_id='r-n2ukka74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1283477154',owner_user_name='tempest-VolumesActionsTest-1283477154-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:47:41Z,user_data=None,user_id='487eb09a6aa148c18ba2070972457616',uuid=8187fa8f-cd78-46ce-887a-e9582f16fea9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "952573e9-4c7c-4c17-b64f-21193b63b080", "address": "fa:16:3e:46:e1:3d", "network": {"id": "2468551a-06dc-44c4-82fe-7ed843e90920", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1864190400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9fef6c64f0545ef99e0c2e8059cd267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap952573e9-4c", "ovs_interfaceid": "952573e9-4c7c-4c17-b64f-21193b63b080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:49:24 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Converting VIF {"id": "952573e9-4c7c-4c17-b64f-21193b63b080", "address": "fa:16:3e:46:e1:3d", "network": {"id": "2468551a-06dc-44c4-82fe-7ed843e90920", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1864190400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9fef6c64f0545ef99e0c2e8059cd267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap952573e9-4c", "ovs_interfaceid": "952573e9-4c7c-4c17-b64f-21193b63b080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:49:24 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:e1:3d,bridge_name='br-int',has_traffic_filtering=True,id=952573e9-4c7c-4c17-b64f-21193b63b080,network=Network(2468551a-06dc-44c4-82fe-7ed843e90920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap952573e9-4c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:49:24 user nova-compute[72150]: DEBUG os_vif [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:e1:3d,bridge_name='br-int',has_traffic_filtering=True,id=952573e9-4c7c-4c17-b64f-21193b63b080,network=Network(2468551a-06dc-44c4-82fe-7ed843e90920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap952573e9-4c') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:49:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:49:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap952573e9-4c, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:49:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:49:24 user nova-compute[72150]: INFO os_vif [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:e1:3d,bridge_name='br-int',has_traffic_filtering=True,id=952573e9-4c7c-4c17-b64f-21193b63b080,network=Network(2468551a-06dc-44c4-82fe-7ed843e90920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap952573e9-4c')
Aug 01 18:49:24 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Deleting instance files /opt/stack/data/nova/instances/8187fa8f-cd78-46ce-887a-e9582f16fea9_del
Aug 01 18:49:24 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Deletion of /opt/stack/data/nova/instances/8187fa8f-cd78-46ce-887a-e9582f16fea9_del complete
Aug 01 18:49:24 user nova-compute[72150]: INFO nova.compute.manager [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 01 18:49:24 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:49:24 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:49:24 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:49:25 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:49:25 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Took 0.75 seconds to deallocate network for instance.
Aug 01 18:49:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:49:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:49:25 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:49:25 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:49:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:49:25 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Deleted allocations for instance 8187fa8f-cd78-46ce-887a-e9582f16fea9
Aug 01 18:49:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-947d8ff5-bad5-452a-b3bc-00424e33672d tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "8187fa8f-cd78-46ce-887a-e9582f16fea9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.879s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:49:26 user nova-compute[72150]: DEBUG nova.compute.manager [req-08d6bd57-9b3e-4da3-ba59-7bbb683dfa66 req-81c3855e-f751-4f07-be32-ad5e2b45d12f service nova] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Received event network-vif-plugged-952573e9-4c7c-4c17-b64f-21193b63b080 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:49:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08d6bd57-9b3e-4da3-ba59-7bbb683dfa66 req-81c3855e-f751-4f07-be32-ad5e2b45d12f service nova] Acquiring lock "8187fa8f-cd78-46ce-887a-e9582f16fea9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:49:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08d6bd57-9b3e-4da3-ba59-7bbb683dfa66 req-81c3855e-f751-4f07-be32-ad5e2b45d12f service nova] Lock "8187fa8f-cd78-46ce-887a-e9582f16fea9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:49:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-08d6bd57-9b3e-4da3-ba59-7bbb683dfa66 req-81c3855e-f751-4f07-be32-ad5e2b45d12f service nova] Lock "8187fa8f-cd78-46ce-887a-e9582f16fea9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:49:26 user nova-compute[72150]: DEBUG nova.compute.manager [req-08d6bd57-9b3e-4da3-ba59-7bbb683dfa66 req-81c3855e-f751-4f07-be32-ad5e2b45d12f service nova] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] No waiting events found dispatching network-vif-plugged-952573e9-4c7c-4c17-b64f-21193b63b080 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:49:26 user nova-compute[72150]: WARNING nova.compute.manager [req-08d6bd57-9b3e-4da3-ba59-7bbb683dfa66 req-81c3855e-f751-4f07-be32-ad5e2b45d12f service nova] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Received unexpected event network-vif-plugged-952573e9-4c7c-4c17-b64f-21193b63b080 for instance with vm_state deleted and task_state None.
Aug 01 18:49:26 user nova-compute[72150]: DEBUG nova.compute.manager [req-08d6bd57-9b3e-4da3-ba59-7bbb683dfa66 req-81c3855e-f751-4f07-be32-ad5e2b45d12f service nova] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Received event network-vif-deleted-952573e9-4c7c-4c17-b64f-21193b63b080 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:49:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:49:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:49:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:49:39 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915764.3477826, 8187fa8f-cd78-46ce-887a-e9582f16fea9 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:49:39 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] VM Stopped (Lifecycle Event)
Aug 01 18:49:39 user nova-compute[72150]: DEBUG nova.compute.manager [None req-e12f5cda-dbc0-41bf-b4c1-1489ac9eaa44 None None] [instance: 8187fa8f-cd78-46ce-887a-e9582f16fea9] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:49:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:49:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG nova.compute.manager [req-746da1ac-94d3-4bc0-bc2a-ee93cf9b9c12 req-29dfdd4d-8969-404a-8968-80b36a4668db service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Received event network-changed-c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG nova.compute.manager [req-746da1ac-94d3-4bc0-bc2a-ee93cf9b9c12 req-29dfdd4d-8969-404a-8968-80b36a4668db service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Refreshing instance network info cache due to event network-changed-c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-746da1ac-94d3-4bc0-bc2a-ee93cf9b9c12 req-29dfdd4d-8969-404a-8968-80b36a4668db service nova] Acquiring lock "refresh_cache-760ec148-92e3-49a3-93e6-5343f6e6b8c0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-746da1ac-94d3-4bc0-bc2a-ee93cf9b9c12 req-29dfdd4d-8969-404a-8968-80b36a4668db service nova] Acquired lock "refresh_cache-760ec148-92e3-49a3-93e6-5343f6e6b8c0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG nova.network.neutron [req-746da1ac-94d3-4bc0-bc2a-ee93cf9b9c12 req-29dfdd4d-8969-404a-8968-80b36a4668db service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Refreshing network info cache for port c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lazy-loading 'flavor' on Instance uuid 760ec148-92e3-49a3-93e6-5343f6e6b8c0 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:49:40 user nova-compute[72150]: INFO nova.compute.manager [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Attaching volume d5072fa3-3342-4209-b8a1-843876ab6018 to /dev/vdb
Aug 01 18:49:40 user nova-compute[72150]: DEBUG nova.network.neutron [req-746da1ac-94d3-4bc0-bc2a-ee93cf9b9c12 req-29dfdd4d-8969-404a-8968-80b36a4668db service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Updated VIF entry in instance network info cache for port c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG nova.network.neutron [req-746da1ac-94d3-4bc0-bc2a-ee93cf9b9c12 req-29dfdd4d-8969-404a-8968-80b36a4668db service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Updating instance_info_cache with network_info: [{"id": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "address": "fa:16:3e:e3:ad:06", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ac02e1-ad", "ovs_interfaceid": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-746da1ac-94d3-4bc0-bc2a-ee93cf9b9c12 req-29dfdd4d-8969-404a-8968-80b36a4668db service nova] Releasing lock "refresh_cache-760ec148-92e3-49a3-93e6-5343f6e6b8c0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG os_brick.utils [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4403ee5-6286-46d2-9e1a-604ce4f91e3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98b2676-68b8-4713-bdfe-be691b209ff6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a669fd61-7dbe-476d-9b87-7feb4a682fff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[480b2088-3df7-4438-bf67-dbf99fdcc3f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:49:40 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:49:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8fa8b9-2e06-429a-9d90-38856d4f4828]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG os_brick.utils [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:49:40 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Updating existing volume attachment record: 6c4e266d-0113-4c93-bc22-1783499e3710 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:49:42 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:49:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:49:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rzPNQwbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:49:48 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:49:48 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:49:48 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b220ad-5faf-4211-8da2-ef5a14317ef7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:49:48 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f27c3d-2be0-4980-97d5-83351e004d43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018] added
Aug 01 18:49:48 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc6521e-21c6-4649-9b60-ed4c8f79285e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f35650e-f823-4f64-8202-edc7cd551b45]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rzPNQwbU {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rzPNQwbU" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d0cc08-c403-4006-a71c-170d0d525882]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rzPNQwbU'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a490a941-2bda-4123-bd65-6716f22f1186]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc95db0-8de4-4189-a6d8-f4f8bd0faf76]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)
Aug 01 18:49:48 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)
Aug 01 18:49:48 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b787e836-39db-4cb6-b113-8c2f0db28646]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018, portal: 172.16.0.220,3260]
Aug 01 18:49:48 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018, portal: 172.16.0.220,3260] successful.
Aug 01 18:49:48 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4dc99e-0518-4487-bf4a-c0be56c7ebec]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4daa6b-fced-4d56-b8c6-65bbad0b7b05]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)
Aug 01 18:49:48 user nova-compute[72150]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 (non-flash)
Aug 01 18:49:48 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)
Aug 01 18:49:48 user nova-compute[72150]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 (non-flash)
Aug 01 18:49:48 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec707b3-6e6c-4d9e-b8d3-5fa3db0bb347]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rzPNQwbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:49:48 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:49:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:49:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:49:49 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26666623332393761', 'path': '/dev/sdc'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:49:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666623332393761', 'path': '/dev/sdc'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:49:49 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lazy-loading 'flavor' on Instance uuid 760ec148-92e3-49a3-93e6-5343f6e6b8c0 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:49:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:49:49 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:49:49 user nova-compute[72150]:   <source dev="/dev/sdc"/>
Aug 01 18:49:49 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:49:49 user nova-compute[72150]:   <serial>d5072fa3-3342-4209-b8a1-843876ab6018</serial>
Aug 01 18:49:49 user nova-compute[72150]: </disk>
Aug 01 18:49:49 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:49:49 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:49:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:49:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:49:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:49:49 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:49:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:49:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:49:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:49:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] No VIF found with MAC fa:16:3e:e3:ad:06, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:49:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9beed398-a729-42d6-874f-331074a7e34f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.544s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:49:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:49:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:49:50 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:49:50 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:49:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8607MB free_disk=25.41827392578125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:49:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:49:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:49:51 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance e6831e19-1dc8-470a-8151-9896d8fea013 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:49:51 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 760ec148-92e3-49a3-93e6-5343f6e6b8c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:49:51 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:49:51 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:49:51 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:49:51 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:49:51 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:49:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.362s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:49:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:49:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:49:51 user nova-compute[72150]: INFO nova.compute.manager [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Detaching volume d5072fa3-3342-4209-b8a1-843876ab6018
Aug 01 18:49:51 user nova-compute[72150]: INFO nova.virt.block_device [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Attempting to driver detach volume d5072fa3-3342-4209-b8a1-843876ab6018 from mountpoint /dev/vdb
Aug 01 18:49:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Attempting to detach device vdb from instance 760ec148-92e3-49a3-93e6-5343f6e6b8c0 from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:49:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:49:51 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:49:51 user nova-compute[72150]:   <source dev="/dev/sdc"/>
Aug 01 18:49:51 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:49:51 user nova-compute[72150]:   <serial>d5072fa3-3342-4209-b8a1-843876ab6018</serial>
Aug 01 18:49:51 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:49:51 user nova-compute[72150]: </disk>
Aug 01 18:49:51 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:49:51 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Successfully detached device vdb from instance 760ec148-92e3-49a3-93e6-5343f6e6b8c0 from the persistent domain config.
Aug 01 18:49:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 760ec148-92e3-49a3-93e6-5343f6e6b8c0 from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:49:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:49:51 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:49:51 user nova-compute[72150]:   <source dev="/dev/sdc"/>
Aug 01 18:49:51 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:49:51 user nova-compute[72150]:   <serial>d5072fa3-3342-4209-b8a1-843876ab6018</serial>
Aug 01 18:49:51 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:49:51 user nova-compute[72150]: </disk>
Aug 01 18:49:51 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690915792.2685094, 760ec148-92e3-49a3-93e6-5343f6e6b8c0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 760ec148-92e3-49a3-93e6-5343f6e6b8c0 {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:49:52 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Successfully detached device vdb from instance 760ec148-92e3-49a3-93e6-5343f6e6b8c0 from the live domain config.
Aug 01 18:49:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rzPNQwbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:49:52 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:49:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e5f599-b674-4031-904a-af1d68f0ce81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b5c982-e1e1-49a5-a22a-162706504d08]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)
Aug 01 18:49:52 user nova-compute[72150]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 (non-flash)
Aug 01 18:49:52 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)
Aug 01 18:49:52 user nova-compute[72150]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 (non-flash)
Aug 01 18:49:52 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec2f5ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018'): ({'sdc'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Removing single pathed devices sdc {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[387d338f-0363-452c-bdb4-88fd71acb62e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[591cbac9-6707-4bcb-aecc-06bff0b8b652]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Flushing IO for device /dev/sdc {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6d9745-522e-4bff-b7e6-6e868bf39f27]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f4ede3-bf30-4982-a223-17b28de4d5f2]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] SCSI volumes sdc have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdd498f-0c58-45a5-ab4b-c2afa318da8c]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe08c13-c0cd-42fc-a08e-74c8f7240a46]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018, portal: 172.16.0.220,3260]
Aug 01 18:49:52 user nova-compute[72150]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018, portal: 172.16.0.220,3260] successful.
Aug 01 18:49:52 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5072fa3-3342-4209-b8a1-843876ab6018 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b91c16-334b-4ac3-8044-efaf13b3fc45]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] <== disconnect_volume: return (255ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:49:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:49:53 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lazy-loading 'flavor' on Instance uuid 760ec148-92e3-49a3-93e6-5343f6e6b8c0 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:49:53 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:49:53 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:49:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9308aa5e-b77c-4243-9cd9-49ee84648001 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.596s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:49:53 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:49:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:49:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:49:55 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:49:56 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:49:56 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:49:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-760ec148-92e3-49a3-93e6-5343f6e6b8c0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:49:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-760ec148-92e3-49a3-93e6-5343f6e6b8c0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:49:56 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:49:57 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Updating instance_info_cache with network_info: [{"id": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "address": "fa:16:3e:e3:ad:06", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ac02e1-ad", "ovs_interfaceid": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:49:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-760ec148-92e3-49a3-93e6-5343f6e6b8c0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:49:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:49:57 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:49:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:49:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:02 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:50:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "e6831e19-1dc8-470a-8151-9896d8fea013" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "e6831e19-1dc8-470a-8151-9896d8fea013" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:09 user nova-compute[72150]: INFO nova.compute.manager [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Detaching volume a0d0b3ed-5b7f-4e57-8bb6-62c773875896
Aug 01 18:50:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:09 user nova-compute[72150]: INFO nova.virt.block_device [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Attempting to driver detach volume a0d0b3ed-5b7f-4e57-8bb6-62c773875896 from mountpoint /dev/vdb
Aug 01 18:50:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Attempting to detach device vdb from instance e6831e19-1dc8-470a-8151-9896d8fea013 from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:50:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:50:09 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:50:09 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 18:50:09 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:50:09 user nova-compute[72150]:   <serial>a0d0b3ed-5b7f-4e57-8bb6-62c773875896</serial>
Aug 01 18:50:09 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 18:50:09 user nova-compute[72150]: </disk>
Aug 01 18:50:09 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:50:10 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Successfully detached device vdb from instance e6831e19-1dc8-470a-8151-9896d8fea013 from the persistent domain config.
Aug 01 18:50:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e6831e19-1dc8-470a-8151-9896d8fea013 from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:50:10 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:50:10 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 18:50:10 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:50:10 user nova-compute[72150]:   <serial>a0d0b3ed-5b7f-4e57-8bb6-62c773875896</serial>
Aug 01 18:50:10 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 18:50:10 user nova-compute[72150]: </disk>
Aug 01 18:50:10 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690915810.460591, e6831e19-1dc8-470a-8151-9896d8fea013 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:50:10 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Successfully detached device vdb from instance e6831e19-1dc8-470a-8151-9896d8fea013 from the live domain config.
Aug 01 18:50:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaYDNLOM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:50:10 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:50:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[33172821-7920-4858-b8fe-45c1b14b2b3b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c353d3-0ccf-4b2b-b242-96505f61feed]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)
Aug 01 18:50:10 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 (non-flash)
Aug 01 18:50:10 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec5549d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896'): ({'sdb'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Removing single pathed devices sdb {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee32e319-8fcc-438e-975e-7fbc693f9a67]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6120eae3-5a71-427e-a1aa-f69260bcfaaf]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Flushing IO for device /dev/sdb {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8777e79d-6f40-4486-8386-4ff1d4519de5]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a71a97-c6ab-4a95-a588-cddcd02c9a81]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c7a2a8-214e-4126-92ba-e84c6527fd30]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[09979ba5-e3c7-47a6-8e1a-d823ea805b64]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896, portal: 172.16.0.220,3260]
Aug 01 18:50:10 user nova-compute[72150]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896, portal: 172.16.0.220,3260] successful.
Aug 01 18:50:10 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0d0b3ed-5b7f-4e57-8bb6-62c773875896 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05bd932-f42c-4e86-b2f4-8d312d03483a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.243s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] <== disconnect_volume: return (244ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:50:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:50:11 user nova-compute[72150]: DEBUG nova.objects.instance [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'flavor' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:50:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-21fa3455-e806-4ddc-af42-753f90baec89 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "e6831e19-1dc8-470a-8151-9896d8fea013" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.709s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-41f8ecfe-0f2d-450a-90cb-f2d6e23a1f48 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "e6831e19-1dc8-470a-8151-9896d8fea013" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-41f8ecfe-0f2d-450a-90cb-f2d6e23a1f48 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "e6831e19-1dc8-470a-8151-9896d8fea013" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:12 user nova-compute[72150]: DEBUG nova.compute.manager [None req-41f8ecfe-0f2d-450a-90cb-f2d6e23a1f48 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:50:12 user nova-compute[72150]: DEBUG nova.compute.manager [None req-41f8ecfe-0f2d-450a-90cb-f2d6e23a1f48 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72150) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 01 18:50:12 user nova-compute[72150]: DEBUG nova.objects.instance [None req-41f8ecfe-0f2d-450a-90cb-f2d6e23a1f48 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'flavor' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:50:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:13 user nova-compute[72150]: DEBUG nova.compute.manager [req-5d0fa067-ef7c-46ac-8af3-e6000b911b42 req-b43447e2-3f36-4d7b-a6e8-fb4d551c5fce service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received event network-vif-unplugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:50:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5d0fa067-ef7c-46ac-8af3-e6000b911b42 req-b43447e2-3f36-4d7b-a6e8-fb4d551c5fce service nova] Acquiring lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5d0fa067-ef7c-46ac-8af3-e6000b911b42 req-b43447e2-3f36-4d7b-a6e8-fb4d551c5fce service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5d0fa067-ef7c-46ac-8af3-e6000b911b42 req-b43447e2-3f36-4d7b-a6e8-fb4d551c5fce service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:13 user nova-compute[72150]: DEBUG nova.compute.manager [req-5d0fa067-ef7c-46ac-8af3-e6000b911b42 req-b43447e2-3f36-4d7b-a6e8-fb4d551c5fce service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] No waiting events found dispatching network-vif-unplugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:50:13 user nova-compute[72150]: WARNING nova.compute.manager [req-5d0fa067-ef7c-46ac-8af3-e6000b911b42 req-b43447e2-3f36-4d7b-a6e8-fb4d551c5fce service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received unexpected event network-vif-unplugged-34f12530-76e7-453e-b503-4756ee0cb4a5 for instance with vm_state active and task_state powering-off.
Aug 01 18:50:13 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Instance destroyed successfully.
Aug 01 18:50:13 user nova-compute[72150]: DEBUG nova.compute.manager [None req-41f8ecfe-0f2d-450a-90cb-f2d6e23a1f48 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:50:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-41f8ecfe-0f2d-450a-90cb-f2d6e23a1f48 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "e6831e19-1dc8-470a-8151-9896d8fea013" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.828s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Acquiring lock "30f0aa50-65d4-4a5d-a507-f6ee539478ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Lock "30f0aa50-65d4-4a5d-a507-f6ee539478ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:13 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:50:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:13 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:50:13 user nova-compute[72150]: INFO nova.compute.claims [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Claim successful on node user
Aug 01 18:50:14 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:50:14 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:50:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:50:14 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Creating image(s)
Aug 01 18:50:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Acquiring lock "/opt/stack/data/nova/instances/30f0aa50-65d4-4a5d-a507-f6ee539478ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Lock "/opt/stack/data/nova/instances/30f0aa50-65d4-4a5d-a507-f6ee539478ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Lock "/opt/stack/data/nova/instances/30f0aa50-65d4-4a5d-a507-f6ee539478ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/30f0aa50-65d4-4a5d-a507-f6ee539478ca/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/30f0aa50-65d4-4a5d-a507-f6ee539478ca/disk 1073741824" returned: 0 in 0.052s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.134s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30f0aa50-65d4-4a5d-a507-f6ee539478ca/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f0aa50-65d4-4a5d-a507-f6ee539478ca/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f0aa50-65d4-4a5d-a507-f6ee539478ca/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Cannot resize image /opt/stack/data/nova/instances/30f0aa50-65d4-4a5d-a507-f6ee539478ca/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG nova.objects.instance [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Lazy-loading 'migration_context' on Instance uuid 30f0aa50-65d4-4a5d-a507-f6ee539478ca {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Ensure instance console log exists: /opt/stack/data/nova/instances/30f0aa50-65d4-4a5d-a507-f6ee539478ca/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:15 user nova-compute[72150]: DEBUG nova.compute.manager [req-901bd522-2159-47af-8bb7-ea54f9397076 req-ae9c9fab-419d-4e96-8350-8a73594252ff service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received event network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:50:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-901bd522-2159-47af-8bb7-ea54f9397076 req-ae9c9fab-419d-4e96-8350-8a73594252ff service nova] Acquiring lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-901bd522-2159-47af-8bb7-ea54f9397076 req-ae9c9fab-419d-4e96-8350-8a73594252ff service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-901bd522-2159-47af-8bb7-ea54f9397076 req-ae9c9fab-419d-4e96-8350-8a73594252ff service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:15 user nova-compute[72150]: DEBUG nova.compute.manager [req-901bd522-2159-47af-8bb7-ea54f9397076 req-ae9c9fab-419d-4e96-8350-8a73594252ff service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] No waiting events found dispatching network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:50:15 user nova-compute[72150]: WARNING nova.compute.manager [req-901bd522-2159-47af-8bb7-ea54f9397076 req-ae9c9fab-419d-4e96-8350-8a73594252ff service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received unexpected event network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 for instance with vm_state stopped and task_state None.
Aug 01 18:50:15 user nova-compute[72150]: DEBUG nova.policy [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f84f2871aa24b77b4576b6c573b1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7624d57f4a8641559baaf352eee69eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:50:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Acquiring lock "c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:15 user nova-compute[72150]: DEBUG nova.compute.manager [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:50:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:15 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:50:15 user nova-compute[72150]: INFO nova.compute.claims [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Claim successful on node user
Aug 01 18:50:15 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:50:15 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:50:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.257s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:15 user nova-compute[72150]: DEBUG nova.compute.manager [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG nova.compute.manager [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG nova.network.neutron [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:50:16 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:50:16 user nova-compute[72150]: DEBUG nova.compute.manager [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Successfully created port: 17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG nova.policy [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '487eb09a6aa148c18ba2070972457616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fef6c64f0545ef99e0c2e8059cd267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG nova.compute.manager [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:50:16 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Creating image(s)
Aug 01 18:50:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "/opt/stack/data/nova/instances/c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "/opt/stack/data/nova/instances/c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434/disk 1073741824" returned: 0 in 0.129s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.144s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG nova.network.neutron [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Successfully created port: fce49821-8c97-406d-8740-ab3117c345cc {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Successfully updated port: 17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Acquiring lock "refresh_cache-30f0aa50-65d4-4a5d-a507-f6ee539478ca" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Acquired lock "refresh_cache-30f0aa50-65d4-4a5d-a507-f6ee539478ca" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Cannot resize image /opt/stack/data/nova/instances/c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG nova.objects.instance [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lazy-loading 'migration_context' on Instance uuid c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Ensure instance console log exists: /opt/stack/data/nova/instances/c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG nova.compute.manager [req-8df4f5ea-7bcd-4e53-8c8c-4c459f104673 req-2976e948-0ae8-4955-a215-ee9e1e22b742 service nova] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Received event network-changed-17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG nova.compute.manager [req-8df4f5ea-7bcd-4e53-8c8c-4c459f104673 req-2976e948-0ae8-4955-a215-ee9e1e22b742 service nova] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Refreshing instance network info cache due to event network-changed-17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8df4f5ea-7bcd-4e53-8c8c-4c459f104673 req-2976e948-0ae8-4955-a215-ee9e1e22b742 service nova] Acquiring lock "refresh_cache-30f0aa50-65d4-4a5d-a507-f6ee539478ca" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:50:16 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.network.neutron [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Updating instance_info_cache with network_info: [{"id": "17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8", "address": "fa:16:3e:2c:a1:94", "network": {"id": "e33f734f-1aa9-4c14-8368-133d6d3316a0", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "efb71aa93c5d4aa2b46478912805009b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae0d6b-7e", "ovs_interfaceid": "17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Releasing lock "refresh_cache-30f0aa50-65d4-4a5d-a507-f6ee539478ca" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Instance network_info: |[{"id": "17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8", "address": "fa:16:3e:2c:a1:94", "network": {"id": "e33f734f-1aa9-4c14-8368-133d6d3316a0", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "efb71aa93c5d4aa2b46478912805009b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae0d6b-7e", "ovs_interfaceid": "17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8df4f5ea-7bcd-4e53-8c8c-4c459f104673 req-2976e948-0ae8-4955-a215-ee9e1e22b742 service nova] Acquired lock "refresh_cache-30f0aa50-65d4-4a5d-a507-f6ee539478ca" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.network.neutron [req-8df4f5ea-7bcd-4e53-8c8c-4c459f104673 req-2976e948-0ae8-4955-a215-ee9e1e22b742 service nova] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Refreshing network info cache for port 17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Start _get_guest_xml network_info=[{"id": "17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8", "address": "fa:16:3e:2c:a1:94", "network": {"id": "e33f734f-1aa9-4c14-8368-133d6d3316a0", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "efb71aa93c5d4aa2b46478912805009b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae0d6b-7e", "ovs_interfaceid": "17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:50:17 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:50:17 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:50:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-291465271',display_name='tempest-VolumesNegativeTest-instance-291465271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-291465271',id=46,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7624d57f4a8641559baaf352eee69eeb',ramdisk_id='',reservation_id='r-0sc5txdt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1458395207',owner_user_name='tempest-VolumesNegativeTest-1458395207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:50:14Z,user_data=None,user_id='9f84f2871aa24b77b4576b6c573b1dbe',uuid=30f0aa50-65d4-4a5d-a507-f6ee539478ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8", "address": "fa:16:3e:2c:a1:94", "network": {"id": "e33f734f-1aa9-4c14-8368-133d6d3316a0", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "efb71aa93c5d4aa2b46478912805009b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae0d6b-7e", "ovs_interfaceid": "17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Converting VIF {"id": "17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8", "address": "fa:16:3e:2c:a1:94", "network": {"id": "e33f734f-1aa9-4c14-8368-133d6d3316a0", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "efb71aa93c5d4aa2b46478912805009b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae0d6b-7e", "ovs_interfaceid": "17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a1:94,bridge_name='br-int',has_traffic_filtering=True,id=17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8,network=Network(e33f734f-1aa9-4c14-8368-133d6d3316a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17ae0d6b-7e') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.objects.instance [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Lazy-loading 'pci_devices' on Instance uuid 30f0aa50-65d4-4a5d-a507-f6ee539478ca {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:50:17 user nova-compute[72150]:   <uuid>30f0aa50-65d4-4a5d-a507-f6ee539478ca</uuid>
Aug 01 18:50:17 user nova-compute[72150]:   <name>instance-0000002e</name>
Aug 01 18:50:17 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:50:17 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:50:17 user nova-compute[72150]:   <metadata>
Aug 01 18:50:17 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:50:17 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:50:17 user nova-compute[72150]:       <nova:name>tempest-VolumesNegativeTest-instance-291465271</nova:name>
Aug 01 18:50:17 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:50:17</nova:creationTime>
Aug 01 18:50:17 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:50:17 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:50:17 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:50:17 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:50:17 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:50:17 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:50:17 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:50:17 user nova-compute[72150]:       <nova:owner>
Aug 01 18:50:17 user nova-compute[72150]:         <nova:user uuid="9f84f2871aa24b77b4576b6c573b1dbe">tempest-VolumesNegativeTest-1458395207-project-member</nova:user>
Aug 01 18:50:17 user nova-compute[72150]:         <nova:project uuid="7624d57f4a8641559baaf352eee69eeb">tempest-VolumesNegativeTest-1458395207</nova:project>
Aug 01 18:50:17 user nova-compute[72150]:       </nova:owner>
Aug 01 18:50:17 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:50:17 user nova-compute[72150]:       <nova:ports>
Aug 01 18:50:17 user nova-compute[72150]:         <nova:port uuid="17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8">
Aug 01 18:50:17 user nova-compute[72150]:           <nova:ip type="fixed" address="192.168.233.107" ipVersion="4"/>
Aug 01 18:50:17 user nova-compute[72150]:         </nova:port>
Aug 01 18:50:17 user nova-compute[72150]:       </nova:ports>
Aug 01 18:50:17 user nova-compute[72150]:     </nova:instance>
Aug 01 18:50:17 user nova-compute[72150]:   </metadata>
Aug 01 18:50:17 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:50:17 user nova-compute[72150]:     <system>
Aug 01 18:50:17 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:50:17 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:50:17 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:50:17 user nova-compute[72150]:       <entry name="serial">30f0aa50-65d4-4a5d-a507-f6ee539478ca</entry>
Aug 01 18:50:17 user nova-compute[72150]:       <entry name="uuid">30f0aa50-65d4-4a5d-a507-f6ee539478ca</entry>
Aug 01 18:50:17 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:50:17 user nova-compute[72150]:     </system>
Aug 01 18:50:17 user nova-compute[72150]:   </sysinfo>
Aug 01 18:50:17 user nova-compute[72150]:   <os>
Aug 01 18:50:17 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:50:17 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:50:17 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:50:17 user nova-compute[72150]:   </os>
Aug 01 18:50:17 user nova-compute[72150]:   <features>
Aug 01 18:50:17 user nova-compute[72150]:     <acpi/>
Aug 01 18:50:17 user nova-compute[72150]:     <apic/>
Aug 01 18:50:17 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:50:17 user nova-compute[72150]:   </features>
Aug 01 18:50:17 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:50:17 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:50:17 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:50:17 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:50:17 user nova-compute[72150]:   </clock>
Aug 01 18:50:17 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:50:17 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:50:17 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:50:17 user nova-compute[72150]:   </cpu>
Aug 01 18:50:17 user nova-compute[72150]:   <devices>
Aug 01 18:50:17 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:50:17 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:50:17 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/30f0aa50-65d4-4a5d-a507-f6ee539478ca/disk"/>
Aug 01 18:50:17 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:50:17 user nova-compute[72150]:     </disk>
Aug 01 18:50:17 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:50:17 user nova-compute[72150]:       <mac address="fa:16:3e:2c:a1:94"/>
Aug 01 18:50:17 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:50:17 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:50:17 user nova-compute[72150]:       <target dev="tap17ae0d6b-7e"/>
Aug 01 18:50:17 user nova-compute[72150]:     </interface>
Aug 01 18:50:17 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:50:17 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/30f0aa50-65d4-4a5d-a507-f6ee539478ca/console.log" append="off"/>
Aug 01 18:50:17 user nova-compute[72150]:     </serial>
Aug 01 18:50:17 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:50:17 user nova-compute[72150]:     <video>
Aug 01 18:50:17 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:50:17 user nova-compute[72150]:     </video>
Aug 01 18:50:17 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:50:17 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:50:17 user nova-compute[72150]:     </rng>
Aug 01 18:50:17 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:50:17 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:50:17 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:50:17 user nova-compute[72150]:     </memballoon>
Aug 01 18:50:17 user nova-compute[72150]:   </devices>
Aug 01 18:50:17 user nova-compute[72150]: </domain>
Aug 01 18:50:17 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:50:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-291465271',display_name='tempest-VolumesNegativeTest-instance-291465271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-291465271',id=46,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7624d57f4a8641559baaf352eee69eeb',ramdisk_id='',reservation_id='r-0sc5txdt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1458395207',owner_user_name='tempest-VolumesNegativeTest-1458395207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:50:14Z,user_data=None,user_id='9f84f2871aa24b77b4576b6c573b1dbe',uuid=30f0aa50-65d4-4a5d-a507-f6ee539478ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8", "address": "fa:16:3e:2c:a1:94", "network": {"id": "e33f734f-1aa9-4c14-8368-133d6d3316a0", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "efb71aa93c5d4aa2b46478912805009b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae0d6b-7e", "ovs_interfaceid": "17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Converting VIF {"id": "17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8", "address": "fa:16:3e:2c:a1:94", "network": {"id": "e33f734f-1aa9-4c14-8368-133d6d3316a0", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "efb71aa93c5d4aa2b46478912805009b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae0d6b-7e", "ovs_interfaceid": "17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a1:94,bridge_name='br-int',has_traffic_filtering=True,id=17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8,network=Network(e33f734f-1aa9-4c14-8368-133d6d3316a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17ae0d6b-7e') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG os_vif [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a1:94,bridge_name='br-int',has_traffic_filtering=True,id=17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8,network=Network(e33f734f-1aa9-4c14-8368-133d6d3316a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17ae0d6b-7e') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17ae0d6b-7e, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap17ae0d6b-7e, col_values=(('external_ids', {'iface-id': '17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:a1:94', 'vm-uuid': '30f0aa50-65d4-4a5d-a507-f6ee539478ca'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:17 user nova-compute[72150]: INFO os_vif [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a1:94,bridge_name='br-int',has_traffic_filtering=True,id=17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8,network=Network(e33f734f-1aa9-4c14-8368-133d6d3316a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17ae0d6b-7e')
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] No VIF found with MAC fa:16:3e:2c:a1:94, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.network.neutron [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Successfully updated port: fce49821-8c97-406d-8740-ab3117c345cc {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Acquiring lock "refresh_cache-c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Acquired lock "refresh_cache-c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.network.neutron [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.compute.manager [req-350b8812-a854-4a88-a2f9-4b0f2e0ba9d2 req-133fd5e3-6801-4ac4-8862-095101c5c70c service nova] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Received event network-changed-fce49821-8c97-406d-8740-ab3117c345cc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.compute.manager [req-350b8812-a854-4a88-a2f9-4b0f2e0ba9d2 req-133fd5e3-6801-4ac4-8862-095101c5c70c service nova] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Refreshing instance network info cache due to event network-changed-fce49821-8c97-406d-8740-ab3117c345cc. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-350b8812-a854-4a88-a2f9-4b0f2e0ba9d2 req-133fd5e3-6801-4ac4-8862-095101c5c70c service nova] Acquiring lock "refresh_cache-c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.network.neutron [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.network.neutron [req-8df4f5ea-7bcd-4e53-8c8c-4c459f104673 req-2976e948-0ae8-4955-a215-ee9e1e22b742 service nova] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Updated VIF entry in instance network info cache for port 17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.network.neutron [req-8df4f5ea-7bcd-4e53-8c8c-4c459f104673 req-2976e948-0ae8-4955-a215-ee9e1e22b742 service nova] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Updating instance_info_cache with network_info: [{"id": "17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8", "address": "fa:16:3e:2c:a1:94", "network": {"id": "e33f734f-1aa9-4c14-8368-133d6d3316a0", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "efb71aa93c5d4aa2b46478912805009b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae0d6b-7e", "ovs_interfaceid": "17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-8df4f5ea-7bcd-4e53-8c8c-4c459f104673 req-2976e948-0ae8-4955-a215-ee9e1e22b742 service nova] Releasing lock "refresh_cache-30f0aa50-65d4-4a5d-a507-f6ee539478ca" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.network.neutron [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Updating instance_info_cache with network_info: [{"id": "fce49821-8c97-406d-8740-ab3117c345cc", "address": "fa:16:3e:d3:b1:46", "network": {"id": "2468551a-06dc-44c4-82fe-7ed843e90920", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1864190400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9fef6c64f0545ef99e0c2e8059cd267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce49821-8c", "ovs_interfaceid": "fce49821-8c97-406d-8740-ab3117c345cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Releasing lock "refresh_cache-c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.compute.manager [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Instance network_info: |[{"id": "fce49821-8c97-406d-8740-ab3117c345cc", "address": "fa:16:3e:d3:b1:46", "network": {"id": "2468551a-06dc-44c4-82fe-7ed843e90920", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1864190400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9fef6c64f0545ef99e0c2e8059cd267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce49821-8c", "ovs_interfaceid": "fce49821-8c97-406d-8740-ab3117c345cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-350b8812-a854-4a88-a2f9-4b0f2e0ba9d2 req-133fd5e3-6801-4ac4-8862-095101c5c70c service nova] Acquired lock "refresh_cache-c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.network.neutron [req-350b8812-a854-4a88-a2f9-4b0f2e0ba9d2 req-133fd5e3-6801-4ac4-8862-095101c5c70c service nova] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Refreshing network info cache for port fce49821-8c97-406d-8740-ab3117c345cc {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Start _get_guest_xml network_info=[{"id": "fce49821-8c97-406d-8740-ab3117c345cc", "address": "fa:16:3e:d3:b1:46", "network": {"id": "2468551a-06dc-44c4-82fe-7ed843e90920", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1864190400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9fef6c64f0545ef99e0c2e8059cd267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce49821-8c", "ovs_interfaceid": "fce49821-8c97-406d-8740-ab3117c345cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:50:17 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:50:17 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:50:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1251285739',display_name='tempest-VolumesActionsTest-instance-1251285739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1251285739',id=47,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9fef6c64f0545ef99e0c2e8059cd267',ramdisk_id='',reservation_id='r-i1banwws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1283477154',owner_user_name='tempest-VolumesActionsTest-1283477154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:50:16Z,user_data=None,user_id='487eb09a6aa148c18ba2070972457616',uuid=c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fce49821-8c97-406d-8740-ab3117c345cc", "address": "fa:16:3e:d3:b1:46", "network": {"id": "2468551a-06dc-44c4-82fe-7ed843e90920", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1864190400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9fef6c64f0545ef99e0c2e8059cd267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce49821-8c", "ovs_interfaceid": "fce49821-8c97-406d-8740-ab3117c345cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Converting VIF {"id": "fce49821-8c97-406d-8740-ab3117c345cc", "address": "fa:16:3e:d3:b1:46", "network": {"id": "2468551a-06dc-44c4-82fe-7ed843e90920", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1864190400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9fef6c64f0545ef99e0c2e8059cd267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce49821-8c", "ovs_interfaceid": "fce49821-8c97-406d-8740-ab3117c345cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:46,bridge_name='br-int',has_traffic_filtering=True,id=fce49821-8c97-406d-8740-ab3117c345cc,network=Network(2468551a-06dc-44c4-82fe-7ed843e90920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce49821-8c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.objects.instance [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lazy-loading 'pci_devices' on Instance uuid c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:50:17 user nova-compute[72150]:   <uuid>c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434</uuid>
Aug 01 18:50:17 user nova-compute[72150]:   <name>instance-0000002f</name>
Aug 01 18:50:17 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:50:17 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:50:17 user nova-compute[72150]:   <metadata>
Aug 01 18:50:17 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:50:17 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:50:17 user nova-compute[72150]:       <nova:name>tempest-VolumesActionsTest-instance-1251285739</nova:name>
Aug 01 18:50:17 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:50:17</nova:creationTime>
Aug 01 18:50:17 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:50:17 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:50:17 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:50:17 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:50:17 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:50:17 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:50:17 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:50:17 user nova-compute[72150]:       <nova:owner>
Aug 01 18:50:17 user nova-compute[72150]:         <nova:user uuid="487eb09a6aa148c18ba2070972457616">tempest-VolumesActionsTest-1283477154-project-member</nova:user>
Aug 01 18:50:17 user nova-compute[72150]:         <nova:project uuid="b9fef6c64f0545ef99e0c2e8059cd267">tempest-VolumesActionsTest-1283477154</nova:project>
Aug 01 18:50:17 user nova-compute[72150]:       </nova:owner>
Aug 01 18:50:17 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:50:17 user nova-compute[72150]:       <nova:ports>
Aug 01 18:50:17 user nova-compute[72150]:         <nova:port uuid="fce49821-8c97-406d-8740-ab3117c345cc">
Aug 01 18:50:17 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 18:50:17 user nova-compute[72150]:         </nova:port>
Aug 01 18:50:17 user nova-compute[72150]:       </nova:ports>
Aug 01 18:50:17 user nova-compute[72150]:     </nova:instance>
Aug 01 18:50:17 user nova-compute[72150]:   </metadata>
Aug 01 18:50:17 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:50:17 user nova-compute[72150]:     <system>
Aug 01 18:50:17 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:50:17 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:50:17 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:50:17 user nova-compute[72150]:       <entry name="serial">c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434</entry>
Aug 01 18:50:17 user nova-compute[72150]:       <entry name="uuid">c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434</entry>
Aug 01 18:50:17 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:50:17 user nova-compute[72150]:     </system>
Aug 01 18:50:17 user nova-compute[72150]:   </sysinfo>
Aug 01 18:50:17 user nova-compute[72150]:   <os>
Aug 01 18:50:17 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:50:17 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:50:17 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:50:17 user nova-compute[72150]:   </os>
Aug 01 18:50:17 user nova-compute[72150]:   <features>
Aug 01 18:50:17 user nova-compute[72150]:     <acpi/>
Aug 01 18:50:17 user nova-compute[72150]:     <apic/>
Aug 01 18:50:17 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:50:17 user nova-compute[72150]:   </features>
Aug 01 18:50:17 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:50:17 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:50:17 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:50:17 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:50:17 user nova-compute[72150]:   </clock>
Aug 01 18:50:17 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:50:17 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:50:17 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:50:17 user nova-compute[72150]:   </cpu>
Aug 01 18:50:17 user nova-compute[72150]:   <devices>
Aug 01 18:50:17 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:50:17 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:50:17 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434/disk"/>
Aug 01 18:50:17 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:50:17 user nova-compute[72150]:     </disk>
Aug 01 18:50:17 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:50:17 user nova-compute[72150]:       <mac address="fa:16:3e:d3:b1:46"/>
Aug 01 18:50:17 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:50:17 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:50:17 user nova-compute[72150]:       <target dev="tapfce49821-8c"/>
Aug 01 18:50:17 user nova-compute[72150]:     </interface>
Aug 01 18:50:17 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:50:17 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434/console.log" append="off"/>
Aug 01 18:50:17 user nova-compute[72150]:     </serial>
Aug 01 18:50:17 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:50:17 user nova-compute[72150]:     <video>
Aug 01 18:50:17 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:50:17 user nova-compute[72150]:     </video>
Aug 01 18:50:17 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:50:17 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:50:17 user nova-compute[72150]:     </rng>
Aug 01 18:50:17 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:50:17 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:50:17 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:50:17 user nova-compute[72150]:     </memballoon>
Aug 01 18:50:17 user nova-compute[72150]:   </devices>
Aug 01 18:50:17 user nova-compute[72150]: </domain>
Aug 01 18:50:17 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:50:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1251285739',display_name='tempest-VolumesActionsTest-instance-1251285739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1251285739',id=47,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9fef6c64f0545ef99e0c2e8059cd267',ramdisk_id='',reservation_id='r-i1banwws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1283477154',owner_user_name='tempest-VolumesActionsTest-1283477154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:50:16Z,user_data=None,user_id='487eb09a6aa148c18ba2070972457616',uuid=c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fce49821-8c97-406d-8740-ab3117c345cc", "address": "fa:16:3e:d3:b1:46", "network": {"id": "2468551a-06dc-44c4-82fe-7ed843e90920", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1864190400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9fef6c64f0545ef99e0c2e8059cd267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce49821-8c", "ovs_interfaceid": "fce49821-8c97-406d-8740-ab3117c345cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Converting VIF {"id": "fce49821-8c97-406d-8740-ab3117c345cc", "address": "fa:16:3e:d3:b1:46", "network": {"id": "2468551a-06dc-44c4-82fe-7ed843e90920", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1864190400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9fef6c64f0545ef99e0c2e8059cd267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce49821-8c", "ovs_interfaceid": "fce49821-8c97-406d-8740-ab3117c345cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:46,bridge_name='br-int',has_traffic_filtering=True,id=fce49821-8c97-406d-8740-ab3117c345cc,network=Network(2468551a-06dc-44c4-82fe-7ed843e90920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce49821-8c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG os_vif [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:46,bridge_name='br-int',has_traffic_filtering=True,id=fce49821-8c97-406d-8740-ab3117c345cc,network=Network(2468551a-06dc-44c4-82fe-7ed843e90920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce49821-8c') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfce49821-8c, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfce49821-8c, col_values=(('external_ids', {'iface-id': 'fce49821-8c97-406d-8740-ab3117c345cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:b1:46', 'vm-uuid': 'c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:50:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:18 user nova-compute[72150]: INFO os_vif [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:46,bridge_name='br-int',has_traffic_filtering=True,id=fce49821-8c97-406d-8740-ab3117c345cc,network=Network(2468551a-06dc-44c4-82fe-7ed843e90920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce49821-8c')
Aug 01 18:50:18 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:50:18 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] No VIF found with MAC fa:16:3e:d3:b1:46, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:50:18 user nova-compute[72150]: DEBUG nova.network.neutron [req-350b8812-a854-4a88-a2f9-4b0f2e0ba9d2 req-133fd5e3-6801-4ac4-8862-095101c5c70c service nova] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Updated VIF entry in instance network info cache for port fce49821-8c97-406d-8740-ab3117c345cc. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:50:18 user nova-compute[72150]: DEBUG nova.network.neutron [req-350b8812-a854-4a88-a2f9-4b0f2e0ba9d2 req-133fd5e3-6801-4ac4-8862-095101c5c70c service nova] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Updating instance_info_cache with network_info: [{"id": "fce49821-8c97-406d-8740-ab3117c345cc", "address": "fa:16:3e:d3:b1:46", "network": {"id": "2468551a-06dc-44c4-82fe-7ed843e90920", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1864190400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9fef6c64f0545ef99e0c2e8059cd267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce49821-8c", "ovs_interfaceid": "fce49821-8c97-406d-8740-ab3117c345cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:50:18 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-350b8812-a854-4a88-a2f9-4b0f2e0ba9d2 req-133fd5e3-6801-4ac4-8862-095101c5c70c service nova] Releasing lock "refresh_cache-c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:50:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:20 user nova-compute[72150]: DEBUG nova.compute.manager [req-89a852b0-fc92-4ab5-98c7-16c16e83b09b req-e4c8954f-8c5e-4f64-8d89-2e237d37e88f service nova] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Received event network-vif-plugged-fce49821-8c97-406d-8740-ab3117c345cc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:50:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-89a852b0-fc92-4ab5-98c7-16c16e83b09b req-e4c8954f-8c5e-4f64-8d89-2e237d37e88f service nova] Acquiring lock "c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-89a852b0-fc92-4ab5-98c7-16c16e83b09b req-e4c8954f-8c5e-4f64-8d89-2e237d37e88f service nova] Lock "c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-89a852b0-fc92-4ab5-98c7-16c16e83b09b req-e4c8954f-8c5e-4f64-8d89-2e237d37e88f service nova] Lock "c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:20 user nova-compute[72150]: DEBUG nova.compute.manager [req-89a852b0-fc92-4ab5-98c7-16c16e83b09b req-e4c8954f-8c5e-4f64-8d89-2e237d37e88f service nova] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] No waiting events found dispatching network-vif-plugged-fce49821-8c97-406d-8740-ab3117c345cc {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:50:20 user nova-compute[72150]: WARNING nova.compute.manager [req-89a852b0-fc92-4ab5-98c7-16c16e83b09b req-e4c8954f-8c5e-4f64-8d89-2e237d37e88f service nova] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Received unexpected event network-vif-plugged-fce49821-8c97-406d-8740-ab3117c345cc for instance with vm_state building and task_state spawning.
Aug 01 18:50:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:20 user nova-compute[72150]: DEBUG nova.compute.manager [req-ccacae5c-c7e6-4768-a3d3-3843cde63112 req-0461357d-c275-47ee-bfa4-ef450dd42963 service nova] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Received event network-vif-plugged-17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:50:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ccacae5c-c7e6-4768-a3d3-3843cde63112 req-0461357d-c275-47ee-bfa4-ef450dd42963 service nova] Acquiring lock "30f0aa50-65d4-4a5d-a507-f6ee539478ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ccacae5c-c7e6-4768-a3d3-3843cde63112 req-0461357d-c275-47ee-bfa4-ef450dd42963 service nova] Lock "30f0aa50-65d4-4a5d-a507-f6ee539478ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ccacae5c-c7e6-4768-a3d3-3843cde63112 req-0461357d-c275-47ee-bfa4-ef450dd42963 service nova] Lock "30f0aa50-65d4-4a5d-a507-f6ee539478ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:20 user nova-compute[72150]: DEBUG nova.compute.manager [req-ccacae5c-c7e6-4768-a3d3-3843cde63112 req-0461357d-c275-47ee-bfa4-ef450dd42963 service nova] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] No waiting events found dispatching network-vif-plugged-17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:50:20 user nova-compute[72150]: WARNING nova.compute.manager [req-ccacae5c-c7e6-4768-a3d3-3843cde63112 req-0461357d-c275-47ee-bfa4-ef450dd42963 service nova] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Received unexpected event network-vif-plugged-17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8 for instance with vm_state building and task_state spawning.
Aug 01 18:50:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.compute.manager [req-fa43f232-6740-4a6e-83f8-d7a9cdaf41b3 req-ab95eddd-62aa-493d-8f3c-a8686b58168d service nova] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Received event network-vif-plugged-fce49821-8c97-406d-8740-ab3117c345cc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fa43f232-6740-4a6e-83f8-d7a9cdaf41b3 req-ab95eddd-62aa-493d-8f3c-a8686b58168d service nova] Acquiring lock "c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fa43f232-6740-4a6e-83f8-d7a9cdaf41b3 req-ab95eddd-62aa-493d-8f3c-a8686b58168d service nova] Lock "c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fa43f232-6740-4a6e-83f8-d7a9cdaf41b3 req-ab95eddd-62aa-493d-8f3c-a8686b58168d service nova] Lock "c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.compute.manager [req-fa43f232-6740-4a6e-83f8-d7a9cdaf41b3 req-ab95eddd-62aa-493d-8f3c-a8686b58168d service nova] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] No waiting events found dispatching network-vif-plugged-fce49821-8c97-406d-8740-ab3117c345cc {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:50:22 user nova-compute[72150]: WARNING nova.compute.manager [req-fa43f232-6740-4a6e-83f8-d7a9cdaf41b3 req-ab95eddd-62aa-493d-8f3c-a8686b58168d service nova] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Received unexpected event network-vif-plugged-fce49821-8c97-406d-8740-ab3117c345cc for instance with vm_state building and task_state spawning.
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.compute.manager [req-fc4b0cda-7607-4db7-b311-1826bc0b706d req-80dedb42-48d5-4f6f-ba5f-68a5765e86b7 service nova] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Received event network-vif-plugged-17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fc4b0cda-7607-4db7-b311-1826bc0b706d req-80dedb42-48d5-4f6f-ba5f-68a5765e86b7 service nova] Acquiring lock "30f0aa50-65d4-4a5d-a507-f6ee539478ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fc4b0cda-7607-4db7-b311-1826bc0b706d req-80dedb42-48d5-4f6f-ba5f-68a5765e86b7 service nova] Lock "30f0aa50-65d4-4a5d-a507-f6ee539478ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-fc4b0cda-7607-4db7-b311-1826bc0b706d req-80dedb42-48d5-4f6f-ba5f-68a5765e86b7 service nova] Lock "30f0aa50-65d4-4a5d-a507-f6ee539478ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.compute.manager [req-fc4b0cda-7607-4db7-b311-1826bc0b706d req-80dedb42-48d5-4f6f-ba5f-68a5765e86b7 service nova] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] No waiting events found dispatching network-vif-plugged-17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:50:22 user nova-compute[72150]: WARNING nova.compute.manager [req-fc4b0cda-7607-4db7-b311-1826bc0b706d req-80dedb42-48d5-4f6f-ba5f-68a5765e86b7 service nova] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Received unexpected event network-vif-plugged-17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8 for instance with vm_state building and task_state spawning.
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915822.4654508, 30f0aa50-65d4-4a5d-a507-f6ee539478ca => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:50:22 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] VM Resumed (Lifecycle Event)
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:50:22 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Instance spawned successfully.
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.compute.manager [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:50:22 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915822.4669666, 30f0aa50-65d4-4a5d-a507-f6ee539478ca => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:50:22 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] VM Started (Lifecycle Event)
Aug 01 18:50:22 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Instance spawned successfully.
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:50:22 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915822.4983222, c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:50:22 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] VM Resumed (Lifecycle Event)
Aug 01 18:50:22 user nova-compute[72150]: INFO nova.compute.manager [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Took 8.33 seconds to spawn the instance on the hypervisor.
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.compute.manager [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:50:22 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915822.4998832, c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:50:22 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] VM Started (Lifecycle Event)
Aug 01 18:50:22 user nova-compute[72150]: INFO nova.compute.manager [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Took 6.48 seconds to spawn the instance on the hypervisor.
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.compute.manager [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:50:22 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:50:22 user nova-compute[72150]: INFO nova.compute.manager [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Took 8.92 seconds to build instance.
Aug 01 18:50:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d70faf70-a4e0-4c14-aaf1-d600fa0e18d9 tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Lock "30f0aa50-65d4-4a5d-a507-f6ee539478ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:22 user nova-compute[72150]: INFO nova.compute.manager [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Took 7.06 seconds to build instance.
Aug 01 18:50:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-34433d34-8ea3-4788-bf91-ec83c4f8867b tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.148s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:28 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915813.399611, e6831e19-1dc8-470a-8151-9896d8fea013 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:50:28 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] VM Stopped (Lifecycle Event)
Aug 01 18:50:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-27cb26ac-0645-47e0-b7bb-4521807c037c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:50:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-27cb26ac-0645-47e0-b7bb-4521807c037c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:50:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:50:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:50:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:50:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:50:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:50:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:42 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:50:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:48 user nova-compute[72150]: DEBUG nova.compute.manager [None req-82507a21-5890-47fe-92e5-cfd9127b627a tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:50:48 user nova-compute[72150]: INFO nova.compute.manager [None req-82507a21-5890-47fe-92e5-cfd9127b627a tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] instance snapshotting
Aug 01 18:50:48 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-82507a21-5890-47fe-92e5-cfd9127b627a tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Beginning live snapshot process
Aug 01 18:50:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-82507a21-5890-47fe-92e5-cfd9127b627a tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json -f qcow2 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-82507a21-5890-47fe-92e5-cfd9127b627a tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-82507a21-5890-47fe-92e5-cfd9127b627a tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json -f qcow2 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-82507a21-5890-47fe-92e5-cfd9127b627a tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-82507a21-5890-47fe-92e5-cfd9127b627a tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-82507a21-5890-47fe-92e5-cfd9127b627a tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-82507a21-5890-47fe-92e5-cfd9127b627a tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9hoisfv9/15b643e9c5d6411389438d9865d8a4be.delta 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-82507a21-5890-47fe-92e5-cfd9127b627a tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9hoisfv9/15b643e9c5d6411389438d9865d8a4be.delta 1073741824" returned: 0 in 0.057s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:48 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-82507a21-5890-47fe-92e5-cfd9127b627a tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 18:50:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-82507a21-5890-47fe-92e5-cfd9127b627a tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:50:49 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:50:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-82507a21-5890-47fe-92e5-cfd9127b627a tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72150) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 18:50:50 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-82507a21-5890-47fe-92e5-cfd9127b627a tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 18:50:50 user nova-compute[72150]: DEBUG nova.privsep.utils [None req-82507a21-5890-47fe-92e5-cfd9127b627a tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72150) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 18:50:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-82507a21-5890-47fe-92e5-cfd9127b627a tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9hoisfv9/15b643e9c5d6411389438d9865d8a4be.delta /opt/stack/data/nova/instances/snapshots/tmp9hoisfv9/15b643e9c5d6411389438d9865d8a4be {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-82507a21-5890-47fe-92e5-cfd9127b627a tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9hoisfv9/15b643e9c5d6411389438d9865d8a4be.delta /opt/stack/data/nova/instances/snapshots/tmp9hoisfv9/15b643e9c5d6411389438d9865d8a4be" returned: 0 in 0.502s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:50 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-82507a21-5890-47fe-92e5-cfd9127b627a tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Snapshot extracted, beginning image upload
Aug 01 18:50:50 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:50:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:50:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f0aa50-65d4-4a5d-a507-f6ee539478ca/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f0aa50-65d4-4a5d-a507-f6ee539478ca/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f0aa50-65d4-4a5d-a507-f6ee539478ca/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f0aa50-65d4-4a5d-a507-f6ee539478ca/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:52 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:50:52 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:50:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8386MB free_disk=25.309940338134766GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:50:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance e6831e19-1dc8-470a-8151-9896d8fea013 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:50:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 760ec148-92e3-49a3-93e6-5343f6e6b8c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:50:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 30f0aa50-65d4-4a5d-a507-f6ee539478ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:50:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:50:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:50:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:50:52 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:50:52 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:50:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:50:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:53 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-82507a21-5890-47fe-92e5-cfd9127b627a tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Snapshot image upload complete
Aug 01 18:50:53 user nova-compute[72150]: INFO nova.compute.manager [None req-82507a21-5890-47fe-92e5-cfd9127b627a tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Took 4.82 seconds to snapshot the instance on the hypervisor.
Aug 01 18:50:54 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:50:54 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:50:54 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:50:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "635d02d7-65ea-4848-a7d4-29a78b67b60a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "635d02d7-65ea-4848-a7d4-29a78b67b60a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:55 user nova-compute[72150]: DEBUG nova.compute.manager [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:50:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:55 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:50:55 user nova-compute[72150]: INFO nova.compute.claims [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Claim successful on node user
Aug 01 18:50:55 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:50:55 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:50:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:55 user nova-compute[72150]: DEBUG nova.compute.manager [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:50:55 user nova-compute[72150]: DEBUG nova.compute.manager [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:50:55 user nova-compute[72150]: DEBUG nova.network.neutron [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:50:55 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:50:55 user nova-compute[72150]: DEBUG nova.compute.manager [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:50:56 user nova-compute[72150]: DEBUG nova.policy [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e18c2b7f1714542bb4f14be70c46194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fca32199d5c458ab4bd52d15c27509b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:50:56 user nova-compute[72150]: DEBUG nova.compute.manager [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:50:56 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:50:56 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Creating image(s)
Aug 01 18:50:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "/opt/stack/data/nova/instances/635d02d7-65ea-4848-a7d4-29a78b67b60a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "/opt/stack/data/nova/instances/635d02d7-65ea-4848-a7d4-29a78b67b60a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "/opt/stack/data/nova/instances/635d02d7-65ea-4848-a7d4-29a78b67b60a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "2fe7780b7a6600f31bd755b49234b12368c632ac" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "2fe7780b7a6600f31bd755b49234b12368c632ac" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2fe7780b7a6600f31bd755b49234b12368c632ac.part --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:56 user nova-compute[72150]: DEBUG nova.network.neutron [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Successfully created port: aa9f3b11-3b09-4025-8355-7971304b048b {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:50:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2fe7780b7a6600f31bd755b49234b12368c632ac.part --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:56 user nova-compute[72150]: DEBUG nova.virt.images [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] 15b8ff12-3594-42ce-a911-1ddd96b1db13 was qcow2, converting to raw {{(pid=72150) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 18:50:56 user nova-compute[72150]: DEBUG nova.privsep.utils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72150) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 18:50:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2fe7780b7a6600f31bd755b49234b12368c632ac.part /opt/stack/data/nova/instances/_base/2fe7780b7a6600f31bd755b49234b12368c632ac.converted {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2fe7780b7a6600f31bd755b49234b12368c632ac.part /opt/stack/data/nova/instances/_base/2fe7780b7a6600f31bd755b49234b12368c632ac.converted" returned: 0 in 0.494s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2fe7780b7a6600f31bd755b49234b12368c632ac.converted --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2fe7780b7a6600f31bd755b49234b12368c632ac.converted --force-share --output=json" returned: 0 in 0.152s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "2fe7780b7a6600f31bd755b49234b12368c632ac" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.554s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2fe7780b7a6600f31bd755b49234b12368c632ac --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG nova.network.neutron [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Successfully updated port: aa9f3b11-3b09-4025-8355-7971304b048b {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-b9951fd2-009c-4b79-a722-4ba5ff3a57fe req-71fe993b-1e13-4573-81f0-e98570e4aeee service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Received event network-changed-aa9f3b11-3b09-4025-8355-7971304b048b {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-b9951fd2-009c-4b79-a722-4ba5ff3a57fe req-71fe993b-1e13-4573-81f0-e98570e4aeee service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Refreshing instance network info cache due to event network-changed-aa9f3b11-3b09-4025-8355-7971304b048b. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b9951fd2-009c-4b79-a722-4ba5ff3a57fe req-71fe993b-1e13-4573-81f0-e98570e4aeee service nova] Acquiring lock "refresh_cache-635d02d7-65ea-4848-a7d4-29a78b67b60a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b9951fd2-009c-4b79-a722-4ba5ff3a57fe req-71fe993b-1e13-4573-81f0-e98570e4aeee service nova] Acquired lock "refresh_cache-635d02d7-65ea-4848-a7d4-29a78b67b60a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG nova.network.neutron [req-b9951fd2-009c-4b79-a722-4ba5ff3a57fe req-71fe993b-1e13-4573-81f0-e98570e4aeee service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Refreshing network info cache for port aa9f3b11-3b09-4025-8355-7971304b048b {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "refresh_cache-635d02d7-65ea-4848-a7d4-29a78b67b60a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2fe7780b7a6600f31bd755b49234b12368c632ac --force-share --output=json" returned: 0 in 0.144s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "2fe7780b7a6600f31bd755b49234b12368c632ac" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "2fe7780b7a6600f31bd755b49234b12368c632ac" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2fe7780b7a6600f31bd755b49234b12368c632ac --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG nova.network.neutron [req-b9951fd2-009c-4b79-a722-4ba5ff3a57fe req-71fe993b-1e13-4573-81f0-e98570e4aeee service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2fe7780b7a6600f31bd755b49234b12368c632ac --force-share --output=json" returned: 0 in 0.141s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2fe7780b7a6600f31bd755b49234b12368c632ac,backing_fmt=raw /opt/stack/data/nova/instances/635d02d7-65ea-4848-a7d4-29a78b67b60a/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2fe7780b7a6600f31bd755b49234b12368c632ac,backing_fmt=raw /opt/stack/data/nova/instances/635d02d7-65ea-4848-a7d4-29a78b67b60a/disk 1073741824" returned: 0 in 0.049s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "2fe7780b7a6600f31bd755b49234b12368c632ac" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2fe7780b7a6600f31bd755b49234b12368c632ac --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.network.neutron [req-b9951fd2-009c-4b79-a722-4ba5ff3a57fe req-71fe993b-1e13-4573-81f0-e98570e4aeee service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b9951fd2-009c-4b79-a722-4ba5ff3a57fe req-71fe993b-1e13-4573-81f0-e98570e4aeee service nova] Releasing lock "refresh_cache-635d02d7-65ea-4848-a7d4-29a78b67b60a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquired lock "refresh_cache-635d02d7-65ea-4848-a7d4-29a78b67b60a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.network.neutron [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2fe7780b7a6600f31bd755b49234b12368c632ac --force-share --output=json" returned: 0 in 0.142s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.objects.instance [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lazy-loading 'migration_context' on Instance uuid 635d02d7-65ea-4848-a7d4-29a78b67b60a {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Ensure instance console log exists: /opt/stack/data/nova/instances/635d02d7-65ea-4848-a7d4-29a78b67b60a/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.network.neutron [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.network.neutron [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Updating instance_info_cache with network_info: [{"id": "aa9f3b11-3b09-4025-8355-7971304b048b", "address": "fa:16:3e:c4:29:f7", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa9f3b11-3b", "ovs_interfaceid": "aa9f3b11-3b09-4025-8355-7971304b048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Releasing lock "refresh_cache-635d02d7-65ea-4848-a7d4-29a78b67b60a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Instance network_info: |[{"id": "aa9f3b11-3b09-4025-8355-7971304b048b", "address": "fa:16:3e:c4:29:f7", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa9f3b11-3b", "ovs_interfaceid": "aa9f3b11-3b09-4025-8355-7971304b048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Start _get_guest_xml network_info=[{"id": "aa9f3b11-3b09-4025-8355-7971304b048b", "address": "fa:16:3e:c4:29:f7", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa9f3b11-3b", "ovs_interfaceid": "aa9f3b11-3b09-4025-8355-7971304b048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e96b0e93c1ccd6e1db85a76fd3745cca',container_format='bare',created_at=2023-08-01T18:50:48Z,direct_url=<?>,disk_format='qcow2',id=15b8ff12-3594-42ce-a911-1ddd96b1db13,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-225253177',owner='4fca32199d5c458ab4bd52d15c27509b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T18:50:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '15b8ff12-3594-42ce-a911-1ddd96b1db13'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:50:58 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:50:58 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e96b0e93c1ccd6e1db85a76fd3745cca',container_format='bare',created_at=2023-08-01T18:50:48Z,direct_url=<?>,disk_format='qcow2',id=15b8ff12-3594-42ce-a911-1ddd96b1db13,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-225253177',owner='4fca32199d5c458ab4bd52d15c27509b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T18:50:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-156124977',display_name='tempest-TestStampPattern-server-156124977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-156124977',id=48,image_ref='15b8ff12-3594-42ce-a911-1ddd96b1db13',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZy2wVCHd7vEtiOS/HYac+tq78O0CA/dgbnZhwl2N6J70l2eXFgL43fhOucY/uXMm4OefFrQ4HuyqEQUOsD22aJwn95LDZVUWnVjJnV8RCkRBcjCwyi2bzx0ZZbSdwYQA==',key_name='tempest-TestStampPattern-1877833599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fca32199d5c458ab4bd52d15c27509b',ramdisk_id='',reservation_id='r-8rx5acke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='760ec148-92e3-49a3-93e6-5343f6e6b8c0',image_min_disk='1',image_min_ram='0',image_owner_id='4fca32199d5c458ab4bd52d15c27509b',image_owner_project_name='tempest-TestStampPattern-958709342',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-958709342-project-member',image_user_id='1e18c2b7f1714542bb4f14be70c46194',network_allocated='True',owner_project_name='tempest-TestStampPattern-958709342',owner_user_name='tempest-TestStampPattern-958709342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:50:56Z,user_data=None,user_id='1e18c2b7f1714542bb4f14be70c46194',uuid=635d02d7-65ea-4848-a7d4-29a78b67b60a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa9f3b11-3b09-4025-8355-7971304b048b", "address": "fa:16:3e:c4:29:f7", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa9f3b11-3b", "ovs_interfaceid": "aa9f3b11-3b09-4025-8355-7971304b048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Converting VIF {"id": "aa9f3b11-3b09-4025-8355-7971304b048b", "address": "fa:16:3e:c4:29:f7", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa9f3b11-3b", "ovs_interfaceid": "aa9f3b11-3b09-4025-8355-7971304b048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:29:f7,bridge_name='br-int',has_traffic_filtering=True,id=aa9f3b11-3b09-4025-8355-7971304b048b,network=Network(662f2fa8-b862-434c-bf1f-1804ac5e04ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa9f3b11-3b') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.objects.instance [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lazy-loading 'pci_devices' on Instance uuid 635d02d7-65ea-4848-a7d4-29a78b67b60a {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:50:58 user nova-compute[72150]:   <uuid>635d02d7-65ea-4848-a7d4-29a78b67b60a</uuid>
Aug 01 18:50:58 user nova-compute[72150]:   <name>instance-00000030</name>
Aug 01 18:50:58 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:50:58 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:50:58 user nova-compute[72150]:   <metadata>
Aug 01 18:50:58 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:50:58 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:50:58 user nova-compute[72150]:       <nova:name>tempest-TestStampPattern-server-156124977</nova:name>
Aug 01 18:50:58 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:50:58</nova:creationTime>
Aug 01 18:50:58 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:50:58 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:50:58 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:50:58 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:50:58 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:50:58 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:50:58 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:50:58 user nova-compute[72150]:       <nova:owner>
Aug 01 18:50:58 user nova-compute[72150]:         <nova:user uuid="1e18c2b7f1714542bb4f14be70c46194">tempest-TestStampPattern-958709342-project-member</nova:user>
Aug 01 18:50:58 user nova-compute[72150]:         <nova:project uuid="4fca32199d5c458ab4bd52d15c27509b">tempest-TestStampPattern-958709342</nova:project>
Aug 01 18:50:58 user nova-compute[72150]:       </nova:owner>
Aug 01 18:50:58 user nova-compute[72150]:       <nova:root type="image" uuid="15b8ff12-3594-42ce-a911-1ddd96b1db13"/>
Aug 01 18:50:58 user nova-compute[72150]:       <nova:ports>
Aug 01 18:50:58 user nova-compute[72150]:         <nova:port uuid="aa9f3b11-3b09-4025-8355-7971304b048b">
Aug 01 18:50:58 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 18:50:58 user nova-compute[72150]:         </nova:port>
Aug 01 18:50:58 user nova-compute[72150]:       </nova:ports>
Aug 01 18:50:58 user nova-compute[72150]:     </nova:instance>
Aug 01 18:50:58 user nova-compute[72150]:   </metadata>
Aug 01 18:50:58 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:50:58 user nova-compute[72150]:     <system>
Aug 01 18:50:58 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:50:58 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:50:58 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:50:58 user nova-compute[72150]:       <entry name="serial">635d02d7-65ea-4848-a7d4-29a78b67b60a</entry>
Aug 01 18:50:58 user nova-compute[72150]:       <entry name="uuid">635d02d7-65ea-4848-a7d4-29a78b67b60a</entry>
Aug 01 18:50:58 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:50:58 user nova-compute[72150]:     </system>
Aug 01 18:50:58 user nova-compute[72150]:   </sysinfo>
Aug 01 18:50:58 user nova-compute[72150]:   <os>
Aug 01 18:50:58 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:50:58 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:50:58 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:50:58 user nova-compute[72150]:   </os>
Aug 01 18:50:58 user nova-compute[72150]:   <features>
Aug 01 18:50:58 user nova-compute[72150]:     <acpi/>
Aug 01 18:50:58 user nova-compute[72150]:     <apic/>
Aug 01 18:50:58 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:50:58 user nova-compute[72150]:   </features>
Aug 01 18:50:58 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:50:58 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:50:58 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:50:58 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:50:58 user nova-compute[72150]:   </clock>
Aug 01 18:50:58 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:50:58 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:50:58 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:50:58 user nova-compute[72150]:   </cpu>
Aug 01 18:50:58 user nova-compute[72150]:   <devices>
Aug 01 18:50:58 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:50:58 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:50:58 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/635d02d7-65ea-4848-a7d4-29a78b67b60a/disk"/>
Aug 01 18:50:58 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:50:58 user nova-compute[72150]:     </disk>
Aug 01 18:50:58 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:50:58 user nova-compute[72150]:       <mac address="fa:16:3e:c4:29:f7"/>
Aug 01 18:50:58 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:50:58 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:50:58 user nova-compute[72150]:       <target dev="tapaa9f3b11-3b"/>
Aug 01 18:50:58 user nova-compute[72150]:     </interface>
Aug 01 18:50:58 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:50:58 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/635d02d7-65ea-4848-a7d4-29a78b67b60a/console.log" append="off"/>
Aug 01 18:50:58 user nova-compute[72150]:     </serial>
Aug 01 18:50:58 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:50:58 user nova-compute[72150]:     <video>
Aug 01 18:50:58 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:50:58 user nova-compute[72150]:     </video>
Aug 01 18:50:58 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:50:58 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:50:58 user nova-compute[72150]:     </rng>
Aug 01 18:50:58 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:50:58 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:50:58 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:50:58 user nova-compute[72150]:     </memballoon>
Aug 01 18:50:58 user nova-compute[72150]:   </devices>
Aug 01 18:50:58 user nova-compute[72150]: </domain>
Aug 01 18:50:58 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-156124977',display_name='tempest-TestStampPattern-server-156124977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-156124977',id=48,image_ref='15b8ff12-3594-42ce-a911-1ddd96b1db13',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZy2wVCHd7vEtiOS/HYac+tq78O0CA/dgbnZhwl2N6J70l2eXFgL43fhOucY/uXMm4OefFrQ4HuyqEQUOsD22aJwn95LDZVUWnVjJnV8RCkRBcjCwyi2bzx0ZZbSdwYQA==',key_name='tempest-TestStampPattern-1877833599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fca32199d5c458ab4bd52d15c27509b',ramdisk_id='',reservation_id='r-8rx5acke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='760ec148-92e3-49a3-93e6-5343f6e6b8c0',image_min_disk='1',image_min_ram='0',image_owner_id='4fca32199d5c458ab4bd52d15c27509b',image_owner_project_name='tempest-TestStampPattern-958709342',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-958709342-project-member',image_user_id='1e18c2b7f1714542bb4f14be70c46194',network_allocated='True',owner_project_name='tempest-TestStampPattern-958709342',owner_user_name='tempest-TestStampPattern-958709342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:50:56Z,user_data=None,user_id='1e18c2b7f1714542bb4f14be70c46194',uuid=635d02d7-65ea-4848-a7d4-29a78b67b60a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa9f3b11-3b09-4025-8355-7971304b048b", "address": "fa:16:3e:c4:29:f7", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa9f3b11-3b", "ovs_interfaceid": "aa9f3b11-3b09-4025-8355-7971304b048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Converting VIF {"id": "aa9f3b11-3b09-4025-8355-7971304b048b", "address": "fa:16:3e:c4:29:f7", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa9f3b11-3b", "ovs_interfaceid": "aa9f3b11-3b09-4025-8355-7971304b048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:29:f7,bridge_name='br-int',has_traffic_filtering=True,id=aa9f3b11-3b09-4025-8355-7971304b048b,network=Network(662f2fa8-b862-434c-bf1f-1804ac5e04ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa9f3b11-3b') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG os_vif [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:29:f7,bridge_name='br-int',has_traffic_filtering=True,id=aa9f3b11-3b09-4025-8355-7971304b048b,network=Network(662f2fa8-b862-434c-bf1f-1804ac5e04ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa9f3b11-3b') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa9f3b11-3b, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaa9f3b11-3b, col_values=(('external_ids', {'iface-id': 'aa9f3b11-3b09-4025-8355-7971304b048b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:29:f7', 'vm-uuid': '635d02d7-65ea-4848-a7d4-29a78b67b60a'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:58 user nova-compute[72150]: INFO os_vif [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:29:f7,bridge_name='br-int',has_traffic_filtering=True,id=aa9f3b11-3b09-4025-8355-7971304b048b,network=Network(662f2fa8-b862-434c-bf1f-1804ac5e04ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa9f3b11-3b')
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] No VIF found with MAC fa:16:3e:c4:29:f7, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Skipping network cache update for instance because it is Building. {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:50:58 user nova-compute[72150]: DEBUG nova.objects.instance [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lazy-loading 'info_cache' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:50:59 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Updating instance_info_cache with network_info: [{"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:50:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:50:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:50:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:50:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-0cc6d0bd-6bac-413b-886c-c6ee558e8cfb req-9bc27f72-090a-4d7d-8dd1-caaa66c2fd02 service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Received event network-vif-plugged-aa9f3b11-3b09-4025-8355-7971304b048b {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:50:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0cc6d0bd-6bac-413b-886c-c6ee558e8cfb req-9bc27f72-090a-4d7d-8dd1-caaa66c2fd02 service nova] Acquiring lock "635d02d7-65ea-4848-a7d4-29a78b67b60a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:50:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0cc6d0bd-6bac-413b-886c-c6ee558e8cfb req-9bc27f72-090a-4d7d-8dd1-caaa66c2fd02 service nova] Lock "635d02d7-65ea-4848-a7d4-29a78b67b60a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:50:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0cc6d0bd-6bac-413b-886c-c6ee558e8cfb req-9bc27f72-090a-4d7d-8dd1-caaa66c2fd02 service nova] Lock "635d02d7-65ea-4848-a7d4-29a78b67b60a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:50:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-0cc6d0bd-6bac-413b-886c-c6ee558e8cfb req-9bc27f72-090a-4d7d-8dd1-caaa66c2fd02 service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] No waiting events found dispatching network-vif-plugged-aa9f3b11-3b09-4025-8355-7971304b048b {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:50:59 user nova-compute[72150]: WARNING nova.compute.manager [req-0cc6d0bd-6bac-413b-886c-c6ee558e8cfb req-9bc27f72-090a-4d7d-8dd1-caaa66c2fd02 service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Received unexpected event network-vif-plugged-aa9f3b11-3b09-4025-8355-7971304b048b for instance with vm_state building and task_state spawning.
Aug 01 18:51:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:51:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:51:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:51:01 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915861.9309874, 635d02d7-65ea-4848-a7d4-29a78b67b60a => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:51:01 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] VM Resumed (Lifecycle Event)
Aug 01 18:51:01 user nova-compute[72150]: DEBUG nova.compute.manager [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:51:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:51:01 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Instance spawned successfully.
Aug 01 18:51:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:51:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:51:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:51:01 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:51:01 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:51:01 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:51:02 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915861.9333389, 635d02d7-65ea-4848-a7d4-29a78b67b60a => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:51:02 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] VM Started (Lifecycle Event)
Aug 01 18:51:02 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:51:02 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:51:02 user nova-compute[72150]: INFO nova.compute.manager [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Took 6.01 seconds to spawn the instance on the hypervisor.
Aug 01 18:51:02 user nova-compute[72150]: DEBUG nova.compute.manager [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:51:02 user nova-compute[72150]: DEBUG nova.compute.manager [req-152edb96-4d5f-4874-8167-23b8fcf63e0b req-6df4f26b-4360-454c-9e74-c213fef7b780 service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Received event network-vif-plugged-aa9f3b11-3b09-4025-8355-7971304b048b {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:51:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-152edb96-4d5f-4874-8167-23b8fcf63e0b req-6df4f26b-4360-454c-9e74-c213fef7b780 service nova] Acquiring lock "635d02d7-65ea-4848-a7d4-29a78b67b60a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:51:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-152edb96-4d5f-4874-8167-23b8fcf63e0b req-6df4f26b-4360-454c-9e74-c213fef7b780 service nova] Lock "635d02d7-65ea-4848-a7d4-29a78b67b60a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:51:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-152edb96-4d5f-4874-8167-23b8fcf63e0b req-6df4f26b-4360-454c-9e74-c213fef7b780 service nova] Lock "635d02d7-65ea-4848-a7d4-29a78b67b60a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:51:02 user nova-compute[72150]: DEBUG nova.compute.manager [req-152edb96-4d5f-4874-8167-23b8fcf63e0b req-6df4f26b-4360-454c-9e74-c213fef7b780 service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] No waiting events found dispatching network-vif-plugged-aa9f3b11-3b09-4025-8355-7971304b048b {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:51:02 user nova-compute[72150]: WARNING nova.compute.manager [req-152edb96-4d5f-4874-8167-23b8fcf63e0b req-6df4f26b-4360-454c-9e74-c213fef7b780 service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Received unexpected event network-vif-plugged-aa9f3b11-3b09-4025-8355-7971304b048b for instance with vm_state building and task_state spawning.
Aug 01 18:51:02 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:51:02 user nova-compute[72150]: INFO nova.compute.manager [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Took 6.69 seconds to build instance.
Aug 01 18:51:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd59-16db-400c-b80b-6a5ec51d894f tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "635d02d7-65ea-4848-a7d4-29a78b67b60a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.809s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:51:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:51:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:51:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:51:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:51:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:51:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:51:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:51:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:51:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:51:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:51:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:51:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:51:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:51:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:51:44 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:51:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:51:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:51:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:51:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:51:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:51:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:51:50 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:51:50 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:51:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:51:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:51:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:51:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:51:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635d02d7-65ea-4848-a7d4-29a78b67b60a/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:51:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635d02d7-65ea-4848-a7d4-29a78b67b60a/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:51:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635d02d7-65ea-4848-a7d4-29a78b67b60a/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:51:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635d02d7-65ea-4848-a7d4-29a78b67b60a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:51:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f0aa50-65d4-4a5d-a507-f6ee539478ca/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:51:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f0aa50-65d4-4a5d-a507-f6ee539478ca/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:51:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f0aa50-65d4-4a5d-a507-f6ee539478ca/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:51:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f0aa50-65d4-4a5d-a507-f6ee539478ca/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:51:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:51:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:51:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:51:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:51:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:51:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:51:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:51:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:51:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:51:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:51:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:51:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:51:52 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:51:52 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:51:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8362MB free_disk=25.21233367919922GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:51:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:51:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:51:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance e6831e19-1dc8-470a-8151-9896d8fea013 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:51:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 760ec148-92e3-49a3-93e6-5343f6e6b8c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:51:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 30f0aa50-65d4-4a5d-a507-f6ee539478ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:51:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:51:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 635d02d7-65ea-4848-a7d4-29a78b67b60a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:51:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:51:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:51:53 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:51:53 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:51:53 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:51:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:51:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:51:57 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:51:57 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:51:57 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:51:57 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:51:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:51:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:51:58 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:51:59 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:51:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:52:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-760ec148-92e3-49a3-93e6-5343f6e6b8c0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:52:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-760ec148-92e3-49a3-93e6-5343f6e6b8c0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:52:00 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:52:00 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Updating instance_info_cache with network_info: [{"id": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "address": "fa:16:3e:e3:ad:06", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ac02e1-ad", "ovs_interfaceid": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:52:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-760ec148-92e3-49a3-93e6-5343f6e6b8c0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:52:00 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.objects.instance [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'flavor' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquired lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.network.neutron [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.objects.instance [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'info_cache' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.network.neutron [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Updating instance_info_cache with network_info: [{"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Releasing lock "refresh_cache-e6831e19-1dc8-470a-8151-9896d8fea013" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:52:03 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Instance destroyed successfully.
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.objects.instance [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'resources' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-332550401',display_name='tempest-AttachVolumeTestJSON-server-332550401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-332550401',id=42,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1Pv06QL+gB8akpzxvePS2xW6RCpVy2Ew7P1W7eruRMggchqt3ZwFOUtwpWrdLBnRyq6PjJd04/eUWvQrMOr+kepnE87SxCG13sR5q56un9VmgaCmcSVeQvqkCfksWPsQ==',key_name='tempest-keypair-133087547',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ac704a033c8b46328eeda139cd57a3aa',ramdisk_id='',reservation_id='r-82uxffm9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-961178577',owner_user_name='tempest-AttachVolumeTestJSON-961178577-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:50:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='237fb5b4bd184868a610aaea2766fa0d',uuid=e6831e19-1dc8-470a-8151-9896d8fea013,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converting VIF {"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=34f12530-76e7-453e-b503-4756ee0cb4a5,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f12530-76') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG os_vif [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=34f12530-76e7-453e-b503-4756ee0cb4a5,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f12530-76') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34f12530-76, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:52:03 user nova-compute[72150]: INFO os_vif [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=34f12530-76e7-453e-b503-4756ee0cb4a5,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f12530-76')
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Start _get_guest_xml network_info=[{"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.objects.instance [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'numa_topology' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:52:03 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:52:03 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.objects.instance [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'vcpu_model' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-332550401',display_name='tempest-AttachVolumeTestJSON-server-332550401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-332550401',id=42,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1Pv06QL+gB8akpzxvePS2xW6RCpVy2Ew7P1W7eruRMggchqt3ZwFOUtwpWrdLBnRyq6PjJd04/eUWvQrMOr+kepnE87SxCG13sR5q56un9VmgaCmcSVeQvqkCfksWPsQ==',key_name='tempest-keypair-133087547',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ac704a033c8b46328eeda139cd57a3aa',ramdisk_id='',reservation_id='r-82uxffm9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-961178577',owner_user_name='tempest-AttachVolumeTestJSON-961178577-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:50:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='237fb5b4bd184868a610aaea2766fa0d',uuid=e6831e19-1dc8-470a-8151-9896d8fea013,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converting VIF {"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=34f12530-76e7-453e-b503-4756ee0cb4a5,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f12530-76') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.objects.instance [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'pci_devices' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:52:03 user nova-compute[72150]:   <uuid>e6831e19-1dc8-470a-8151-9896d8fea013</uuid>
Aug 01 18:52:03 user nova-compute[72150]:   <name>instance-0000002a</name>
Aug 01 18:52:03 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:52:03 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:52:03 user nova-compute[72150]:   <metadata>
Aug 01 18:52:03 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:52:03 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:52:03 user nova-compute[72150]:       <nova:name>tempest-AttachVolumeTestJSON-server-332550401</nova:name>
Aug 01 18:52:03 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:52:03</nova:creationTime>
Aug 01 18:52:03 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:52:03 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:52:03 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:52:03 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:52:03 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:52:03 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:52:03 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:52:03 user nova-compute[72150]:       <nova:owner>
Aug 01 18:52:03 user nova-compute[72150]:         <nova:user uuid="237fb5b4bd184868a610aaea2766fa0d">tempest-AttachVolumeTestJSON-961178577-project-member</nova:user>
Aug 01 18:52:03 user nova-compute[72150]:         <nova:project uuid="ac704a033c8b46328eeda139cd57a3aa">tempest-AttachVolumeTestJSON-961178577</nova:project>
Aug 01 18:52:03 user nova-compute[72150]:       </nova:owner>
Aug 01 18:52:03 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:52:03 user nova-compute[72150]:       <nova:ports>
Aug 01 18:52:03 user nova-compute[72150]:         <nova:port uuid="34f12530-76e7-453e-b503-4756ee0cb4a5">
Aug 01 18:52:03 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 18:52:03 user nova-compute[72150]:         </nova:port>
Aug 01 18:52:03 user nova-compute[72150]:       </nova:ports>
Aug 01 18:52:03 user nova-compute[72150]:     </nova:instance>
Aug 01 18:52:03 user nova-compute[72150]:   </metadata>
Aug 01 18:52:03 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:52:03 user nova-compute[72150]:     <system>
Aug 01 18:52:03 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:52:03 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:52:03 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:52:03 user nova-compute[72150]:       <entry name="serial">e6831e19-1dc8-470a-8151-9896d8fea013</entry>
Aug 01 18:52:03 user nova-compute[72150]:       <entry name="uuid">e6831e19-1dc8-470a-8151-9896d8fea013</entry>
Aug 01 18:52:03 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:52:03 user nova-compute[72150]:     </system>
Aug 01 18:52:03 user nova-compute[72150]:   </sysinfo>
Aug 01 18:52:03 user nova-compute[72150]:   <os>
Aug 01 18:52:03 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:52:03 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:52:03 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:52:03 user nova-compute[72150]:   </os>
Aug 01 18:52:03 user nova-compute[72150]:   <features>
Aug 01 18:52:03 user nova-compute[72150]:     <acpi/>
Aug 01 18:52:03 user nova-compute[72150]:     <apic/>
Aug 01 18:52:03 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:52:03 user nova-compute[72150]:   </features>
Aug 01 18:52:03 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:52:03 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:52:03 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:52:03 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:52:03 user nova-compute[72150]:   </clock>
Aug 01 18:52:03 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:52:03 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:52:03 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:52:03 user nova-compute[72150]:   </cpu>
Aug 01 18:52:03 user nova-compute[72150]:   <devices>
Aug 01 18:52:03 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:52:03 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:52:03 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk"/>
Aug 01 18:52:03 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:52:03 user nova-compute[72150]:     </disk>
Aug 01 18:52:03 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:52:03 user nova-compute[72150]:       <mac address="fa:16:3e:6a:16:f7"/>
Aug 01 18:52:03 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:52:03 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:52:03 user nova-compute[72150]:       <target dev="tap34f12530-76"/>
Aug 01 18:52:03 user nova-compute[72150]:     </interface>
Aug 01 18:52:03 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:52:03 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/console.log" append="off"/>
Aug 01 18:52:03 user nova-compute[72150]:     </serial>
Aug 01 18:52:03 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:52:03 user nova-compute[72150]:     <video>
Aug 01 18:52:03 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:52:03 user nova-compute[72150]:     </video>
Aug 01 18:52:03 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:52:03 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:52:03 user nova-compute[72150]:     </rng>
Aug 01 18:52:03 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:52:03 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:52:03 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:52:03 user nova-compute[72150]:     </memballoon>
Aug 01 18:52:03 user nova-compute[72150]:   </devices>
Aug 01 18:52:03 user nova-compute[72150]: </domain>
Aug 01 18:52:03 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Acquiring lock "30f0aa50-65d4-4a5d-a507-f6ee539478ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Lock "30f0aa50-65d4-4a5d-a507-f6ee539478ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Acquiring lock "30f0aa50-65d4-4a5d-a507-f6ee539478ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Lock "30f0aa50-65d4-4a5d-a507-f6ee539478ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Lock "30f0aa50-65d4-4a5d-a507-f6ee539478ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:52:03 user nova-compute[72150]: INFO nova.compute.manager [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Terminating instance
Aug 01 18:52:03 user nova-compute[72150]: DEBUG nova.compute.manager [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:52:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG nova.objects.instance [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'trusted_certs' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG nova.compute.manager [req-ac601630-d260-407f-8803-d9e6b5f331df req-08520059-bc94-471b-86ac-4d432c47fff1 service nova] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Received event network-vif-unplugged-17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ac601630-d260-407f-8803-d9e6b5f331df req-08520059-bc94-471b-86ac-4d432c47fff1 service nova] Acquiring lock "30f0aa50-65d4-4a5d-a507-f6ee539478ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ac601630-d260-407f-8803-d9e6b5f331df req-08520059-bc94-471b-86ac-4d432c47fff1 service nova] Lock "30f0aa50-65d4-4a5d-a507-f6ee539478ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-ac601630-d260-407f-8803-d9e6b5f331df req-08520059-bc94-471b-86ac-4d432c47fff1 service nova] Lock "30f0aa50-65d4-4a5d-a507-f6ee539478ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG nova.compute.manager [req-ac601630-d260-407f-8803-d9e6b5f331df req-08520059-bc94-471b-86ac-4d432c47fff1 service nova] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] No waiting events found dispatching network-vif-unplugged-17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG nova.compute.manager [req-ac601630-d260-407f-8803-d9e6b5f331df req-08520059-bc94-471b-86ac-4d432c47fff1 service nova] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Received event network-vif-unplugged-17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.149s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Cannot resize image /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG nova.objects.instance [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'migration_context' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-332550401',display_name='tempest-AttachVolumeTestJSON-server-332550401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-332550401',id=42,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1Pv06QL+gB8akpzxvePS2xW6RCpVy2Ew7P1W7eruRMggchqt3ZwFOUtwpWrdLBnRyq6PjJd04/eUWvQrMOr+kepnE87SxCG13sR5q56un9VmgaCmcSVeQvqkCfksWPsQ==',key_name='tempest-keypair-133087547',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='ac704a033c8b46328eeda139cd57a3aa',ramdisk_id='',reservation_id='r-82uxffm9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-961178577',owner_user_name='tempest-AttachVolumeTestJSON-961178577-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:50:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='237fb5b4bd184868a610aaea2766fa0d',uuid=e6831e19-1dc8-470a-8151-9896d8fea013,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converting VIF {"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=34f12530-76e7-453e-b503-4756ee0cb4a5,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f12530-76') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG os_vif [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=34f12530-76e7-453e-b503-4756ee0cb4a5,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f12530-76') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:52:04 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Instance destroyed successfully.
Aug 01 18:52:04 user nova-compute[72150]: DEBUG nova.objects.instance [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Lazy-loading 'resources' on Instance uuid 30f0aa50-65d4-4a5d-a507-f6ee539478ca {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34f12530-76, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap34f12530-76, col_values=(('external_ids', {'iface-id': '34f12530-76e7-453e-b503-4756ee0cb4a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:16:f7', 'vm-uuid': 'e6831e19-1dc8-470a-8151-9896d8fea013'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:50:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-291465271',display_name='tempest-VolumesNegativeTest-instance-291465271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-291465271',id=46,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:50:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7624d57f4a8641559baaf352eee69eeb',ramdisk_id='',reservation_id='r-0sc5txdt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1458395207',owner_user_name='tempest-VolumesNegativeTest-1458395207-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:50:23Z,user_data=None,user_id='9f84f2871aa24b77b4576b6c573b1dbe',uuid=30f0aa50-65d4-4a5d-a507-f6ee539478ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8", "address": "fa:16:3e:2c:a1:94", "network": {"id": "e33f734f-1aa9-4c14-8368-133d6d3316a0", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "efb71aa93c5d4aa2b46478912805009b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae0d6b-7e", "ovs_interfaceid": "17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Converting VIF {"id": "17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8", "address": "fa:16:3e:2c:a1:94", "network": {"id": "e33f734f-1aa9-4c14-8368-133d6d3316a0", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "efb71aa93c5d4aa2b46478912805009b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae0d6b-7e", "ovs_interfaceid": "17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a1:94,bridge_name='br-int',has_traffic_filtering=True,id=17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8,network=Network(e33f734f-1aa9-4c14-8368-133d6d3316a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17ae0d6b-7e') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG os_vif [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a1:94,bridge_name='br-int',has_traffic_filtering=True,id=17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8,network=Network(e33f734f-1aa9-4c14-8368-133d6d3316a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17ae0d6b-7e') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:04 user nova-compute[72150]: INFO os_vif [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=34f12530-76e7-453e-b503-4756ee0cb4a5,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f12530-76')
Aug 01 18:52:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17ae0d6b-7e, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:04 user nova-compute[72150]: INFO os_vif [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a1:94,bridge_name='br-int',has_traffic_filtering=True,id=17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8,network=Network(e33f734f-1aa9-4c14-8368-133d6d3316a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17ae0d6b-7e')
Aug 01 18:52:04 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Deleting instance files /opt/stack/data/nova/instances/30f0aa50-65d4-4a5d-a507-f6ee539478ca_del
Aug 01 18:52:04 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Deletion of /opt/stack/data/nova/instances/30f0aa50-65d4-4a5d-a507-f6ee539478ca_del complete
Aug 01 18:52:04 user nova-compute[72150]: INFO nova.compute.manager [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 01 18:52:04 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:52:04 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:52:05 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:52:05 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Took 0.52 seconds to deallocate network for instance.
Aug 01 18:52:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:52:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:52:05 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:52:05 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:52:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:52:05 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Deleted allocations for instance 30f0aa50-65d4-4a5d-a507-f6ee539478ca
Aug 01 18:52:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c9af9ae4-3abf-4ef1-a659-3cf27b83a5fa tempest-VolumesNegativeTest-1458395207 tempest-VolumesNegativeTest-1458395207-project-member] Lock "30f0aa50-65d4-4a5d-a507-f6ee539478ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.640s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:52:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG nova.compute.manager [req-e68748a0-bf16-4763-852f-fdb69a59a1b6 req-c83495d3-79af-4f0d-8d41-92e627271cae service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received event network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e68748a0-bf16-4763-852f-fdb69a59a1b6 req-c83495d3-79af-4f0d-8d41-92e627271cae service nova] Acquiring lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e68748a0-bf16-4763-852f-fdb69a59a1b6 req-c83495d3-79af-4f0d-8d41-92e627271cae service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e68748a0-bf16-4763-852f-fdb69a59a1b6 req-c83495d3-79af-4f0d-8d41-92e627271cae service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG nova.compute.manager [req-e68748a0-bf16-4763-852f-fdb69a59a1b6 req-c83495d3-79af-4f0d-8d41-92e627271cae service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] No waiting events found dispatching network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:52:06 user nova-compute[72150]: WARNING nova.compute.manager [req-e68748a0-bf16-4763-852f-fdb69a59a1b6 req-c83495d3-79af-4f0d-8d41-92e627271cae service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received unexpected event network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 for instance with vm_state stopped and task_state powering-on.
Aug 01 18:52:06 user nova-compute[72150]: DEBUG nova.compute.manager [req-c4959584-8b2e-406e-b389-7c201900b1a2 req-9fe03298-e8c4-4f2d-ad9d-0c7adabb0266 service nova] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Received event network-vif-plugged-17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c4959584-8b2e-406e-b389-7c201900b1a2 req-9fe03298-e8c4-4f2d-ad9d-0c7adabb0266 service nova] Acquiring lock "30f0aa50-65d4-4a5d-a507-f6ee539478ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c4959584-8b2e-406e-b389-7c201900b1a2 req-9fe03298-e8c4-4f2d-ad9d-0c7adabb0266 service nova] Lock "30f0aa50-65d4-4a5d-a507-f6ee539478ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c4959584-8b2e-406e-b389-7c201900b1a2 req-9fe03298-e8c4-4f2d-ad9d-0c7adabb0266 service nova] Lock "30f0aa50-65d4-4a5d-a507-f6ee539478ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG nova.compute.manager [req-c4959584-8b2e-406e-b389-7c201900b1a2 req-9fe03298-e8c4-4f2d-ad9d-0c7adabb0266 service nova] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] No waiting events found dispatching network-vif-plugged-17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:52:06 user nova-compute[72150]: WARNING nova.compute.manager [req-c4959584-8b2e-406e-b389-7c201900b1a2 req-9fe03298-e8c4-4f2d-ad9d-0c7adabb0266 service nova] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Received unexpected event network-vif-plugged-17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8 for instance with vm_state deleted and task_state None.
Aug 01 18:52:06 user nova-compute[72150]: DEBUG nova.compute.manager [req-c4959584-8b2e-406e-b389-7c201900b1a2 req-9fe03298-e8c4-4f2d-ad9d-0c7adabb0266 service nova] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Received event network-vif-deleted-17ae0d6b-7eab-4cae-a1e8-539e1ff5cff8 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Acquiring lock "c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Acquiring lock "c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:52:06 user nova-compute[72150]: INFO nova.compute.manager [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Terminating instance
Aug 01 18:52:06 user nova-compute[72150]: DEBUG nova.compute.manager [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG nova.compute.manager [req-785a649a-07fb-416f-a52b-e733fbe3961b req-a8313c30-fe4f-4921-91f0-fc8ea617dd61 service nova] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Received event network-vif-unplugged-fce49821-8c97-406d-8740-ab3117c345cc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-785a649a-07fb-416f-a52b-e733fbe3961b req-a8313c30-fe4f-4921-91f0-fc8ea617dd61 service nova] Acquiring lock "c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-785a649a-07fb-416f-a52b-e733fbe3961b req-a8313c30-fe4f-4921-91f0-fc8ea617dd61 service nova] Lock "c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-785a649a-07fb-416f-a52b-e733fbe3961b req-a8313c30-fe4f-4921-91f0-fc8ea617dd61 service nova] Lock "c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG nova.compute.manager [req-785a649a-07fb-416f-a52b-e733fbe3961b req-a8313c30-fe4f-4921-91f0-fc8ea617dd61 service nova] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] No waiting events found dispatching network-vif-unplugged-fce49821-8c97-406d-8740-ab3117c345cc {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG nova.compute.manager [req-785a649a-07fb-416f-a52b-e733fbe3961b req-a8313c30-fe4f-4921-91f0-fc8ea617dd61 service nova] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Received event network-vif-unplugged-fce49821-8c97-406d-8740-ab3117c345cc for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:52:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:07 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Instance destroyed successfully.
Aug 01 18:52:07 user nova-compute[72150]: DEBUG nova.objects.instance [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lazy-loading 'resources' on Instance uuid c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:52:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:50:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1251285739',display_name='tempest-VolumesActionsTest-instance-1251285739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1251285739',id=47,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:50:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9fef6c64f0545ef99e0c2e8059cd267',ramdisk_id='',reservation_id='r-i1banwws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1283477154',owner_user_name='tempest-VolumesActionsTest-1283477154-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:50:23Z,user_data=None,user_id='487eb09a6aa148c18ba2070972457616',uuid=c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fce49821-8c97-406d-8740-ab3117c345cc", "address": "fa:16:3e:d3:b1:46", "network": {"id": "2468551a-06dc-44c4-82fe-7ed843e90920", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1864190400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9fef6c64f0545ef99e0c2e8059cd267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce49821-8c", "ovs_interfaceid": "fce49821-8c97-406d-8740-ab3117c345cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:52:07 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Converting VIF {"id": "fce49821-8c97-406d-8740-ab3117c345cc", "address": "fa:16:3e:d3:b1:46", "network": {"id": "2468551a-06dc-44c4-82fe-7ed843e90920", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1864190400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9fef6c64f0545ef99e0c2e8059cd267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce49821-8c", "ovs_interfaceid": "fce49821-8c97-406d-8740-ab3117c345cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:52:07 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:46,bridge_name='br-int',has_traffic_filtering=True,id=fce49821-8c97-406d-8740-ab3117c345cc,network=Network(2468551a-06dc-44c4-82fe-7ed843e90920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce49821-8c') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:52:07 user nova-compute[72150]: DEBUG os_vif [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:46,bridge_name='br-int',has_traffic_filtering=True,id=fce49821-8c97-406d-8740-ab3117c345cc,network=Network(2468551a-06dc-44c4-82fe-7ed843e90920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce49821-8c') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:52:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfce49821-8c, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:52:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:52:07 user nova-compute[72150]: INFO os_vif [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:46,bridge_name='br-int',has_traffic_filtering=True,id=fce49821-8c97-406d-8740-ab3117c345cc,network=Network(2468551a-06dc-44c4-82fe-7ed843e90920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce49821-8c')
Aug 01 18:52:07 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Deleting instance files /opt/stack/data/nova/instances/c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434_del
Aug 01 18:52:07 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Deletion of /opt/stack/data/nova/instances/c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434_del complete
Aug 01 18:52:07 user nova-compute[72150]: INFO nova.compute.manager [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 18:52:07 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:52:07 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:52:07 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:52:07 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:52:07 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Took 0.42 seconds to deallocate network for instance.
Aug 01 18:52:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:52:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:52:07 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:52:07 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:52:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:52:07 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Deleted allocations for instance c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434
Aug 01 18:52:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-1767fc68-a8f9-4217-ac8f-50c7801f959c tempest-VolumesActionsTest-1283477154 tempest-VolumesActionsTest-1283477154-project-member] Lock "c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.647s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:52:08 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915928.0875618, e6831e19-1dc8-470a-8151-9896d8fea013 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:52:08 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] VM Resumed (Lifecycle Event)
Aug 01 18:52:08 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:52:08 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Instance rebooted successfully.
Aug 01 18:52:08 user nova-compute[72150]: DEBUG nova.compute.manager [None req-bd9400fc-fc9a-4202-8c6f-7cb2a8ca1e2f tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:52:08 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:52:08 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:52:08 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 01 18:52:08 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690915928.0884604, e6831e19-1dc8-470a-8151-9896d8fea013 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:52:08 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] VM Started (Lifecycle Event)
Aug 01 18:52:08 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:52:08 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:52:08 user nova-compute[72150]: DEBUG nova.compute.manager [req-46eb4eb4-42ab-47b7-a971-ac8f96d4168e req-522f5537-c4dd-4ebb-a659-254e2b4b4a1f service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received event network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:52:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-46eb4eb4-42ab-47b7-a971-ac8f96d4168e req-522f5537-c4dd-4ebb-a659-254e2b4b4a1f service nova] Acquiring lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:52:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-46eb4eb4-42ab-47b7-a971-ac8f96d4168e req-522f5537-c4dd-4ebb-a659-254e2b4b4a1f service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:52:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-46eb4eb4-42ab-47b7-a971-ac8f96d4168e req-522f5537-c4dd-4ebb-a659-254e2b4b4a1f service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:52:08 user nova-compute[72150]: DEBUG nova.compute.manager [req-46eb4eb4-42ab-47b7-a971-ac8f96d4168e req-522f5537-c4dd-4ebb-a659-254e2b4b4a1f service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] No waiting events found dispatching network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:52:08 user nova-compute[72150]: WARNING nova.compute.manager [req-46eb4eb4-42ab-47b7-a971-ac8f96d4168e req-522f5537-c4dd-4ebb-a659-254e2b4b4a1f service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received unexpected event network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 for instance with vm_state active and task_state None.
Aug 01 18:52:08 user nova-compute[72150]: DEBUG nova.compute.manager [req-9e879c04-6fff-426a-b175-2c7ea34573b9 req-192061ee-ce77-45d3-ba6e-e6aaa788c0fa service nova] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Received event network-vif-deleted-fce49821-8c97-406d-8740-ab3117c345cc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:52:08 user nova-compute[72150]: DEBUG nova.compute.manager [req-9da85b3a-bd23-409d-b0f5-eebcfa479ba9 req-91a78c58-2a8b-465b-a1c8-7f5d0f2ba9bd service nova] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Received event network-vif-plugged-fce49821-8c97-406d-8740-ab3117c345cc {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:52:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9da85b3a-bd23-409d-b0f5-eebcfa479ba9 req-91a78c58-2a8b-465b-a1c8-7f5d0f2ba9bd service nova] Acquiring lock "c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:52:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9da85b3a-bd23-409d-b0f5-eebcfa479ba9 req-91a78c58-2a8b-465b-a1c8-7f5d0f2ba9bd service nova] Lock "c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:52:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-9da85b3a-bd23-409d-b0f5-eebcfa479ba9 req-91a78c58-2a8b-465b-a1c8-7f5d0f2ba9bd service nova] Lock "c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:52:08 user nova-compute[72150]: DEBUG nova.compute.manager [req-9da85b3a-bd23-409d-b0f5-eebcfa479ba9 req-91a78c58-2a8b-465b-a1c8-7f5d0f2ba9bd service nova] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] No waiting events found dispatching network-vif-plugged-fce49821-8c97-406d-8740-ab3117c345cc {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:52:08 user nova-compute[72150]: WARNING nova.compute.manager [req-9da85b3a-bd23-409d-b0f5-eebcfa479ba9 req-91a78c58-2a8b-465b-a1c8-7f5d0f2ba9bd service nova] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Received unexpected event network-vif-plugged-fce49821-8c97-406d-8740-ab3117c345cc for instance with vm_state deleted and task_state None.
Aug 01 18:52:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:52:19 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915924.4409878, 30f0aa50-65d4-4a5d-a507-f6ee539478ca => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:52:19 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] VM Stopped (Lifecycle Event)
Aug 01 18:52:19 user nova-compute[72150]: DEBUG nova.compute.manager [None req-5f1538bd-7de5-41e8-9061-571ab6caf4d3 None None] [instance: 30f0aa50-65d4-4a5d-a507-f6ee539478ca] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:52:22 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690915927.1826892, c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:52:22 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] VM Stopped (Lifecycle Event)
Aug 01 18:52:22 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ad8a159e-ad00-4b74-ba21-21caab844049 None None] [instance: c7f7d9ac-a7f0-46c1-8a23-e0c6c4234434] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:52:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:52:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:52:44 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:52:47 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-3f1c2e06-3c44-4db4-8bc5-da2465ee2e70 req-824ae2e9-7d2d-4b79-b446-fca8f35ec995 service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Received event network-changed-aa9f3b11-3b09-4025-8355-7971304b048b {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:52:47 user nova-compute[72150]: DEBUG nova.compute.manager [req-3f1c2e06-3c44-4db4-8bc5-da2465ee2e70 req-824ae2e9-7d2d-4b79-b446-fca8f35ec995 service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Refreshing instance network info cache due to event network-changed-aa9f3b11-3b09-4025-8355-7971304b048b. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:52:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3f1c2e06-3c44-4db4-8bc5-da2465ee2e70 req-824ae2e9-7d2d-4b79-b446-fca8f35ec995 service nova] Acquiring lock "refresh_cache-635d02d7-65ea-4848-a7d4-29a78b67b60a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:52:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3f1c2e06-3c44-4db4-8bc5-da2465ee2e70 req-824ae2e9-7d2d-4b79-b446-fca8f35ec995 service nova] Acquired lock "refresh_cache-635d02d7-65ea-4848-a7d4-29a78b67b60a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:52:47 user nova-compute[72150]: DEBUG nova.network.neutron [req-3f1c2e06-3c44-4db4-8bc5-da2465ee2e70 req-824ae2e9-7d2d-4b79-b446-fca8f35ec995 service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Refreshing network info cache for port aa9f3b11-3b09-4025-8355-7971304b048b {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:52:47 user nova-compute[72150]: DEBUG nova.network.neutron [req-3f1c2e06-3c44-4db4-8bc5-da2465ee2e70 req-824ae2e9-7d2d-4b79-b446-fca8f35ec995 service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Updated VIF entry in instance network info cache for port aa9f3b11-3b09-4025-8355-7971304b048b. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:52:47 user nova-compute[72150]: DEBUG nova.network.neutron [req-3f1c2e06-3c44-4db4-8bc5-da2465ee2e70 req-824ae2e9-7d2d-4b79-b446-fca8f35ec995 service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Updating instance_info_cache with network_info: [{"id": "aa9f3b11-3b09-4025-8355-7971304b048b", "address": "fa:16:3e:c4:29:f7", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa9f3b11-3b", "ovs_interfaceid": "aa9f3b11-3b09-4025-8355-7971304b048b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:52:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3f1c2e06-3c44-4db4-8bc5-da2465ee2e70 req-824ae2e9-7d2d-4b79-b446-fca8f35ec995 service nova] Releasing lock "refresh_cache-635d02d7-65ea-4848-a7d4-29a78b67b60a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:52:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "635d02d7-65ea-4848-a7d4-29a78b67b60a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:52:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "635d02d7-65ea-4848-a7d4-29a78b67b60a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:52:47 user nova-compute[72150]: DEBUG nova.objects.instance [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lazy-loading 'flavor' on Instance uuid 635d02d7-65ea-4848-a7d4-29a78b67b60a {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:52:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "635d02d7-65ea-4848-a7d4-29a78b67b60a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:52:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "635d02d7-65ea-4848-a7d4-29a78b67b60a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:52:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "635d02d7-65ea-4848-a7d4-29a78b67b60a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:52:48 user nova-compute[72150]: INFO nova.compute.manager [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Attaching volume a6572cb8-522a-404e-9d08-f9c92b994a2f to /dev/vdb
Aug 01 18:52:48 user nova-compute[72150]: DEBUG os_brick.utils [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:52:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:52:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:52:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdf7a42-354b-4066-8f4e-a9991f7e0414]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:52:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:52:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:52:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6768cbd8-0851-4123-9ef0-9ffaf8fdd0bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:52:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:52:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:52:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cb3adb-f8e1-4f90-af5b-9724f6b7ab47]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:52:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f059f6-e3a4-4d3f-b446-e733c70ff32b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:52:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:52:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:52:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:52:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:52:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:52:48 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:52:48 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6255de5f-d79a-45cd-b776-eb01c27278d7]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:52:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:52:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:52:48 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:52:48 user nova-compute[72150]: DEBUG os_brick.utils [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:52:48 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Updating existing volume attachment record: be787bd7-9c33-4640-b43e-a6e67760c8c6 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:52:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:50 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:52:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:52:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:52:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:52:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:52:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635d02d7-65ea-4848-a7d4-29a78b67b60a/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:52:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635d02d7-65ea-4848-a7d4-29a78b67b60a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:52:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635d02d7-65ea-4848-a7d4-29a78b67b60a/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:52:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635d02d7-65ea-4848-a7d4-29a78b67b60a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:52:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:52:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:52:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:52:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:52:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:52:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:52:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:52:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:52:52 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:52:52 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:52:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8445MB free_disk=25.266117095947266GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:52:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:52:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:52:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance e6831e19-1dc8-470a-8151-9896d8fea013 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:52:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 760ec148-92e3-49a3-93e6-5343f6e6b8c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:52:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 635d02d7-65ea-4848-a7d4-29a78b67b60a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:52:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:52:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:52:52 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:52:52 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:52:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:52:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:52:54 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:52:54 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:52:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:56 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:52:56 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:52:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:52:57 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:52:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:52:58 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCZKyDLO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:53:00 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:53:00 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:53:00 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72b5b3c-bf5c-4416-a5c7-da2897ad3363]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:53:00 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12a19a5-eb1f-4ace-9f0f-764eb226a786]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f] added
Aug 01 18:53:00 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5588faf1-6b87-4c35-a2d0-3c9ab31ad482]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[02909ffd-58b4-426b-ac4c-f88af4eab120]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qCZKyDLO {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qCZKyDLO" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15e770d-1606-430b-8c31-e07085cf7b8d]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qCZKyDLO'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5fc39f-679f-4388-aa55-21f036514bef]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aed4b85-0bda-40b2-92bd-a144b67f0916]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 18:53:00 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 18:53:00 user nova-compute[72150]:  {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:53:00 user nova-compute[72150]: WARNING os_brick.initiator.connectors.iscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 18:53:00 user nova-compute[72150]: 
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c6c1da-690d-4d64-991c-03e22b0520a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f, portal: 172.16.0.220,3260]
Aug 01 18:53:00 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f, portal: 172.16.0.220,3260] successful.
Aug 01 18:53:00 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c179bdca-8ca8-4a3b-b0b0-3ae5cfa92a72]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b492c129-acc5-4cd3-857d-4103f9c4ec59]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f (non-flash)
Aug 01 18:53:00 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f (non-flash)
Aug 01 18:53:00 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9eaeef-15fe-479e-9c71-17000ed9e6f6]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCZKyDLO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Didn't find any instances for network info cache update. {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 18:53:00 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:53:01 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:53:01 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23165613236613832', 'path': '/dev/sdb'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:53:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165613236613832', 'path': '/dev/sdb'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:53:01 user nova-compute[72150]: DEBUG nova.objects.instance [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lazy-loading 'flavor' on Instance uuid 635d02d7-65ea-4848-a7d4-29a78b67b60a {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:53:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:53:01 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:53:01 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 18:53:01 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:53:01 user nova-compute[72150]:   <serial>a6572cb8-522a-404e-9d08-f9c92b994a2f</serial>
Aug 01 18:53:01 user nova-compute[72150]: </disk>
Aug 01 18:53:01 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:53:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:53:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:53:01 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] No VIF found with MAC fa:16:3e:c4:29:f7, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:53:01 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:53:01 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72150) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 18:53:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0d279e9e-b025-4adf-8b74-5c20ceb36d5e tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "635d02d7-65ea-4848-a7d4-29a78b67b60a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.889s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:53:02 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "635d02d7-65ea-4848-a7d4-29a78b67b60a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "635d02d7-65ea-4848-a7d4-29a78b67b60a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:53:04 user nova-compute[72150]: INFO nova.compute.manager [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Detaching volume a6572cb8-522a-404e-9d08-f9c92b994a2f
Aug 01 18:53:04 user nova-compute[72150]: INFO nova.virt.block_device [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Attempting to driver detach volume a6572cb8-522a-404e-9d08-f9c92b994a2f from mountpoint /dev/vdb
Aug 01 18:53:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Attempting to detach device vdb from instance 635d02d7-65ea-4848-a7d4-29a78b67b60a from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:53:04 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:53:04 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 18:53:04 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:53:04 user nova-compute[72150]:   <serial>a6572cb8-522a-404e-9d08-f9c92b994a2f</serial>
Aug 01 18:53:04 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:53:04 user nova-compute[72150]: </disk>
Aug 01 18:53:04 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:53:04 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Successfully detached device vdb from instance 635d02d7-65ea-4848-a7d4-29a78b67b60a from the persistent domain config.
Aug 01 18:53:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 635d02d7-65ea-4848-a7d4-29a78b67b60a from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:53:04 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:53:04 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 18:53:04 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:53:04 user nova-compute[72150]:   <serial>a6572cb8-522a-404e-9d08-f9c92b994a2f</serial>
Aug 01 18:53:04 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:53:04 user nova-compute[72150]: </disk>
Aug 01 18:53:04 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690915984.8567958, 635d02d7-65ea-4848-a7d4-29a78b67b60a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 635d02d7-65ea-4848-a7d4-29a78b67b60a {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:53:04 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Successfully detached device vdb from instance 635d02d7-65ea-4848-a7d4-29a78b67b60a from the live domain config.
Aug 01 18:53:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCZKyDLO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:53:04 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:53:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0185f9f6-b82a-4c42-8ff3-762524f9e224]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7df0953-3032-4dd5-bfa7-40e882082f1f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f (non-flash)
Aug 01 18:53:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f (non-flash)
Aug 01 18:53:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c3c13f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f'): ({'sdb'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Removing single pathed devices sdb {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb743535-7d19-4edb-a5e8-a1a0f5fb4fa1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[547595c2-d50f-479c-9547-c039166a1c4f]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Flushing IO for device /dev/sdb {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c97b47e-2fee-423b-9abc-a415b673a82c]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:53:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0698c115-2a2a-4e08-aef9-bfdaf8ab3a6e]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:53:05 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:53:05 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:53:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:53:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fa2de9-e329-488a-ba63-de1856f1e9fd]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:53:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:53:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd4110e-e26d-4e67-9746-442c8a2884b8]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:53:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f, portal: 172.16.0.220,3260]
Aug 01 18:53:05 user nova-compute[72150]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f, portal: 172.16.0.220,3260] successful.
Aug 01 18:53:05 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:53:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6572cb8-522a-404e-9d08-f9c92b994a2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:05 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5babf8d1-e914-46cf-804a-9fe901ff5361]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:53:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:53:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:53:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] <== disconnect_volume: return (311ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:53:05 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:53:05 user nova-compute[72150]: DEBUG nova.objects.instance [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lazy-loading 'flavor' on Instance uuid 635d02d7-65ea-4848-a7d4-29a78b67b60a {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:53:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-92958551-8d19-4350-a3a6-84e5f7d06b30 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "635d02d7-65ea-4848-a7d4-29a78b67b60a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.748s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:53:07 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:11 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:53:11 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Cleaning up deleted instances {{(pid=72150) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 18:53:11 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] There are 0 instances to clean {{(pid=72150) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 18:53:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:22 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:27 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Acquiring lock "71494aab-21cb-49b3-ae94-ae946f259994" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:53:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "71494aab-21cb-49b3-ae94-ae946f259994" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:53:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:53:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:53:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:53:28 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:53:28 user nova-compute[72150]: INFO nova.compute.claims [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Claim successful on node user
Aug 01 18:53:28 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:53:28 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:53:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:53:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:53:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:53:28 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:53:28 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:53:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG nova.policy [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f13ebe543cb41ca98fc6b9876940b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6393ebb3a4f0431ba8f5c276872c1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:53:29 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Creating image(s)
Aug 01 18:53:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Acquiring lock "/opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "/opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "/opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.155s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk 1073741824" returned: 0 in 0.193s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.347s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Cannot resize image /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lazy-loading 'migration_context' on Instance uuid 71494aab-21cb-49b3-ae94-ae946f259994 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Ensure instance console log exists: /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:53:29 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Successfully created port: a41a5bac-da6d-45af-8bf7-7d24b077697f {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:53:30 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Successfully updated port: a41a5bac-da6d-45af-8bf7-7d24b077697f {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:53:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Acquiring lock "refresh_cache-71494aab-21cb-49b3-ae94-ae946f259994" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:53:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Acquired lock "refresh_cache-71494aab-21cb-49b3-ae94-ae946f259994" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:53:30 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:53:30 user nova-compute[72150]: DEBUG nova.compute.manager [req-0fcab0f1-6fa8-4a81-b15b-97cbd2d209c2 req-ada6c5a3-ad43-4a34-a9b1-3cb0f0df58ab service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Received event network-changed-a41a5bac-da6d-45af-8bf7-7d24b077697f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:53:30 user nova-compute[72150]: DEBUG nova.compute.manager [req-0fcab0f1-6fa8-4a81-b15b-97cbd2d209c2 req-ada6c5a3-ad43-4a34-a9b1-3cb0f0df58ab service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Refreshing instance network info cache due to event network-changed-a41a5bac-da6d-45af-8bf7-7d24b077697f. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:53:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0fcab0f1-6fa8-4a81-b15b-97cbd2d209c2 req-ada6c5a3-ad43-4a34-a9b1-3cb0f0df58ab service nova] Acquiring lock "refresh_cache-71494aab-21cb-49b3-ae94-ae946f259994" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:53:30 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.network.neutron [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Updating instance_info_cache with network_info: [{"id": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "address": "fa:16:3e:8f:ce:21", "network": {"id": "e2bba8d2-db87-47be-8c46-a1667058901b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1639440778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6393ebb3a4f0431ba8f5c276872c1ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41a5bac-da", "ovs_interfaceid": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Releasing lock "refresh_cache-71494aab-21cb-49b3-ae94-ae946f259994" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Instance network_info: |[{"id": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "address": "fa:16:3e:8f:ce:21", "network": {"id": "e2bba8d2-db87-47be-8c46-a1667058901b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1639440778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6393ebb3a4f0431ba8f5c276872c1ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41a5bac-da", "ovs_interfaceid": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0fcab0f1-6fa8-4a81-b15b-97cbd2d209c2 req-ada6c5a3-ad43-4a34-a9b1-3cb0f0df58ab service nova] Acquired lock "refresh_cache-71494aab-21cb-49b3-ae94-ae946f259994" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.network.neutron [req-0fcab0f1-6fa8-4a81-b15b-97cbd2d209c2 req-ada6c5a3-ad43-4a34-a9b1-3cb0f0df58ab service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Refreshing network info cache for port a41a5bac-da6d-45af-8bf7-7d24b077697f {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Start _get_guest_xml network_info=[{"id": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "address": "fa:16:3e:8f:ce:21", "network": {"id": "e2bba8d2-db87-47be-8c46-a1667058901b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1639440778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6393ebb3a4f0431ba8f5c276872c1ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41a5bac-da", "ovs_interfaceid": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:53:31 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:53:31 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:53:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-658843907',display_name='tempest-TestServerVolumeAttachmentScenario-server-658843907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-658843907',id=49,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUfQcxHoILWQ1sEDnev01p17kX2hJtrzY1vpRTZgdXhkzfrbANrFlHPB3wukYRdm6k9dioXN+ZX6rAqZBagsANvpSjgZWIu0bJTQyLJboa5yrU7XtJwLxZzPdtFUCipBw==',key_name='tempest-keypair-1214909300',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6393ebb3a4f0431ba8f5c276872c1ed2',ramdisk_id='',reservation_id='r-8578ozbt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-534139665',owner_user_name='tempest-TestServerVolumeAttachmentScenario-534139665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f13ebe543cb41ca98fc6b9876940b0a',uuid=71494aab-21cb-49b3-ae94-ae946f259994,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "address": "fa:16:3e:8f:ce:21", "network": {"id": "e2bba8d2-db87-47be-8c46-a1667058901b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1639440778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6393ebb3a4f0431ba8f5c276872c1ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41a5bac-da", "ovs_interfaceid": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Converting VIF {"id": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "address": "fa:16:3e:8f:ce:21", "network": {"id": "e2bba8d2-db87-47be-8c46-a1667058901b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1639440778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6393ebb3a4f0431ba8f5c276872c1ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41a5bac-da", "ovs_interfaceid": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ce:21,bridge_name='br-int',has_traffic_filtering=True,id=a41a5bac-da6d-45af-8bf7-7d24b077697f,network=Network(e2bba8d2-db87-47be-8c46-a1667058901b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa41a5bac-da') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lazy-loading 'pci_devices' on Instance uuid 71494aab-21cb-49b3-ae94-ae946f259994 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:53:31 user nova-compute[72150]:   <uuid>71494aab-21cb-49b3-ae94-ae946f259994</uuid>
Aug 01 18:53:31 user nova-compute[72150]:   <name>instance-00000031</name>
Aug 01 18:53:31 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:53:31 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:53:31 user nova-compute[72150]:   <metadata>
Aug 01 18:53:31 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:53:31 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:53:31 user nova-compute[72150]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-658843907</nova:name>
Aug 01 18:53:31 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:53:31</nova:creationTime>
Aug 01 18:53:31 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:53:31 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:53:31 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:53:31 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:53:31 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:53:31 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:53:31 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:53:31 user nova-compute[72150]:       <nova:owner>
Aug 01 18:53:31 user nova-compute[72150]:         <nova:user uuid="2f13ebe543cb41ca98fc6b9876940b0a">tempest-TestServerVolumeAttachmentScenario-534139665-project-member</nova:user>
Aug 01 18:53:31 user nova-compute[72150]:         <nova:project uuid="6393ebb3a4f0431ba8f5c276872c1ed2">tempest-TestServerVolumeAttachmentScenario-534139665</nova:project>
Aug 01 18:53:31 user nova-compute[72150]:       </nova:owner>
Aug 01 18:53:31 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:53:31 user nova-compute[72150]:       <nova:ports>
Aug 01 18:53:31 user nova-compute[72150]:         <nova:port uuid="a41a5bac-da6d-45af-8bf7-7d24b077697f">
Aug 01 18:53:31 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 18:53:31 user nova-compute[72150]:         </nova:port>
Aug 01 18:53:31 user nova-compute[72150]:       </nova:ports>
Aug 01 18:53:31 user nova-compute[72150]:     </nova:instance>
Aug 01 18:53:31 user nova-compute[72150]:   </metadata>
Aug 01 18:53:31 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:53:31 user nova-compute[72150]:     <system>
Aug 01 18:53:31 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:53:31 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:53:31 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:53:31 user nova-compute[72150]:       <entry name="serial">71494aab-21cb-49b3-ae94-ae946f259994</entry>
Aug 01 18:53:31 user nova-compute[72150]:       <entry name="uuid">71494aab-21cb-49b3-ae94-ae946f259994</entry>
Aug 01 18:53:31 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:53:31 user nova-compute[72150]:     </system>
Aug 01 18:53:31 user nova-compute[72150]:   </sysinfo>
Aug 01 18:53:31 user nova-compute[72150]:   <os>
Aug 01 18:53:31 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:53:31 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:53:31 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:53:31 user nova-compute[72150]:   </os>
Aug 01 18:53:31 user nova-compute[72150]:   <features>
Aug 01 18:53:31 user nova-compute[72150]:     <acpi/>
Aug 01 18:53:31 user nova-compute[72150]:     <apic/>
Aug 01 18:53:31 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:53:31 user nova-compute[72150]:   </features>
Aug 01 18:53:31 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:53:31 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:53:31 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:53:31 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:53:31 user nova-compute[72150]:   </clock>
Aug 01 18:53:31 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:53:31 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:53:31 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:53:31 user nova-compute[72150]:   </cpu>
Aug 01 18:53:31 user nova-compute[72150]:   <devices>
Aug 01 18:53:31 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:53:31 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:53:31 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk"/>
Aug 01 18:53:31 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:53:31 user nova-compute[72150]:     </disk>
Aug 01 18:53:31 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:53:31 user nova-compute[72150]:       <mac address="fa:16:3e:8f:ce:21"/>
Aug 01 18:53:31 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:53:31 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:53:31 user nova-compute[72150]:       <target dev="tapa41a5bac-da"/>
Aug 01 18:53:31 user nova-compute[72150]:     </interface>
Aug 01 18:53:31 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:53:31 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/console.log" append="off"/>
Aug 01 18:53:31 user nova-compute[72150]:     </serial>
Aug 01 18:53:31 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:53:31 user nova-compute[72150]:     <video>
Aug 01 18:53:31 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:53:31 user nova-compute[72150]:     </video>
Aug 01 18:53:31 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:53:31 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:53:31 user nova-compute[72150]:     </rng>
Aug 01 18:53:31 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:53:31 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:53:31 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:53:31 user nova-compute[72150]:     </memballoon>
Aug 01 18:53:31 user nova-compute[72150]:   </devices>
Aug 01 18:53:31 user nova-compute[72150]: </domain>
Aug 01 18:53:31 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:53:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-658843907',display_name='tempest-TestServerVolumeAttachmentScenario-server-658843907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-658843907',id=49,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUfQcxHoILWQ1sEDnev01p17kX2hJtrzY1vpRTZgdXhkzfrbANrFlHPB3wukYRdm6k9dioXN+ZX6rAqZBagsANvpSjgZWIu0bJTQyLJboa5yrU7XtJwLxZzPdtFUCipBw==',key_name='tempest-keypair-1214909300',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6393ebb3a4f0431ba8f5c276872c1ed2',ramdisk_id='',reservation_id='r-8578ozbt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-534139665',owner_user_name='tempest-TestServerVolumeAttachmentScenario-534139665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f13ebe543cb41ca98fc6b9876940b0a',uuid=71494aab-21cb-49b3-ae94-ae946f259994,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "address": "fa:16:3e:8f:ce:21", "network": {"id": "e2bba8d2-db87-47be-8c46-a1667058901b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1639440778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6393ebb3a4f0431ba8f5c276872c1ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41a5bac-da", "ovs_interfaceid": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Converting VIF {"id": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "address": "fa:16:3e:8f:ce:21", "network": {"id": "e2bba8d2-db87-47be-8c46-a1667058901b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1639440778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6393ebb3a4f0431ba8f5c276872c1ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41a5bac-da", "ovs_interfaceid": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ce:21,bridge_name='br-int',has_traffic_filtering=True,id=a41a5bac-da6d-45af-8bf7-7d24b077697f,network=Network(e2bba8d2-db87-47be-8c46-a1667058901b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa41a5bac-da') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG os_vif [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ce:21,bridge_name='br-int',has_traffic_filtering=True,id=a41a5bac-da6d-45af-8bf7-7d24b077697f,network=Network(e2bba8d2-db87-47be-8c46-a1667058901b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa41a5bac-da') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa41a5bac-da, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa41a5bac-da, col_values=(('external_ids', {'iface-id': 'a41a5bac-da6d-45af-8bf7-7d24b077697f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:ce:21', 'vm-uuid': '71494aab-21cb-49b3-ae94-ae946f259994'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:31 user nova-compute[72150]: INFO os_vif [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ce:21,bridge_name='br-int',has_traffic_filtering=True,id=a41a5bac-da6d-45af-8bf7-7d24b077697f,network=Network(e2bba8d2-db87-47be-8c46-a1667058901b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa41a5bac-da')
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] No VIF found with MAC fa:16:3e:8f:ce:21, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.network.neutron [req-0fcab0f1-6fa8-4a81-b15b-97cbd2d209c2 req-ada6c5a3-ad43-4a34-a9b1-3cb0f0df58ab service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Updated VIF entry in instance network info cache for port a41a5bac-da6d-45af-8bf7-7d24b077697f. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG nova.network.neutron [req-0fcab0f1-6fa8-4a81-b15b-97cbd2d209c2 req-ada6c5a3-ad43-4a34-a9b1-3cb0f0df58ab service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Updating instance_info_cache with network_info: [{"id": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "address": "fa:16:3e:8f:ce:21", "network": {"id": "e2bba8d2-db87-47be-8c46-a1667058901b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1639440778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6393ebb3a4f0431ba8f5c276872c1ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41a5bac-da", "ovs_interfaceid": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:53:31 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0fcab0f1-6fa8-4a81-b15b-97cbd2d209c2 req-ada6c5a3-ad43-4a34-a9b1-3cb0f0df58ab service nova] Releasing lock "refresh_cache-71494aab-21cb-49b3-ae94-ae946f259994" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:53:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:32 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:32 user nova-compute[72150]: DEBUG nova.compute.manager [req-d29a642e-5c9c-4a76-af21-4c20518919dc req-041b175a-fc7d-42e9-81cc-dcca2ec10fdd service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Received event network-vif-plugged-a41a5bac-da6d-45af-8bf7-7d24b077697f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:53:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d29a642e-5c9c-4a76-af21-4c20518919dc req-041b175a-fc7d-42e9-81cc-dcca2ec10fdd service nova] Acquiring lock "71494aab-21cb-49b3-ae94-ae946f259994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:53:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d29a642e-5c9c-4a76-af21-4c20518919dc req-041b175a-fc7d-42e9-81cc-dcca2ec10fdd service nova] Lock "71494aab-21cb-49b3-ae94-ae946f259994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:53:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d29a642e-5c9c-4a76-af21-4c20518919dc req-041b175a-fc7d-42e9-81cc-dcca2ec10fdd service nova] Lock "71494aab-21cb-49b3-ae94-ae946f259994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:53:32 user nova-compute[72150]: DEBUG nova.compute.manager [req-d29a642e-5c9c-4a76-af21-4c20518919dc req-041b175a-fc7d-42e9-81cc-dcca2ec10fdd service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] No waiting events found dispatching network-vif-plugged-a41a5bac-da6d-45af-8bf7-7d24b077697f {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:53:32 user nova-compute[72150]: WARNING nova.compute.manager [req-d29a642e-5c9c-4a76-af21-4c20518919dc req-041b175a-fc7d-42e9-81cc-dcca2ec10fdd service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Received unexpected event network-vif-plugged-a41a5bac-da6d-45af-8bf7-7d24b077697f for instance with vm_state building and task_state spawning.
Aug 01 18:53:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:34 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690916014.8660486, 71494aab-21cb-49b3-ae94-ae946f259994 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:53:34 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] VM Resumed (Lifecycle Event)
Aug 01 18:53:34 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:53:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:53:34 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Instance spawned successfully.
Aug 01 18:53:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:53:34 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:53:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:53:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:53:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:53:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:53:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:53:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:53:34 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:53:34 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:53:34 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690916014.86922, 71494aab-21cb-49b3-ae94-ae946f259994 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:53:34 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] VM Started (Lifecycle Event)
Aug 01 18:53:34 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:53:34 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:53:35 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:53:35 user nova-compute[72150]: DEBUG nova.compute.manager [req-6307913b-cfec-4cae-9764-bee4c4e37167 req-0c070e89-f46f-4236-8b99-ebc65c1efb63 service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Received event network-vif-plugged-a41a5bac-da6d-45af-8bf7-7d24b077697f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:53:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6307913b-cfec-4cae-9764-bee4c4e37167 req-0c070e89-f46f-4236-8b99-ebc65c1efb63 service nova] Acquiring lock "71494aab-21cb-49b3-ae94-ae946f259994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:53:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6307913b-cfec-4cae-9764-bee4c4e37167 req-0c070e89-f46f-4236-8b99-ebc65c1efb63 service nova] Lock "71494aab-21cb-49b3-ae94-ae946f259994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:53:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-6307913b-cfec-4cae-9764-bee4c4e37167 req-0c070e89-f46f-4236-8b99-ebc65c1efb63 service nova] Lock "71494aab-21cb-49b3-ae94-ae946f259994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:53:35 user nova-compute[72150]: DEBUG nova.compute.manager [req-6307913b-cfec-4cae-9764-bee4c4e37167 req-0c070e89-f46f-4236-8b99-ebc65c1efb63 service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] No waiting events found dispatching network-vif-plugged-a41a5bac-da6d-45af-8bf7-7d24b077697f {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:53:35 user nova-compute[72150]: WARNING nova.compute.manager [req-6307913b-cfec-4cae-9764-bee4c4e37167 req-0c070e89-f46f-4236-8b99-ebc65c1efb63 service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Received unexpected event network-vif-plugged-a41a5bac-da6d-45af-8bf7-7d24b077697f for instance with vm_state building and task_state spawning.
Aug 01 18:53:35 user nova-compute[72150]: INFO nova.compute.manager [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 01 18:53:35 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:53:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:35 user nova-compute[72150]: INFO nova.compute.manager [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Took 6.58 seconds to build instance.
Aug 01 18:53:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9c3937f3-75e3-4688-ab62-0e2a6a5796a5 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "71494aab-21cb-49b3-ae94-ae946f259994" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.672s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:53:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:45 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:53:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:50 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:53:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:53:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:53:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:53:50 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:53:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635d02d7-65ea-4848-a7d4-29a78b67b60a/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635d02d7-65ea-4848-a7d4-29a78b67b60a/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635d02d7-65ea-4848-a7d4-29a78b67b60a/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635d02d7-65ea-4848-a7d4-29a78b67b60a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:53:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:53:52 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:53:52 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:53:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8298MB free_disk=25.227413177490234GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:53:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:53:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:53:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance e6831e19-1dc8-470a-8151-9896d8fea013 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:53:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 760ec148-92e3-49a3-93e6-5343f6e6b8c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:53:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 635d02d7-65ea-4848-a7d4-29a78b67b60a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:53:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 71494aab-21cb-49b3-ae94-ae946f259994 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:53:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:53:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:53:52 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Refreshing inventories for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 18:53:52 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Updating ProviderTree inventory for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 18:53:52 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Updating inventory in ProviderTree for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 18:53:52 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Refreshing aggregate associations for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479, aggregates: None {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 18:53:53 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Refreshing trait associations for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 18:53:53 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:53:53 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:53:53 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:53:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "e6831e19-1dc8-470a-8151-9896d8fea013" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "e6831e19-1dc8-470a-8151-9896d8fea013" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:53:54 user nova-compute[72150]: INFO nova.compute.manager [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Terminating instance
Aug 01 18:53:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG nova.compute.manager [req-55b97bd2-5dbb-4386-9f1f-43b31cb82abc req-49bc3939-9b66-40b1-a5ef-3eb305594207 service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received event network-vif-unplugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-55b97bd2-5dbb-4386-9f1f-43b31cb82abc req-49bc3939-9b66-40b1-a5ef-3eb305594207 service nova] Acquiring lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-55b97bd2-5dbb-4386-9f1f-43b31cb82abc req-49bc3939-9b66-40b1-a5ef-3eb305594207 service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-55b97bd2-5dbb-4386-9f1f-43b31cb82abc req-49bc3939-9b66-40b1-a5ef-3eb305594207 service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG nova.compute.manager [req-55b97bd2-5dbb-4386-9f1f-43b31cb82abc req-49bc3939-9b66-40b1-a5ef-3eb305594207 service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] No waiting events found dispatching network-vif-unplugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG nova.compute.manager [req-55b97bd2-5dbb-4386-9f1f-43b31cb82abc req-49bc3939-9b66-40b1-a5ef-3eb305594207 service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received event network-vif-unplugged-34f12530-76e7-453e-b503-4756ee0cb4a5 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:53:54 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Instance destroyed successfully.
Aug 01 18:53:54 user nova-compute[72150]: DEBUG nova.objects.instance [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'resources' on Instance uuid e6831e19-1dc8-470a-8151-9896d8fea013 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-332550401',display_name='tempest-AttachVolumeTestJSON-server-332550401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-332550401',id=42,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1Pv06QL+gB8akpzxvePS2xW6RCpVy2Ew7P1W7eruRMggchqt3ZwFOUtwpWrdLBnRyq6PjJd04/eUWvQrMOr+kepnE87SxCG13sR5q56un9VmgaCmcSVeQvqkCfksWPsQ==',key_name='tempest-keypair-133087547',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac704a033c8b46328eeda139cd57a3aa',ramdisk_id='',reservation_id='r-82uxffm9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-961178577',owner_user_name='tempest-AttachVolumeTestJSON-961178577-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:52:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='237fb5b4bd184868a610aaea2766fa0d',uuid=e6831e19-1dc8-470a-8151-9896d8fea013,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converting VIF {"id": "34f12530-76e7-453e-b503-4756ee0cb4a5", "address": "fa:16:3e:6a:16:f7", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f12530-76", "ovs_interfaceid": "34f12530-76e7-453e-b503-4756ee0cb4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=34f12530-76e7-453e-b503-4756ee0cb4a5,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f12530-76') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG os_vif [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=34f12530-76e7-453e-b503-4756ee0cb4a5,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f12530-76') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34f12530-76, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:53:54 user nova-compute[72150]: INFO os_vif [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=34f12530-76e7-453e-b503-4756ee0cb4a5,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f12530-76')
Aug 01 18:53:54 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Deleting instance files /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013_del
Aug 01 18:53:54 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Deletion of /opt/stack/data/nova/instances/e6831e19-1dc8-470a-8151-9896d8fea013_del complete
Aug 01 18:53:55 user nova-compute[72150]: INFO nova.compute.manager [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 01 18:53:55 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:53:55 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:53:55 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:53:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:55 user nova-compute[72150]: DEBUG nova.compute.manager [req-7104a080-1242-4348-ad8e-80c0a2c26b13 req-c0d43cb8-8e25-416d-a902-b975e66dada9 service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Received event network-changed-aa9f3b11-3b09-4025-8355-7971304b048b {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:53:55 user nova-compute[72150]: DEBUG nova.compute.manager [req-7104a080-1242-4348-ad8e-80c0a2c26b13 req-c0d43cb8-8e25-416d-a902-b975e66dada9 service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Refreshing instance network info cache due to event network-changed-aa9f3b11-3b09-4025-8355-7971304b048b. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:53:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7104a080-1242-4348-ad8e-80c0a2c26b13 req-c0d43cb8-8e25-416d-a902-b975e66dada9 service nova] Acquiring lock "refresh_cache-635d02d7-65ea-4848-a7d4-29a78b67b60a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:53:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7104a080-1242-4348-ad8e-80c0a2c26b13 req-c0d43cb8-8e25-416d-a902-b975e66dada9 service nova] Acquired lock "refresh_cache-635d02d7-65ea-4848-a7d4-29a78b67b60a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:53:55 user nova-compute[72150]: DEBUG nova.network.neutron [req-7104a080-1242-4348-ad8e-80c0a2c26b13 req-c0d43cb8-8e25-416d-a902-b975e66dada9 service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Refreshing network info cache for port aa9f3b11-3b09-4025-8355-7971304b048b {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:53:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "635d02d7-65ea-4848-a7d4-29a78b67b60a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:53:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "635d02d7-65ea-4848-a7d4-29a78b67b60a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:53:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "635d02d7-65ea-4848-a7d4-29a78b67b60a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:53:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "635d02d7-65ea-4848-a7d4-29a78b67b60a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:53:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "635d02d7-65ea-4848-a7d4-29a78b67b60a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:53:55 user nova-compute[72150]: INFO nova.compute.manager [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Terminating instance
Aug 01 18:53:55 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:53:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:53:56 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Took 1.18 seconds to deallocate network for instance.
Aug 01 18:53:56 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Instance destroyed successfully.
Aug 01 18:53:56 user nova-compute[72150]: DEBUG nova.objects.instance [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lazy-loading 'resources' on Instance uuid 635d02d7-65ea-4848-a7d4-29a78b67b60a {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-156124977',display_name='tempest-TestStampPattern-server-156124977',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-156124977',id=48,image_ref='15b8ff12-3594-42ce-a911-1ddd96b1db13',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZy2wVCHd7vEtiOS/HYac+tq78O0CA/dgbnZhwl2N6J70l2eXFgL43fhOucY/uXMm4OefFrQ4HuyqEQUOsD22aJwn95LDZVUWnVjJnV8RCkRBcjCwyi2bzx0ZZbSdwYQA==',key_name='tempest-TestStampPattern-1877833599',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:51:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fca32199d5c458ab4bd52d15c27509b',ramdisk_id='',reservation_id='r-8rx5acke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='760ec148-92e3-49a3-93e6-5343f6e6b8c0',image_min_disk='1',image_min_ram='0',image_owner_id='4fca32199d5c458ab4bd52d15c27509b',image_owner_project_name='tempest-TestStampPattern-958709342',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-958709342-project-member',image_user_id='1e18c2b7f1714542bb4f14be70c46194',owner_project_name='tempest-TestStampPattern-958709342',owner_user_name='tempest-TestStampPattern-958709342-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:51:02Z,user_data=None,user_id='1e18c2b7f1714542bb4f14be70c46194',uuid=635d02d7-65ea-4848-a7d4-29a78b67b60a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa9f3b11-3b09-4025-8355-7971304b048b", "address": "fa:16:3e:c4:29:f7", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa9f3b11-3b", "ovs_interfaceid": "aa9f3b11-3b09-4025-8355-7971304b048b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Converting VIF {"id": "aa9f3b11-3b09-4025-8355-7971304b048b", "address": "fa:16:3e:c4:29:f7", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa9f3b11-3b", "ovs_interfaceid": "aa9f3b11-3b09-4025-8355-7971304b048b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:29:f7,bridge_name='br-int',has_traffic_filtering=True,id=aa9f3b11-3b09-4025-8355-7971304b048b,network=Network(662f2fa8-b862-434c-bf1f-1804ac5e04ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa9f3b11-3b') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG os_vif [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:29:f7,bridge_name='br-int',has_traffic_filtering=True,id=aa9f3b11-3b09-4025-8355-7971304b048b,network=Network(662f2fa8-b862-434c-bf1f-1804ac5e04ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa9f3b11-3b') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa9f3b11-3b, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:53:56 user nova-compute[72150]: INFO os_vif [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:29:f7,bridge_name='br-int',has_traffic_filtering=True,id=aa9f3b11-3b09-4025-8355-7971304b048b,network=Network(662f2fa8-b862-434c-bf1f-1804ac5e04ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa9f3b11-3b')
Aug 01 18:53:56 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Deleting instance files /opt/stack/data/nova/instances/635d02d7-65ea-4848-a7d4-29a78b67b60a_del
Aug 01 18:53:56 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Deletion of /opt/stack/data/nova/instances/635d02d7-65ea-4848-a7d4-29a78b67b60a_del complete
Aug 01 18:53:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-b107ea95-d584-45fb-877f-ff788e4c4650 req-f82f550a-598e-4a7c-b50f-f91b41f2fe2f service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Received event network-vif-unplugged-aa9f3b11-3b09-4025-8355-7971304b048b {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b107ea95-d584-45fb-877f-ff788e4c4650 req-f82f550a-598e-4a7c-b50f-f91b41f2fe2f service nova] Acquiring lock "635d02d7-65ea-4848-a7d4-29a78b67b60a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b107ea95-d584-45fb-877f-ff788e4c4650 req-f82f550a-598e-4a7c-b50f-f91b41f2fe2f service nova] Lock "635d02d7-65ea-4848-a7d4-29a78b67b60a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b107ea95-d584-45fb-877f-ff788e4c4650 req-f82f550a-598e-4a7c-b50f-f91b41f2fe2f service nova] Lock "635d02d7-65ea-4848-a7d4-29a78b67b60a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-b107ea95-d584-45fb-877f-ff788e4c4650 req-f82f550a-598e-4a7c-b50f-f91b41f2fe2f service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] No waiting events found dispatching network-vif-unplugged-aa9f3b11-3b09-4025-8355-7971304b048b {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-b107ea95-d584-45fb-877f-ff788e4c4650 req-f82f550a-598e-4a7c-b50f-f91b41f2fe2f service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Received event network-vif-unplugged-aa9f3b11-3b09-4025-8355-7971304b048b for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG nova.network.neutron [req-7104a080-1242-4348-ad8e-80c0a2c26b13 req-c0d43cb8-8e25-416d-a902-b975e66dada9 service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Updated VIF entry in instance network info cache for port aa9f3b11-3b09-4025-8355-7971304b048b. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG nova.network.neutron [req-7104a080-1242-4348-ad8e-80c0a2c26b13 req-c0d43cb8-8e25-416d-a902-b975e66dada9 service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Updating instance_info_cache with network_info: [{"id": "aa9f3b11-3b09-4025-8355-7971304b048b", "address": "fa:16:3e:c4:29:f7", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa9f3b11-3b", "ovs_interfaceid": "aa9f3b11-3b09-4025-8355-7971304b048b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:53:56 user nova-compute[72150]: INFO nova.compute.manager [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 18:53:56 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7104a080-1242-4348-ad8e-80c0a2c26b13 req-c0d43cb8-8e25-416d-a902-b975e66dada9 service nova] Releasing lock "refresh_cache-635d02d7-65ea-4848-a7d4-29a78b67b60a" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:53:56 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Deleted allocations for instance e6831e19-1dc8-470a-8151-9896d8fea013
Aug 01 18:53:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-17e6fc45-380e-4eda-bb8e-07e7de6133aa tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "e6831e19-1dc8-470a-8151-9896d8fea013" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.264s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-c133db43-c879-4812-802c-9bd4bbbf2d2d req-16f725ce-4f5c-4f20-b1b9-f2560e20aecc service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received event network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c133db43-c879-4812-802c-9bd4bbbf2d2d req-16f725ce-4f5c-4f20-b1b9-f2560e20aecc service nova] Acquiring lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c133db43-c879-4812-802c-9bd4bbbf2d2d req-16f725ce-4f5c-4f20-b1b9-f2560e20aecc service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-c133db43-c879-4812-802c-9bd4bbbf2d2d req-16f725ce-4f5c-4f20-b1b9-f2560e20aecc service nova] Lock "e6831e19-1dc8-470a-8151-9896d8fea013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:53:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-c133db43-c879-4812-802c-9bd4bbbf2d2d req-16f725ce-4f5c-4f20-b1b9-f2560e20aecc service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] No waiting events found dispatching network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:53:56 user nova-compute[72150]: WARNING nova.compute.manager [req-c133db43-c879-4812-802c-9bd4bbbf2d2d req-16f725ce-4f5c-4f20-b1b9-f2560e20aecc service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received unexpected event network-vif-plugged-34f12530-76e7-453e-b503-4756ee0cb4a5 for instance with vm_state deleted and task_state None.
Aug 01 18:53:57 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:53:57 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Took 0.74 seconds to deallocate network for instance.
Aug 01 18:53:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:53:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:53:57 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:53:57 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:53:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:53:57 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Deleted allocations for instance 635d02d7-65ea-4848-a7d4-29a78b67b60a
Aug 01 18:53:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-88e06eba-d84e-476b-9b0d-b9db3a0b4348 req-b6fefcb7-ed10-48a2-96cb-5e450a7250b1 service nova] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Received event network-vif-deleted-34f12530-76e7-453e-b503-4756ee0cb4a5 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:53:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-cadd0145-8beb-41d1-9837-9656033f4625 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "635d02d7-65ea-4848-a7d4-29a78b67b60a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.976s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:53:57 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:53:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-d4db357f-6819-4be0-859e-9fd8a0c58cf9 req-56f13b0f-5425-4503-9b91-da302f5ef049 service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Received event network-vif-plugged-aa9f3b11-3b09-4025-8355-7971304b048b {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:53:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d4db357f-6819-4be0-859e-9fd8a0c58cf9 req-56f13b0f-5425-4503-9b91-da302f5ef049 service nova] Acquiring lock "635d02d7-65ea-4848-a7d4-29a78b67b60a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:53:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d4db357f-6819-4be0-859e-9fd8a0c58cf9 req-56f13b0f-5425-4503-9b91-da302f5ef049 service nova] Lock "635d02d7-65ea-4848-a7d4-29a78b67b60a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:53:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-d4db357f-6819-4be0-859e-9fd8a0c58cf9 req-56f13b0f-5425-4503-9b91-da302f5ef049 service nova] Lock "635d02d7-65ea-4848-a7d4-29a78b67b60a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:53:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-d4db357f-6819-4be0-859e-9fd8a0c58cf9 req-56f13b0f-5425-4503-9b91-da302f5ef049 service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] No waiting events found dispatching network-vif-plugged-aa9f3b11-3b09-4025-8355-7971304b048b {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:53:58 user nova-compute[72150]: WARNING nova.compute.manager [req-d4db357f-6819-4be0-859e-9fd8a0c58cf9 req-56f13b0f-5425-4503-9b91-da302f5ef049 service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Received unexpected event network-vif-plugged-aa9f3b11-3b09-4025-8355-7971304b048b for instance with vm_state deleted and task_state None.
Aug 01 18:53:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-d4db357f-6819-4be0-859e-9fd8a0c58cf9 req-56f13b0f-5425-4503-9b91-da302f5ef049 service nova] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Received event network-vif-deleted-aa9f3b11-3b09-4025-8355-7971304b048b {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:53:58 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:53:59 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:53:59 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:53:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:54:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:02 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:54:02 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:54:02 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 18:54:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-760ec148-92e3-49a3-93e6-5343f6e6b8c0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:54:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-760ec148-92e3-49a3-93e6-5343f6e6b8c0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:54:02 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:54:02 user nova-compute[72150]: DEBUG nova.objects.instance [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lazy-loading 'info_cache' on Instance uuid 760ec148-92e3-49a3-93e6-5343f6e6b8c0 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:54:03 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Updating instance_info_cache with network_info: [{"id": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "address": "fa:16:3e:e3:ad:06", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ac02e1-ad", "ovs_interfaceid": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:54:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-760ec148-92e3-49a3-93e6-5343f6e6b8c0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:54:03 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:54:04 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:54:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:09 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690916034.9272249, e6831e19-1dc8-470a-8151-9896d8fea013 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:54:09 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] VM Stopped (Lifecycle Event)
Aug 01 18:54:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-e72857ab-a653-4567-89f3-87a740f45225 None None] [instance: e6831e19-1dc8-470a-8151-9896d8fea013] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:54:11 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690916036.2582324, 635d02d7-65ea-4848-a7d4-29a78b67b60a => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:54:11 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] VM Stopped (Lifecycle Event)
Aug 01 18:54:11 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7c16ece9-d856-481e-bb82-13f7db58f4f9 None None] [instance: 635d02d7-65ea-4848-a7d4-29a78b67b60a] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:54:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:54:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:54:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:54:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:54:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:54:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:45 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:54:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:54:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:54:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:54:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:54:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "0d54f465-6427-4fad-921c-adf51c57a7d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG nova.compute.manager [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 18:54:48 user nova-compute[72150]: INFO nova.compute.claims [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Claim successful on node user
Aug 01 18:54:48 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG nova.compute.manager [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG nova.compute.manager [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG nova.network.neutron [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 18:54:48 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 18:54:48 user nova-compute[72150]: DEBUG nova.compute.manager [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG nova.compute.manager [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 18:54:48 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Creating image(s)
Aug 01 18:54:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "/opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "/opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.142s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:54:48 user nova-compute[72150]: DEBUG nova.policy [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '237fb5b4bd184868a610aaea2766fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac704a033c8b46328eeda139cd57a3aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 18:54:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/disk 1073741824" returned: 0 in 0.055s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:54:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:54:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:54:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:54:49 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 18:54:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:54:49 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:54:49 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Cannot resize image /opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 18:54:49 user nova-compute[72150]: DEBUG nova.objects.instance [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'migration_context' on Instance uuid 0d54f465-6427-4fad-921c-adf51c57a7d4 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:54:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 18:54:49 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Ensure instance console log exists: /opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 18:54:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:54:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:54:49 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:54:49 user nova-compute[72150]: DEBUG nova.network.neutron [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Successfully created port: c8bdd057-cfae-4e74-912c-427d5b9f8500 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.network.neutron [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Successfully updated port: c8bdd057-cfae-4e74-912c-427d5b9f8500 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "refresh_cache-0d54f465-6427-4fad-921c-adf51c57a7d4" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquired lock "refresh_cache-0d54f465-6427-4fad-921c-adf51c57a7d4" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.network.neutron [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-7e7b23b8-ffb5-4cd3-ac8a-57b3b6dc68bf req-7db570c2-03cb-4bf4-a39f-56f1fa0db423 service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Received event network-changed-c8bdd057-cfae-4e74-912c-427d5b9f8500 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.compute.manager [req-7e7b23b8-ffb5-4cd3-ac8a-57b3b6dc68bf req-7db570c2-03cb-4bf4-a39f-56f1fa0db423 service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Refreshing instance network info cache due to event network-changed-c8bdd057-cfae-4e74-912c-427d5b9f8500. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7e7b23b8-ffb5-4cd3-ac8a-57b3b6dc68bf req-7db570c2-03cb-4bf4-a39f-56f1fa0db423 service nova] Acquiring lock "refresh_cache-0d54f465-6427-4fad-921c-adf51c57a7d4" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.network.neutron [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.network.neutron [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Updating instance_info_cache with network_info: [{"id": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "address": "fa:16:3e:49:d1:c8", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8bdd057-cf", "ovs_interfaceid": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Releasing lock "refresh_cache-0d54f465-6427-4fad-921c-adf51c57a7d4" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Instance network_info: |[{"id": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "address": "fa:16:3e:49:d1:c8", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8bdd057-cf", "ovs_interfaceid": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7e7b23b8-ffb5-4cd3-ac8a-57b3b6dc68bf req-7db570c2-03cb-4bf4-a39f-56f1fa0db423 service nova] Acquired lock "refresh_cache-0d54f465-6427-4fad-921c-adf51c57a7d4" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.network.neutron [req-7e7b23b8-ffb5-4cd3-ac8a-57b3b6dc68bf req-7db570c2-03cb-4bf4-a39f-56f1fa0db423 service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Refreshing network info cache for port c8bdd057-cfae-4e74-912c-427d5b9f8500 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Start _get_guest_xml network_info=[{"id": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "address": "fa:16:3e:49:d1:c8", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8bdd057-cf", "ovs_interfaceid": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 18:54:50 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:54:50 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-705744707',display_name='tempest-AttachVolumeTestJSON-server-705744707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-705744707',id=50,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdBc6je6mHCm0hJe+fO3964m4BW411fBODwSJ2g+Letg20Px78nEvRWTm9ItNRHG0FmdxuHRIpWQmFEJiJ4OFmpMqVOeMsoRYmVZTmglZvVOY3v1mIBGZt5Eu9D0W8DLw==',key_name='tempest-keypair-1648075596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac704a033c8b46328eeda139cd57a3aa',ramdisk_id='',reservation_id='r-8rxq74um',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-961178577',owner_user_name='tempest-AttachVolumeTestJSON-961178577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:54:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='237fb5b4bd184868a610aaea2766fa0d',uuid=0d54f465-6427-4fad-921c-adf51c57a7d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "address": "fa:16:3e:49:d1:c8", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8bdd057-cf", "ovs_interfaceid": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converting VIF {"id": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "address": "fa:16:3e:49:d1:c8", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8bdd057-cf", "ovs_interfaceid": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:d1:c8,bridge_name='br-int',has_traffic_filtering=True,id=c8bdd057-cfae-4e74-912c-427d5b9f8500,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8bdd057-cf') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.objects.instance [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d54f465-6427-4fad-921c-adf51c57a7d4 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] End _get_guest_xml xml=<domain type="kvm">
Aug 01 18:54:50 user nova-compute[72150]:   <uuid>0d54f465-6427-4fad-921c-adf51c57a7d4</uuid>
Aug 01 18:54:50 user nova-compute[72150]:   <name>instance-00000032</name>
Aug 01 18:54:50 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 18:54:50 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 18:54:50 user nova-compute[72150]:   <metadata>
Aug 01 18:54:50 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 18:54:50 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 18:54:50 user nova-compute[72150]:       <nova:name>tempest-AttachVolumeTestJSON-server-705744707</nova:name>
Aug 01 18:54:50 user nova-compute[72150]:       <nova:creationTime>2023-08-01 18:54:50</nova:creationTime>
Aug 01 18:54:50 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 18:54:50 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 18:54:50 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 18:54:50 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 18:54:50 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 18:54:50 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 18:54:50 user nova-compute[72150]:       </nova:flavor>
Aug 01 18:54:50 user nova-compute[72150]:       <nova:owner>
Aug 01 18:54:50 user nova-compute[72150]:         <nova:user uuid="237fb5b4bd184868a610aaea2766fa0d">tempest-AttachVolumeTestJSON-961178577-project-member</nova:user>
Aug 01 18:54:50 user nova-compute[72150]:         <nova:project uuid="ac704a033c8b46328eeda139cd57a3aa">tempest-AttachVolumeTestJSON-961178577</nova:project>
Aug 01 18:54:50 user nova-compute[72150]:       </nova:owner>
Aug 01 18:54:50 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 18:54:50 user nova-compute[72150]:       <nova:ports>
Aug 01 18:54:50 user nova-compute[72150]:         <nova:port uuid="c8bdd057-cfae-4e74-912c-427d5b9f8500">
Aug 01 18:54:50 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 18:54:50 user nova-compute[72150]:         </nova:port>
Aug 01 18:54:50 user nova-compute[72150]:       </nova:ports>
Aug 01 18:54:50 user nova-compute[72150]:     </nova:instance>
Aug 01 18:54:50 user nova-compute[72150]:   </metadata>
Aug 01 18:54:50 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 18:54:50 user nova-compute[72150]:     <system>
Aug 01 18:54:50 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 18:54:50 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 18:54:50 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 18:54:50 user nova-compute[72150]:       <entry name="serial">0d54f465-6427-4fad-921c-adf51c57a7d4</entry>
Aug 01 18:54:50 user nova-compute[72150]:       <entry name="uuid">0d54f465-6427-4fad-921c-adf51c57a7d4</entry>
Aug 01 18:54:50 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 18:54:50 user nova-compute[72150]:     </system>
Aug 01 18:54:50 user nova-compute[72150]:   </sysinfo>
Aug 01 18:54:50 user nova-compute[72150]:   <os>
Aug 01 18:54:50 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 18:54:50 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 18:54:50 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 18:54:50 user nova-compute[72150]:   </os>
Aug 01 18:54:50 user nova-compute[72150]:   <features>
Aug 01 18:54:50 user nova-compute[72150]:     <acpi/>
Aug 01 18:54:50 user nova-compute[72150]:     <apic/>
Aug 01 18:54:50 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 18:54:50 user nova-compute[72150]:   </features>
Aug 01 18:54:50 user nova-compute[72150]:   <clock offset="utc">
Aug 01 18:54:50 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 18:54:50 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 18:54:50 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 18:54:50 user nova-compute[72150]:   </clock>
Aug 01 18:54:50 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 18:54:50 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 18:54:50 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 18:54:50 user nova-compute[72150]:   </cpu>
Aug 01 18:54:50 user nova-compute[72150]:   <devices>
Aug 01 18:54:50 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 18:54:50 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 18:54:50 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/disk"/>
Aug 01 18:54:50 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 18:54:50 user nova-compute[72150]:     </disk>
Aug 01 18:54:50 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 18:54:50 user nova-compute[72150]:       <mac address="fa:16:3e:49:d1:c8"/>
Aug 01 18:54:50 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:54:50 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 18:54:50 user nova-compute[72150]:       <target dev="tapc8bdd057-cf"/>
Aug 01 18:54:50 user nova-compute[72150]:     </interface>
Aug 01 18:54:50 user nova-compute[72150]:     <serial type="pty">
Aug 01 18:54:50 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/console.log" append="off"/>
Aug 01 18:54:50 user nova-compute[72150]:     </serial>
Aug 01 18:54:50 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 18:54:50 user nova-compute[72150]:     <video>
Aug 01 18:54:50 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 18:54:50 user nova-compute[72150]:     </video>
Aug 01 18:54:50 user nova-compute[72150]:     <rng model="virtio">
Aug 01 18:54:50 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 18:54:50 user nova-compute[72150]:     </rng>
Aug 01 18:54:50 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 18:54:50 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 18:54:50 user nova-compute[72150]:       <stats period="10"/>
Aug 01 18:54:50 user nova-compute[72150]:     </memballoon>
Aug 01 18:54:50 user nova-compute[72150]:   </devices>
Aug 01 18:54:50 user nova-compute[72150]: </domain>
Aug 01 18:54:50 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-705744707',display_name='tempest-AttachVolumeTestJSON-server-705744707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-705744707',id=50,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdBc6je6mHCm0hJe+fO3964m4BW411fBODwSJ2g+Letg20Px78nEvRWTm9ItNRHG0FmdxuHRIpWQmFEJiJ4OFmpMqVOeMsoRYmVZTmglZvVOY3v1mIBGZt5Eu9D0W8DLw==',key_name='tempest-keypair-1648075596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac704a033c8b46328eeda139cd57a3aa',ramdisk_id='',reservation_id='r-8rxq74um',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-961178577',owner_user_name='tempest-AttachVolumeTestJSON-961178577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T18:54:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='237fb5b4bd184868a610aaea2766fa0d',uuid=0d54f465-6427-4fad-921c-adf51c57a7d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "address": "fa:16:3e:49:d1:c8", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8bdd057-cf", "ovs_interfaceid": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converting VIF {"id": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "address": "fa:16:3e:49:d1:c8", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8bdd057-cf", "ovs_interfaceid": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:d1:c8,bridge_name='br-int',has_traffic_filtering=True,id=c8bdd057-cfae-4e74-912c-427d5b9f8500,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8bdd057-cf') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG os_vif [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:d1:c8,bridge_name='br-int',has_traffic_filtering=True,id=c8bdd057-cfae-4e74-912c-427d5b9f8500,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8bdd057-cf') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8bdd057-cf, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8bdd057-cf, col_values=(('external_ids', {'iface-id': 'c8bdd057-cfae-4e74-912c-427d5b9f8500', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:d1:c8', 'vm-uuid': '0d54f465-6427-4fad-921c-adf51c57a7d4'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:50 user nova-compute[72150]: INFO os_vif [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:d1:c8,bridge_name='br-int',has_traffic_filtering=True,id=c8bdd057-cfae-4e74-912c-427d5b9f8500,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8bdd057-cf')
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:54:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] No VIF found with MAC fa:16:3e:49:d1:c8, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:54:51 user nova-compute[72150]: DEBUG nova.network.neutron [req-7e7b23b8-ffb5-4cd3-ac8a-57b3b6dc68bf req-7db570c2-03cb-4bf4-a39f-56f1fa0db423 service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Updated VIF entry in instance network info cache for port c8bdd057-cfae-4e74-912c-427d5b9f8500. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:54:51 user nova-compute[72150]: DEBUG nova.network.neutron [req-7e7b23b8-ffb5-4cd3-ac8a-57b3b6dc68bf req-7db570c2-03cb-4bf4-a39f-56f1fa0db423 service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Updating instance_info_cache with network_info: [{"id": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "address": "fa:16:3e:49:d1:c8", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8bdd057-cf", "ovs_interfaceid": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:54:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7e7b23b8-ffb5-4cd3-ac8a-57b3b6dc68bf req-7db570c2-03cb-4bf4-a39f-56f1fa0db423 service nova] Releasing lock "refresh_cache-0d54f465-6427-4fad-921c-adf51c57a7d4" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:54:51 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:54:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:54:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:54:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:54:51 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:54:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:52 user nova-compute[72150]: DEBUG nova.compute.manager [req-57ae55c1-7443-4640-81e8-7f028218762b req-24ebe87a-c6f1-470b-8449-890e46d3f9ea service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Received event network-vif-plugged-c8bdd057-cfae-4e74-912c-427d5b9f8500 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:54:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-57ae55c1-7443-4640-81e8-7f028218762b req-24ebe87a-c6f1-470b-8449-890e46d3f9ea service nova] Acquiring lock "0d54f465-6427-4fad-921c-adf51c57a7d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:54:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-57ae55c1-7443-4640-81e8-7f028218762b req-24ebe87a-c6f1-470b-8449-890e46d3f9ea service nova] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:54:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-57ae55c1-7443-4640-81e8-7f028218762b req-24ebe87a-c6f1-470b-8449-890e46d3f9ea service nova] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:54:52 user nova-compute[72150]: DEBUG nova.compute.manager [req-57ae55c1-7443-4640-81e8-7f028218762b req-24ebe87a-c6f1-470b-8449-890e46d3f9ea service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] No waiting events found dispatching network-vif-plugged-c8bdd057-cfae-4e74-912c-427d5b9f8500 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:54:52 user nova-compute[72150]: WARNING nova.compute.manager [req-57ae55c1-7443-4640-81e8-7f028218762b req-24ebe87a-c6f1-470b-8449-890e46d3f9ea service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Received unexpected event network-vif-plugged-c8bdd057-cfae-4e74-912c-427d5b9f8500 for instance with vm_state building and task_state spawning.
Aug 01 18:54:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:54:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:52 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:54:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:54:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:54:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:54:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:54:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:54:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:54:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:54:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:54:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:54:53 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690916094.4967866, 0d54f465-6427-4fad-921c-adf51c57a7d4 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:54:54 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] VM Resumed (Lifecycle Event)
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.compute.manager [req-09e3c568-7df6-4ffe-b80a-2dbf2aee7bee req-c7fb6e38-be77-4a9c-af88-28e026484855 service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Received event network-vif-plugged-c8bdd057-cfae-4e74-912c-427d5b9f8500 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:54:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-09e3c568-7df6-4ffe-b80a-2dbf2aee7bee req-c7fb6e38-be77-4a9c-af88-28e026484855 service nova] Acquiring lock "0d54f465-6427-4fad-921c-adf51c57a7d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:54:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-09e3c568-7df6-4ffe-b80a-2dbf2aee7bee req-c7fb6e38-be77-4a9c-af88-28e026484855 service nova] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:54:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-09e3c568-7df6-4ffe-b80a-2dbf2aee7bee req-c7fb6e38-be77-4a9c-af88-28e026484855 service nova] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.compute.manager [req-09e3c568-7df6-4ffe-b80a-2dbf2aee7bee req-c7fb6e38-be77-4a9c-af88-28e026484855 service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] No waiting events found dispatching network-vif-plugged-c8bdd057-cfae-4e74-912c-427d5b9f8500 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:54:54 user nova-compute[72150]: WARNING nova.compute.manager [req-09e3c568-7df6-4ffe-b80a-2dbf2aee7bee req-c7fb6e38-be77-4a9c-af88-28e026484855 service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Received unexpected event network-vif-plugged-c8bdd057-cfae-4e74-912c-427d5b9f8500 for instance with vm_state building and task_state spawning.
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:54:54 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:54:54 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8608MB free_disk=25.342815399169922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:54:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:54:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:54:54 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Instance spawned successfully.
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 18:54:54 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690916094.498149, 0d54f465-6427-4fad-921c-adf51c57a7d4 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:54:54 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] VM Started (Lifecycle Event)
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 760ec148-92e3-49a3-93e6-5343f6e6b8c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 71494aab-21cb-49b3-ae94-ae946f259994 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 0d54f465-6427-4fad-921c-adf51c57a7d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:54:54 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 18:54:54 user nova-compute[72150]: INFO nova.compute.manager [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Took 6.29 seconds to spawn the instance on the hypervisor.
Aug 01 18:54:54 user nova-compute[72150]: DEBUG nova.compute.manager [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:54:55 user nova-compute[72150]: INFO nova.compute.manager [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Took 6.87 seconds to build instance.
Aug 01 18:54:55 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:54:55 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:54:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-603fd839-708c-40f6-aebf-cefaedd3607e tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.982s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:54:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:55 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:54:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:54:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:54:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:54:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:54:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:54:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:54:55 user nova-compute[72150]: INFO nova.compute.manager [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Terminating instance
Aug 01 18:54:55 user nova-compute[72150]: DEBUG nova.compute.manager [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-3509d0e5-b37c-411a-bb7d-eaf6459c97b5 req-689ff57b-7769-4366-b58f-e64900a10830 service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Received event network-vif-unplugged-c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3509d0e5-b37c-411a-bb7d-eaf6459c97b5 req-689ff57b-7769-4366-b58f-e64900a10830 service nova] Acquiring lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3509d0e5-b37c-411a-bb7d-eaf6459c97b5 req-689ff57b-7769-4366-b58f-e64900a10830 service nova] Lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-3509d0e5-b37c-411a-bb7d-eaf6459c97b5 req-689ff57b-7769-4366-b58f-e64900a10830 service nova] Lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-3509d0e5-b37c-411a-bb7d-eaf6459c97b5 req-689ff57b-7769-4366-b58f-e64900a10830 service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] No waiting events found dispatching network-vif-unplugged-c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-3509d0e5-b37c-411a-bb7d-eaf6459c97b5 req-689ff57b-7769-4366-b58f-e64900a10830 service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Received event network-vif-unplugged-c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-e52d5995-fd0e-4892-bb7e-16eebb2ba034 req-c228921b-242d-4c49-be86-9ac8e517a549 service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Received event network-changed-c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG nova.compute.manager [req-e52d5995-fd0e-4892-bb7e-16eebb2ba034 req-c228921b-242d-4c49-be86-9ac8e517a549 service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Refreshing instance network info cache due to event network-changed-c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e52d5995-fd0e-4892-bb7e-16eebb2ba034 req-c228921b-242d-4c49-be86-9ac8e517a549 service nova] Acquiring lock "refresh_cache-760ec148-92e3-49a3-93e6-5343f6e6b8c0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e52d5995-fd0e-4892-bb7e-16eebb2ba034 req-c228921b-242d-4c49-be86-9ac8e517a549 service nova] Acquired lock "refresh_cache-760ec148-92e3-49a3-93e6-5343f6e6b8c0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG nova.network.neutron [req-e52d5995-fd0e-4892-bb7e-16eebb2ba034 req-c228921b-242d-4c49-be86-9ac8e517a549 service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Refreshing network info cache for port c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:54:56 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Instance destroyed successfully.
Aug 01 18:54:56 user nova-compute[72150]: DEBUG nova.objects.instance [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lazy-loading 'resources' on Instance uuid 760ec148-92e3-49a3-93e6-5343f6e6b8c0 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:47:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-422576796',display_name='tempest-TestStampPattern-server-422576796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-422576796',id=45,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZy2wVCHd7vEtiOS/HYac+tq78O0CA/dgbnZhwl2N6J70l2eXFgL43fhOucY/uXMm4OefFrQ4HuyqEQUOsD22aJwn95LDZVUWnVjJnV8RCkRBcjCwyi2bzx0ZZbSdwYQA==',key_name='tempest-TestStampPattern-1877833599',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:47:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fca32199d5c458ab4bd52d15c27509b',ramdisk_id='',reservation_id='r-3ghksjfd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-958709342',owner_user_name='tempest-TestStampPattern-958709342-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:50:53Z,user_data=None,user_id='1e18c2b7f1714542bb4f14be70c46194',uuid=760ec148-92e3-49a3-93e6-5343f6e6b8c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "address": "fa:16:3e:e3:ad:06", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ac02e1-ad", "ovs_interfaceid": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Converting VIF {"id": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "address": "fa:16:3e:e3:ad:06", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ac02e1-ad", "ovs_interfaceid": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:ad:06,bridge_name='br-int',has_traffic_filtering=True,id=c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3,network=Network(662f2fa8-b862-434c-bf1f-1804ac5e04ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ac02e1-ad') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG os_vif [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:ad:06,bridge_name='br-int',has_traffic_filtering=True,id=c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3,network=Network(662f2fa8-b862-434c-bf1f-1804ac5e04ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ac02e1-ad') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9ac02e1-ad, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:54:56 user nova-compute[72150]: INFO os_vif [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:ad:06,bridge_name='br-int',has_traffic_filtering=True,id=c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3,network=Network(662f2fa8-b862-434c-bf1f-1804ac5e04ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ac02e1-ad')
Aug 01 18:54:56 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Deleting instance files /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0_del
Aug 01 18:54:56 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Deletion of /opt/stack/data/nova/instances/760ec148-92e3-49a3-93e6-5343f6e6b8c0_del complete
Aug 01 18:54:56 user nova-compute[72150]: INFO nova.compute.manager [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 18:54:56 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:54:56 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:54:57 user nova-compute[72150]: DEBUG nova.network.neutron [req-e52d5995-fd0e-4892-bb7e-16eebb2ba034 req-c228921b-242d-4c49-be86-9ac8e517a549 service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Updated VIF entry in instance network info cache for port c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:54:57 user nova-compute[72150]: DEBUG nova.network.neutron [req-e52d5995-fd0e-4892-bb7e-16eebb2ba034 req-c228921b-242d-4c49-be86-9ac8e517a549 service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Updating instance_info_cache with network_info: [{"id": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "address": "fa:16:3e:e3:ad:06", "network": {"id": "662f2fa8-b862-434c-bf1f-1804ac5e04ae", "bridge": "br-int", "label": "tempest-TestStampPattern-1165407824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fca32199d5c458ab4bd52d15c27509b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ac02e1-ad", "ovs_interfaceid": "c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:54:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-e52d5995-fd0e-4892-bb7e-16eebb2ba034 req-c228921b-242d-4c49-be86-9ac8e517a549 service nova] Releasing lock "refresh_cache-760ec148-92e3-49a3-93e6-5343f6e6b8c0" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:54:57 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:54:57 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Took 0.45 seconds to deallocate network for instance.
Aug 01 18:54:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:54:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:54:57 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:54:57 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:54:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:54:57 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Deleted allocations for instance 760ec148-92e3-49a3-93e6-5343f6e6b8c0
Aug 01 18:54:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-951edde6-a8a1-42a7-9d20-e22402e96d63 req-2f92d7b9-6451-49c3-b91a-6d70e40e047b service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Received event network-vif-deleted-c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:54:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-8c169538-55d0-4070-97c0-cd74a7b47d34 tempest-TestStampPattern-958709342 tempest-TestStampPattern-958709342-project-member] Lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.668s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:54:58 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:54:58 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:54:58 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:54:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-7803675b-2f7e-4c5b-b52a-d5164388f03f req-9acef608-c6d2-4d04-867c-80296ffef328 service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Received event network-vif-plugged-c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:54:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7803675b-2f7e-4c5b-b52a-d5164388f03f req-9acef608-c6d2-4d04-867c-80296ffef328 service nova] Acquiring lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:54:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7803675b-2f7e-4c5b-b52a-d5164388f03f req-9acef608-c6d2-4d04-867c-80296ffef328 service nova] Lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:54:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7803675b-2f7e-4c5b-b52a-d5164388f03f req-9acef608-c6d2-4d04-867c-80296ffef328 service nova] Lock "760ec148-92e3-49a3-93e6-5343f6e6b8c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:54:58 user nova-compute[72150]: DEBUG nova.compute.manager [req-7803675b-2f7e-4c5b-b52a-d5164388f03f req-9acef608-c6d2-4d04-867c-80296ffef328 service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] No waiting events found dispatching network-vif-plugged-c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:54:58 user nova-compute[72150]: WARNING nova.compute.manager [req-7803675b-2f7e-4c5b-b52a-d5164388f03f req-9acef608-c6d2-4d04-867c-80296ffef328 service nova] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Received unexpected event network-vif-plugged-c9ac02e1-adb9-48d2-92b8-cde2f1dfc1a3 for instance with vm_state deleted and task_state None.
Aug 01 18:54:59 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:54:59 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:54:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:55:00 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:55:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:55:03 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:55:03 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:55:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-71494aab-21cb-49b3-ae94-ae946f259994" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:55:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-71494aab-21cb-49b3-ae94-ae946f259994" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:55:03 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:55:04 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Updating instance_info_cache with network_info: [{"id": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "address": "fa:16:3e:8f:ce:21", "network": {"id": "e2bba8d2-db87-47be-8c46-a1667058901b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1639440778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6393ebb3a4f0431ba8f5c276872c1ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41a5bac-da", "ovs_interfaceid": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:55:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-71494aab-21cb-49b3-ae94-ae946f259994" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:55:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:55:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:55:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:55:11 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690916096.7487357, 760ec148-92e3-49a3-93e6-5343f6e6b8c0 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:55:11 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] VM Stopped (Lifecycle Event)
Aug 01 18:55:11 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7e01bc43-a832-4515-800c-5cfbc04e1286 None None] [instance: 760ec148-92e3-49a3-93e6-5343f6e6b8c0] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:55:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:55:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:55:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:55:20 user nova-compute[72150]: DEBUG nova.compute.manager [req-28b77aae-98cc-46c1-a9a6-17a707226883 req-76d29e30-5011-46e7-a480-4d6542cf1997 service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Received event network-changed-a41a5bac-da6d-45af-8bf7-7d24b077697f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:55:20 user nova-compute[72150]: DEBUG nova.compute.manager [req-28b77aae-98cc-46c1-a9a6-17a707226883 req-76d29e30-5011-46e7-a480-4d6542cf1997 service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Refreshing instance network info cache due to event network-changed-a41a5bac-da6d-45af-8bf7-7d24b077697f. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:55:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-28b77aae-98cc-46c1-a9a6-17a707226883 req-76d29e30-5011-46e7-a480-4d6542cf1997 service nova] Acquiring lock "refresh_cache-71494aab-21cb-49b3-ae94-ae946f259994" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:55:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-28b77aae-98cc-46c1-a9a6-17a707226883 req-76d29e30-5011-46e7-a480-4d6542cf1997 service nova] Acquired lock "refresh_cache-71494aab-21cb-49b3-ae94-ae946f259994" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:55:20 user nova-compute[72150]: DEBUG nova.network.neutron [req-28b77aae-98cc-46c1-a9a6-17a707226883 req-76d29e30-5011-46e7-a480-4d6542cf1997 service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Refreshing network info cache for port a41a5bac-da6d-45af-8bf7-7d24b077697f {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:55:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:55:20 user nova-compute[72150]: DEBUG nova.network.neutron [req-28b77aae-98cc-46c1-a9a6-17a707226883 req-76d29e30-5011-46e7-a480-4d6542cf1997 service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Updated VIF entry in instance network info cache for port a41a5bac-da6d-45af-8bf7-7d24b077697f. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:55:20 user nova-compute[72150]: DEBUG nova.network.neutron [req-28b77aae-98cc-46c1-a9a6-17a707226883 req-76d29e30-5011-46e7-a480-4d6542cf1997 service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Updating instance_info_cache with network_info: [{"id": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "address": "fa:16:3e:8f:ce:21", "network": {"id": "e2bba8d2-db87-47be-8c46-a1667058901b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1639440778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6393ebb3a4f0431ba8f5c276872c1ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41a5bac-da", "ovs_interfaceid": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:55:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-28b77aae-98cc-46c1-a9a6-17a707226883 req-76d29e30-5011-46e7-a480-4d6542cf1997 service nova] Releasing lock "refresh_cache-71494aab-21cb-49b3-ae94-ae946f259994" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:55:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Acquiring lock "71494aab-21cb-49b3-ae94-ae946f259994" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:55:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "71494aab-21cb-49b3-ae94-ae946f259994" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:55:20 user nova-compute[72150]: DEBUG nova.objects.instance [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lazy-loading 'flavor' on Instance uuid 71494aab-21cb-49b3-ae94-ae946f259994 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:55:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "71494aab-21cb-49b3-ae94-ae946f259994" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:55:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Acquiring lock "71494aab-21cb-49b3-ae94-ae946f259994" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:55:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "71494aab-21cb-49b3-ae94-ae946f259994" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:55:20 user nova-compute[72150]: INFO nova.compute.manager [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Attaching volume bb2d8820-6283-4c60-8a76-4b04e03ab7ad to /dev/vdb
Aug 01 18:55:20 user nova-compute[72150]: DEBUG os_brick.utils [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:55:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:20 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3036ef-9454-4051-8386-482e145b308b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:20 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfac01cb-f439-492e-ab8f-46a7b5c14aef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8dfd07-afac-48b7-ba68-571044908291]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70d731c-4cf8-4172-bffd-8f5a9853b616]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:55:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:55:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:55:21 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:55:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f208a90e-709b-44d5-a14b-ea952336ec81]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:55:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:55:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:55:21 user nova-compute[72150]: DEBUG os_brick.utils [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:55:21 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Updating existing volume attachment record: f9d2c105-8583-4908-991c-4e4cb55592d0 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:55:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:55:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:55:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLSzodIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:55:28 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:55:28 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:55:28 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc21a7ac-e16d-443f-a207-a8f7a0e9baa0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:55:28 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[084934c2-4cce-4430-9740-624ba0db40da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad] added
Aug 01 18:55:28 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c092ef8a-76d4-45ef-8321-4adc3a0e581e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8043865-5388-4ea3-a544-df5a940c1573]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OLSzodIF {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OLSzodIF" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20346a2-ad51-4ab9-b940-d15189d69c62]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OLSzodIF'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da099ec-c690-48fa-ad43-1bb74e7aa90e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c088c284-f86c-4d5d-a9ba-c85d18f8b8fa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 18:55:28 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 18:55:28 user nova-compute[72150]:  {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:55:28 user nova-compute[72150]: WARNING os_brick.initiator.connectors.iscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 18:55:28 user nova-compute[72150]: 
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a20726a-af44-4925-b2ae-fd503c3eb903]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad, portal: 172.16.0.220,3260]
Aug 01 18:55:28 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad, portal: 172.16.0.220,3260] successful.
Aug 01 18:55:28 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[885e63de-c793-4095-8179-b00d33f25159]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[46785ab5-0f36-40c4-a1f5-9e8f0ee49286]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad (non-flash)
Aug 01 18:55:28 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad (non-flash)
Aug 01 18:55:28 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab2bbe5-3851-4efb-98a1-ba40fe1e9eb3]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:55:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLSzodIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:55:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:55:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23661663961353362', 'path': '/dev/sdb'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:55:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661663961353362', 'path': '/dev/sdb'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:55:29 user nova-compute[72150]: DEBUG nova.objects.instance [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lazy-loading 'flavor' on Instance uuid 71494aab-21cb-49b3-ae94-ae946f259994 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:55:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:55:29 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:55:29 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 18:55:29 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:55:29 user nova-compute[72150]:   <serial>bb2d8820-6283-4c60-8a76-4b04e03ab7ad</serial>
Aug 01 18:55:29 user nova-compute[72150]: </disk>
Aug 01 18:55:29 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:55:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:55:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:55:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:55:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] No VIF found with MAC fa:16:3e:8f:ce:21, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:55:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-17c718ae-032d-42bb-8c43-9986e92a7d98 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "71494aab-21cb-49b3-ae94-ae946f259994" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.487s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:55:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:55:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Acquiring lock "71494aab-21cb-49b3-ae94-ae946f259994" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:55:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "71494aab-21cb-49b3-ae94-ae946f259994" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:55:32 user nova-compute[72150]: DEBUG nova.objects.instance [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lazy-loading 'flavor' on Instance uuid 71494aab-21cb-49b3-ae94-ae946f259994 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:55:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "71494aab-21cb-49b3-ae94-ae946f259994" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:55:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Acquiring lock "71494aab-21cb-49b3-ae94-ae946f259994" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:55:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "71494aab-21cb-49b3-ae94-ae946f259994" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:55:32 user nova-compute[72150]: INFO nova.compute.manager [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Attaching volume efc49a9a-626e-4271-9c03-823efb26abf7 to /dev/vdc
Aug 01 18:55:33 user nova-compute[72150]: DEBUG os_brick.utils [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:55:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac3d416-3a14-4e0d-bfea-333ba354d209]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30d3f8d-f78a-4fd3-ab34-d5d641b827d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c305e9c-558f-4a36-bdea-d39161257735]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[749d76cc-b9ad-4fd8-828b-dcfb3e500b16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:55:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:55:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:55:33 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:55:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[24903c69-6aac-4060-8b6f-78aaea3c7d3f]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:55:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:55:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:55:33 user nova-compute[72150]: DEBUG os_brick.utils [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:55:33 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Updating existing volume attachment record: f6655b5d-1859-4989-84af-5bd3ceacf8a1 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:55:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:55:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRjLbZcy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:55:40 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:55:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:55:40 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:55:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:55:40 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[553f4604-0a8d-4621-9db6-248e0c902299]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:55:40 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd9da49-a5e4-47df-937d-55153fd3ab2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7] added
Aug 01 18:55:40 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[be250484-b2a9-42f1-a75b-8cc800325507]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e724b0-e600-457d-8aa0-cef8864f6e26]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pRjLbZcy {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pRjLbZcy" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb352e7-9780-478a-a142-d95c7c1a1920]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pRjLbZcy'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[413f4eb2-6acc-4ca7-83d0-2287e20f4be6]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2715c8-b242-4935-bd7d-6eb8801bbe4c]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad (non-flash)
Aug 01 18:55:40 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad (non-flash)
Aug 01 18:55:40 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71dc419-3c8e-4bf0-a570-8d71fe0e6376]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7, portal: 172.16.0.220,3260]
Aug 01 18:55:40 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7, portal: 172.16.0.220,3260] successful.
Aug 01 18:55:40 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd123782-34b1-4ea4-aba6-17b2e6b6b57a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5fde69-f6ab-4483-baa5-65eb55ef16bb]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad (non-flash)
Aug 01 18:55:40 user nova-compute[72150]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 (non-flash)
Aug 01 18:55:40 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad (non-flash)
Aug 01 18:55:40 user nova-compute[72150]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 (non-flash)
Aug 01 18:55:40 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b363c82-9395-4ee4-a2ff-14615171f103]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:40 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: None {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:55:41 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:55:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRjLbZcy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:55:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:55:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '26166343063646564', 'path': '/dev/sdc'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:55:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166343063646564', 'path': '/dev/sdc'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:55:41 user nova-compute[72150]: DEBUG nova.objects.instance [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lazy-loading 'flavor' on Instance uuid 71494aab-21cb-49b3-ae94-ae946f259994 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:55:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:55:41 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:55:41 user nova-compute[72150]:   <source dev="/dev/sdc"/>
Aug 01 18:55:41 user nova-compute[72150]:   <target dev="vdc" bus="virtio"/>
Aug 01 18:55:41 user nova-compute[72150]:   <serial>efc49a9a-626e-4271-9c03-823efb26abf7</serial>
Aug 01 18:55:41 user nova-compute[72150]: </disk>
Aug 01 18:55:41 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:55:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:55:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:55:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:55:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:55:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:55:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:55:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:55:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:55:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:55:42 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] No VIF found with MAC fa:16:3e:8f:ce:21, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:55:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-e9f06a35-76b2-4177-83d6-0de0780c99ad tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "71494aab-21cb-49b3-ae94-ae946f259994" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.258s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:55:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Acquiring lock "71494aab-21cb-49b3-ae94-ae946f259994" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:55:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "71494aab-21cb-49b3-ae94-ae946f259994" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:55:42 user nova-compute[72150]: INFO nova.compute.manager [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Detaching volume efc49a9a-626e-4271-9c03-823efb26abf7
Aug 01 18:55:43 user nova-compute[72150]: INFO nova.virt.block_device [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Attempting to driver detach volume efc49a9a-626e-4271-9c03-823efb26abf7 from mountpoint /dev/vdc
Aug 01 18:55:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Attempting to detach device vdc from instance 71494aab-21cb-49b3-ae94-ae946f259994 from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:55:43 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:55:43 user nova-compute[72150]:   <source dev="/dev/sdc"/>
Aug 01 18:55:43 user nova-compute[72150]:   <target dev="vdc" bus="virtio"/>
Aug 01 18:55:43 user nova-compute[72150]:   <serial>efc49a9a-626e-4271-9c03-823efb26abf7</serial>
Aug 01 18:55:43 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 18:55:43 user nova-compute[72150]: </disk>
Aug 01 18:55:43 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:55:43 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Successfully detached device vdc from instance 71494aab-21cb-49b3-ae94-ae946f259994 from the persistent domain config.
Aug 01 18:55:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 71494aab-21cb-49b3-ae94-ae946f259994 from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:55:43 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:55:43 user nova-compute[72150]:   <source dev="/dev/sdc"/>
Aug 01 18:55:43 user nova-compute[72150]:   <target dev="vdc" bus="virtio"/>
Aug 01 18:55:43 user nova-compute[72150]:   <serial>efc49a9a-626e-4271-9c03-823efb26abf7</serial>
Aug 01 18:55:43 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 18:55:43 user nova-compute[72150]: </disk>
Aug 01 18:55:43 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690916143.4770162, 71494aab-21cb-49b3-ae94-ae946f259994 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 71494aab-21cb-49b3-ae94-ae946f259994 {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:55:43 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Successfully detached device vdc from instance 71494aab-21cb-49b3-ae94-ae946f259994 from the live domain config.
Aug 01 18:55:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRjLbZcy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:55:43 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:55:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6775471b-ad6e-45fe-a0c2-9ec1fbb6d279]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[db37c8a8-10ff-48ff-8037-e53c6a655591]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad (non-flash)
Aug 01 18:55:43 user nova-compute[72150]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 (non-flash)
Aug 01 18:55:43 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad (non-flash)
Aug 01 18:55:43 user nova-compute[72150]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 (non-flash)
Aug 01 18:55:43 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c48e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7'): ({'sdc'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Removing single pathed devices sdc {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[922ceea9-2731-4285-8a92-f825f704d38c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e9e057-0afa-48dd-babb-ac9690c7e8f7]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Flushing IO for device /dev/sdc {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fda9f99-a107-4f33-8b08-4e2be6237db7]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba4114d-bb38-4aed-aa3b-84e08458827f]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] SCSI volumes sdc have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87318d4-2987-4fac-8f80-a777a5f9368f]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff7db9e-4914-46d8-8fdc-ca5ad85b64b4]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7, portal: 172.16.0.220,3260]
Aug 01 18:55:43 user nova-compute[72150]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7, portal: 172.16.0.220,3260] successful.
Aug 01 18:55:43 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efc49a9a-626e-4271-9c03-823efb26abf7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e84dee0-f944-480d-b130-a5ae8d8e935c]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] <== disconnect_volume: return (279ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:55:43 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:55:44 user nova-compute[72150]: DEBUG nova.objects.instance [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lazy-loading 'flavor' on Instance uuid 71494aab-21cb-49b3-ae94-ae946f259994 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:55:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7bfa8a9b-0ccf-46fc-a085-833d3e53d614 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "71494aab-21cb-49b3-ae94-ae946f259994" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.654s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:55:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:55:46 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:55:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:55:51 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:55:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:55:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:55:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:55:51 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:55:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:55:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:55:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 18:55:52 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:55:52 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:55:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8616MB free_disk=25.34029769897461GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:55:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:55:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:55:53 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 71494aab-21cb-49b3-ae94-ae946f259994 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:55:53 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 0d54f465-6427-4fad-921c-adf51c57a7d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:55:53 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:55:53 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:55:53 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:55:53 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:55:53 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:55:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:55:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:55:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:55:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:55:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:55:57 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:55:57 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:55:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:55:59 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:55:59 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:55:59 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:55:59 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:56:01 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:56:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:56:04 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:56:05 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:56:05 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:56:05 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 18:56:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-71494aab-21cb-49b3-ae94-ae946f259994" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:56:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-71494aab-21cb-49b3-ae94-ae946f259994" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:56:05 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:56:05 user nova-compute[72150]: DEBUG nova.objects.instance [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lazy-loading 'info_cache' on Instance uuid 71494aab-21cb-49b3-ae94-ae946f259994 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:56:06 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Updating instance_info_cache with network_info: [{"id": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "address": "fa:16:3e:8f:ce:21", "network": {"id": "e2bba8d2-db87-47be-8c46-a1667058901b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1639440778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6393ebb3a4f0431ba8f5c276872c1ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41a5bac-da", "ovs_interfaceid": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:56:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-71494aab-21cb-49b3-ae94-ae946f259994" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:56:06 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:56:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:56:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:56:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:56:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:56:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:56:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:56:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Acquiring lock "71494aab-21cb-49b3-ae94-ae946f259994" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:56:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "71494aab-21cb-49b3-ae94-ae946f259994" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:56:33 user nova-compute[72150]: INFO nova.compute.manager [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Detaching volume bb2d8820-6283-4c60-8a76-4b04e03ab7ad
Aug 01 18:56:33 user nova-compute[72150]: INFO nova.virt.block_device [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Attempting to driver detach volume bb2d8820-6283-4c60-8a76-4b04e03ab7ad from mountpoint /dev/vdb
Aug 01 18:56:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Attempting to detach device vdb from instance 71494aab-21cb-49b3-ae94-ae946f259994 from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:56:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:56:33 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:56:33 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 18:56:33 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:56:33 user nova-compute[72150]:   <serial>bb2d8820-6283-4c60-8a76-4b04e03ab7ad</serial>
Aug 01 18:56:33 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:56:33 user nova-compute[72150]: </disk>
Aug 01 18:56:33 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:56:33 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Successfully detached device vdb from instance 71494aab-21cb-49b3-ae94-ae946f259994 from the persistent domain config.
Aug 01 18:56:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 71494aab-21cb-49b3-ae94-ae946f259994 from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:56:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:56:33 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:56:33 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 18:56:33 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:56:33 user nova-compute[72150]:   <serial>bb2d8820-6283-4c60-8a76-4b04e03ab7ad</serial>
Aug 01 18:56:33 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:56:33 user nova-compute[72150]: </disk>
Aug 01 18:56:33 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690916194.0395358, 71494aab-21cb-49b3-ae94-ae946f259994 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 71494aab-21cb-49b3-ae94-ae946f259994 {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:56:34 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Successfully detached device vdb from instance 71494aab-21cb-49b3-ae94-ae946f259994 from the live domain config.
Aug 01 18:56:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLSzodIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:56:34 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:56:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fe099e-b7c2-4c49-930c-13d18d57c455]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[26507858-f6a2-4dea-94a1-f85e336e4676]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad (non-flash)
Aug 01 18:56:34 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad (non-flash)
Aug 01 18:56:34 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4710c16b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad'): ({'sdb'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Removing single pathed devices sdb {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdbe750-1a54-438b-8506-1cbbd16898a6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8642a19c-b1bb-48ba-8dfd-90a0de2b6c1d]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Flushing IO for device /dev/sdb {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7650cb-fcd4-409f-88dc-1f3e66901d9a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e27490d-fe1e-4384-8af7-791ac0b3478a]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3f0f6b-8e74-47cf-9b87-2f0e535569be]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[76048789-3f08-42b1-9ec5-da2bab47b95d]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad, portal: 172.16.0.220,3260]
Aug 01 18:56:34 user nova-compute[72150]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad, portal: 172.16.0.220,3260] successful.
Aug 01 18:56:34 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d8820-6283-4c60-8a76-4b04e03ab7ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27eb9fd-2315-45f0-ad96-2d61a1502080]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.229s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] <== disconnect_volume: return (230ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:56:34 user nova-compute[72150]: DEBUG nova.objects.instance [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lazy-loading 'flavor' on Instance uuid 71494aab-21cb-49b3-ae94-ae946f259994 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:56:35 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d21761f5-fb63-48c6-92e8-2349e2361567 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "71494aab-21cb-49b3-ae94-ae946f259994" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.523s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:56:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:56:39 user nova-compute[72150]: DEBUG nova.compute.manager [req-a08e4730-2f59-4045-9f12-7b6b9cf79c71 req-3b384a45-1c25-4b75-8a7b-fe2bcdd72a25 service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Received event network-changed-c8bdd057-cfae-4e74-912c-427d5b9f8500 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:56:39 user nova-compute[72150]: DEBUG nova.compute.manager [req-a08e4730-2f59-4045-9f12-7b6b9cf79c71 req-3b384a45-1c25-4b75-8a7b-fe2bcdd72a25 service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Refreshing instance network info cache due to event network-changed-c8bdd057-cfae-4e74-912c-427d5b9f8500. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 18:56:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a08e4730-2f59-4045-9f12-7b6b9cf79c71 req-3b384a45-1c25-4b75-8a7b-fe2bcdd72a25 service nova] Acquiring lock "refresh_cache-0d54f465-6427-4fad-921c-adf51c57a7d4" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:56:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a08e4730-2f59-4045-9f12-7b6b9cf79c71 req-3b384a45-1c25-4b75-8a7b-fe2bcdd72a25 service nova] Acquired lock "refresh_cache-0d54f465-6427-4fad-921c-adf51c57a7d4" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:56:39 user nova-compute[72150]: DEBUG nova.network.neutron [req-a08e4730-2f59-4045-9f12-7b6b9cf79c71 req-3b384a45-1c25-4b75-8a7b-fe2bcdd72a25 service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Refreshing network info cache for port c8bdd057-cfae-4e74-912c-427d5b9f8500 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 18:56:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:56:40 user nova-compute[72150]: DEBUG nova.network.neutron [req-a08e4730-2f59-4045-9f12-7b6b9cf79c71 req-3b384a45-1c25-4b75-8a7b-fe2bcdd72a25 service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Updated VIF entry in instance network info cache for port c8bdd057-cfae-4e74-912c-427d5b9f8500. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 18:56:40 user nova-compute[72150]: DEBUG nova.network.neutron [req-a08e4730-2f59-4045-9f12-7b6b9cf79c71 req-3b384a45-1c25-4b75-8a7b-fe2bcdd72a25 service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Updating instance_info_cache with network_info: [{"id": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "address": "fa:16:3e:49:d1:c8", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8bdd057-cf", "ovs_interfaceid": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:56:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a08e4730-2f59-4045-9f12-7b6b9cf79c71 req-3b384a45-1c25-4b75-8a7b-fe2bcdd72a25 service nova] Releasing lock "refresh_cache-0d54f465-6427-4fad-921c-adf51c57a7d4" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:56:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "0d54f465-6427-4fad-921c-adf51c57a7d4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG nova.objects.instance [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'flavor' on Instance uuid 0d54f465-6427-4fad-921c-adf51c57a7d4 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "0d54f465-6427-4fad-921c-adf51c57a7d4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:56:43 user nova-compute[72150]: INFO nova.compute.manager [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Attaching volume 890cb30b-f802-424d-913b-1a7e70202fca to /dev/vdb
Aug 01 18:56:43 user nova-compute[72150]: DEBUG os_brick.utils [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a9b239-c8bc-4a4e-97a9-fd637fb7c1a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfc6ec4-ee51-455b-ba44-3a6efeaf9a59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb280f8-b0f8-4381-8663-fead5ed3c779]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20a2f02-1e1c-4295-90c5-5e3f4c16c8ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:56:43 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:56:43 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d26f4f-5e42-4cc9-97ee-e2e57ed96e04]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG os_brick.utils [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:56:43 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Updating existing volume attachment record: 11335321-6fec-4a93-b7f4-fa651f990fd6 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:56:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:56:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:56:48 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GikaXdAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:56:50 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:56:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:56:50 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:56:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:56:50 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a49449e-f2d6-4992-a418-2d2f38bb7c06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:56:50 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10dcdfd-6928-4e4d-9089-63f92c0843fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca] added
Aug 01 18:56:50 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad03042-710d-419f-94e2-0a1d56a05f7e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[765b39e4-29a7-4713-8048-80c65560abb0]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GikaXdAF {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GikaXdAF" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02c5bb1-9029-4af9-9b4b-b68425034f71]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GikaXdAF'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[34aa66da-3b17-41c9-b876-a85aa9149e0c]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c01ffbd-73ad-4b62-96ee-8170d1e6458b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 18:56:50 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 18:56:50 user nova-compute[72150]:  {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:56:50 user nova-compute[72150]: WARNING os_brick.initiator.connectors.iscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 18:56:50 user nova-compute[72150]: 
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecaa3a1-9b4d-4cb9-bd76-f2d79de89042]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca, portal: 172.16.0.220,3260]
Aug 01 18:56:50 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca, portal: 172.16.0.220,3260] successful.
Aug 01 18:56:50 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad7eced-1f5b-4818-9439-33ba7ade6567]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded478c5-9a7e-4b43-8777-8d7751d270c5]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca (non-flash)
Aug 01 18:56:50 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca (non-flash)
Aug 01 18:56:50 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[540417b2-8a74-45b8-9f9c-19b20d9b508d]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:50 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:56:51 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:56:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:56:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:56:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:56:51 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:56:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:56:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:51 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:56:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GikaXdAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:56:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:56:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23935383264363239', 'path': '/dev/sdb'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:56:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935383264363239', 'path': '/dev/sdb'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:56:51 user nova-compute[72150]: DEBUG nova.objects.instance [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'flavor' on Instance uuid 0d54f465-6427-4fad-921c-adf51c57a7d4 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:56:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:56:52 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:56:52 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 18:56:52 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:56:52 user nova-compute[72150]:   <serial>890cb30b-f802-424d-913b-1a7e70202fca</serial>
Aug 01 18:56:52 user nova-compute[72150]: </disk>
Aug 01 18:56:52 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:56:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:52 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:52 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:56:52 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:56:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8689MB free_disk=25.331104278564453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:56:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:56:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:56:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:56:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:56:52 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] No VIF found with MAC fa:16:3e:49:d1:c8, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:56:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 71494aab-21cb-49b3-ae94-ae946f259994 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:56:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 0d54f465-6427-4fad-921c-adf51c57a7d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 18:56:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:56:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:56:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b5da12ce-e0be-4a72-b543-9e777899f4b6 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.510s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:56:53 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:56:53 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:56:53 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:56:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:56:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:56:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:56:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "0d54f465-6427-4fad-921c-adf51c57a7d4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:56:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:56:56 user nova-compute[72150]: DEBUG nova.objects.instance [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'flavor' on Instance uuid 0d54f465-6427-4fad-921c-adf51c57a7d4 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "0d54f465-6427-4fad-921c-adf51c57a7d4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:56:57 user nova-compute[72150]: INFO nova.compute.manager [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Attaching volume b7da97c9-f601-48f7-97b8-040a9b2c74d7 to /dev/vdc
Aug 01 18:56:57 user nova-compute[72150]: DEBUG os_brick.utils [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e2b9aa-39c3-46d9-8c5f-a59c5816eb56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e947335-3b02-48fa-9638-367a06402214]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbc34d1-70c7-4e14-bf5c-d2dc753a0d8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3757bfe6-709b-4fb3-beab-1fdcff93c819]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 18:56:57 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 18:56:57 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd47283e-e7b7-4158-beb2-ef85ed969291]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG os_brick.utils [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:56:57 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Updating existing volume attachment record: 1f55b5d3-2692-4672-a941-4c4a126dd36f {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 18:56:58 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:56:58 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:57:00 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:57:00 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:57:00 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:57:00 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:57:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:57:03 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxrlgbXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:57:04 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:57:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:57:04 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:57:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:57:04 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb97f143-c0ce-453f-9ffb-db7eb4b9b244]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 18:57:04 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96c2b01-8dd5-4aa9-8900-858e70440352]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7] added
Aug 01 18:57:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c01b433-8fe1-4c26-98a9-979008fe181e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de09b70-bada-426c-97ea-0ecac5640e32]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fxrlgbXA {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fxrlgbXA" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4371374b-29cd-4565-b5ee-93d055c81064]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fxrlgbXA'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa9ad75-5426-40ef-a4d7-83413bb17b0b]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05b001b-31e1-4072-a416-5324d6631572]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca (non-flash)
Aug 01 18:57:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca (non-flash)
Aug 01 18:57:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[35846d16-6aec-46c3-beca-8bb9e51f3fdf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7, portal: 172.16.0.220,3260]
Aug 01 18:57:04 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7, portal: 172.16.0.220,3260] successful.
Aug 01 18:57:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b241d829-d5ef-48d5-a979-e5450d769d1a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4ec6e6-0ddc-4404-a94c-482e6eea8336]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca (non-flash)
Aug 01 18:57:04 user nova-compute[72150]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 (non-flash)
Aug 01 18:57:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca (non-flash)
Aug 01 18:57:04 user nova-compute[72150]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 (non-flash)
Aug 01 18:57:04 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f5ee88-6cc5-41e0-8683-6067c0fc692e]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:04 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:57:05 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 18:57:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxrlgbXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 18:57:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:57:05 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26161663963393763', 'path': '/dev/sdc'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:57:05 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161663963393763', 'path': '/dev/sdc'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 18:57:05 user nova-compute[72150]: DEBUG nova.objects.instance [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'flavor' on Instance uuid 0d54f465-6427-4fad-921c-adf51c57a7d4 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:57:05 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 18:57:05 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:57:05 user nova-compute[72150]:   <source dev="/dev/sdc"/>
Aug 01 18:57:05 user nova-compute[72150]:   <target dev="vdc" bus="virtio"/>
Aug 01 18:57:05 user nova-compute[72150]:   <serial>b7da97c9-f601-48f7-97b8-040a9b2c74d7</serial>
Aug 01 18:57:05 user nova-compute[72150]: </disk>
Aug 01 18:57:05 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 18:57:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:57:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:57:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 18:57:06 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] No VIF found with MAC fa:16:3e:49:d1:c8, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 18:57:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-3ca47215-76cf-45f9-8ca7-c6c06da20622 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.509s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:57:06 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:57:06 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:57:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-0d54f465-6427-4fad-921c-adf51c57a7d4" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 18:57:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-0d54f465-6427-4fad-921c-adf51c57a7d4" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 18:57:06 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "0d54f465-6427-4fad-921c-adf51c57a7d4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:57:07 user nova-compute[72150]: INFO nova.compute.manager [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Detaching volume 890cb30b-f802-424d-913b-1a7e70202fca
Aug 01 18:57:07 user nova-compute[72150]: INFO nova.virt.block_device [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Attempting to driver detach volume 890cb30b-f802-424d-913b-1a7e70202fca from mountpoint /dev/vdb
Aug 01 18:57:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Attempting to detach device vdb from instance 0d54f465-6427-4fad-921c-adf51c57a7d4 from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:57:07 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:57:07 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 18:57:07 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:57:07 user nova-compute[72150]:   <serial>890cb30b-f802-424d-913b-1a7e70202fca</serial>
Aug 01 18:57:07 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:57:07 user nova-compute[72150]: </disk>
Aug 01 18:57:07 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:57:07 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Successfully detached device vdb from instance 0d54f465-6427-4fad-921c-adf51c57a7d4 from the persistent domain config.
Aug 01 18:57:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0d54f465-6427-4fad-921c-adf51c57a7d4 from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:57:07 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:57:07 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 18:57:07 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 18:57:07 user nova-compute[72150]:   <serial>890cb30b-f802-424d-913b-1a7e70202fca</serial>
Aug 01 18:57:07 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 18:57:07 user nova-compute[72150]: </disk>
Aug 01 18:57:07 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Updating instance_info_cache with network_info: [{"id": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "address": "fa:16:3e:49:d1:c8", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8bdd057-cf", "ovs_interfaceid": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-0d54f465-6427-4fad-921c-adf51c57a7d4" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690916227.779372, 0d54f465-6427-4fad-921c-adf51c57a7d4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0d54f465-6427-4fad-921c-adf51c57a7d4 {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:57:07 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Successfully detached device vdb from instance 0d54f465-6427-4fad-921c-adf51c57a7d4 from the live domain config.
Aug 01 18:57:07 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GikaXdAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:57:07 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:57:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c12ea40-6751-4a85-b0b5-f80a8e318596]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c528ea12-8a9a-4715-b232-2d3535e014a3]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca (non-flash)
Aug 01 18:57:07 user nova-compute[72150]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 (non-flash)
Aug 01 18:57:07 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca (non-flash)
Aug 01 18:57:07 user nova-compute[72150]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 (non-flash)
Aug 01 18:57:07 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c48e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca'): ({'sdb'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Removing single pathed devices sdb {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8adcfb-ce70-4e21-9336-e7af927412c9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74022c4-d41d-4ac1-a3f8-dc3fe3a8b560]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Flushing IO for device /dev/sdb {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0797d945-a4d3-4f4b-81db-31c4cf3d80a6]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f37bf8-78b6-472b-a3d7-6ea34336b072]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf48920c-ecc8-4730-8f26-3e082cf85367]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:57:07 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:08 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9948ae-cc56-4965-927f-6eca90bbec04]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:08 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca, portal: 172.16.0.220,3260]
Aug 01 18:57:08 user nova-compute[72150]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca, portal: 172.16.0.220,3260] successful.
Aug 01 18:57:08 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:57:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:08 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890cb30b-f802-424d-913b-1a7e70202fca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:08 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dab42a-9868-4eb5-bc8c-3278ec06ca6d]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:08 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:57:08 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:57:08 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] <== disconnect_volume: return (270ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:57:08 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:57:08 user nova-compute[72150]: DEBUG nova.objects.instance [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'flavor' on Instance uuid 0d54f465-6427-4fad-921c-adf51c57a7d4 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:57:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-257ca3bf-4134-4473-8659-d3ce70b24269 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.567s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:57:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "0d54f465-6427-4fad-921c-adf51c57a7d4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:57:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:57:09 user nova-compute[72150]: INFO nova.compute.manager [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Detaching volume b7da97c9-f601-48f7-97b8-040a9b2c74d7
Aug 01 18:57:09 user nova-compute[72150]: INFO nova.virt.block_device [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Attempting to driver detach volume b7da97c9-f601-48f7-97b8-040a9b2c74d7 from mountpoint /dev/vdc
Aug 01 18:57:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Attempting to detach device vdc from instance 0d54f465-6427-4fad-921c-adf51c57a7d4 from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 18:57:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:57:09 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:57:09 user nova-compute[72150]:   <source dev="/dev/sdc"/>
Aug 01 18:57:09 user nova-compute[72150]:   <target dev="vdc" bus="virtio"/>
Aug 01 18:57:09 user nova-compute[72150]:   <serial>b7da97c9-f601-48f7-97b8-040a9b2c74d7</serial>
Aug 01 18:57:09 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 18:57:09 user nova-compute[72150]: </disk>
Aug 01 18:57:09 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:57:09 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Successfully detached device vdc from instance 0d54f465-6427-4fad-921c-adf51c57a7d4 from the persistent domain config.
Aug 01 18:57:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0d54f465-6427-4fad-921c-adf51c57a7d4 from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 18:57:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 18:57:09 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 18:57:09 user nova-compute[72150]:   <source dev="/dev/sdc"/>
Aug 01 18:57:09 user nova-compute[72150]:   <target dev="vdc" bus="virtio"/>
Aug 01 18:57:09 user nova-compute[72150]:   <serial>b7da97c9-f601-48f7-97b8-040a9b2c74d7</serial>
Aug 01 18:57:09 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 18:57:09 user nova-compute[72150]: </disk>
Aug 01 18:57:09 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690916230.2155602, 0d54f465-6427-4fad-921c-adf51c57a7d4 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0d54f465-6427-4fad-921c-adf51c57a7d4 {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 18:57:10 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Successfully detached device vdc from instance 0d54f465-6427-4fad-921c-adf51c57a7d4 from the live domain config.
Aug 01 18:57:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxrlgbXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 18:57:10 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 18:57:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21f3b86-0710-45f2-8e5e-afd283ee9491]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0017dc2d-fcd6-4460-ac7b-311635e9d9e1]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 (non-flash)
Aug 01 18:57:10 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 (non-flash)
Aug 01 18:57:10 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec44e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7'): ({'sdc'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Removing single pathed devices sdc {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fbc707-091a-4070-bc11-f17a7abb1d35]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[52292728-ad3f-431f-ac00-6352f3cd755b]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Flushing IO for device /dev/sdc {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93252d1-a455-4269-8137-3a532dad9a8c]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[86015882-9bda-453e-973c-41788b0368bb]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] SCSI volumes sdc have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5d7df1-e459-468b-b8ad-1dc7001138de]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfc6ff3-48ad-4b44-aa6f-1a8417d86433]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7, portal: 172.16.0.220,3260]
Aug 01 18:57:10 user nova-compute[72150]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7, portal: 172.16.0.220,3260] successful.
Aug 01 18:57:10 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7da97c9-f601-48f7-97b8-040a9b2c74d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6b192c-2a48-47a1-9b40-3acbe4c65f68]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] <== disconnect_volume: return (262ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 18:57:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 18:57:11 user nova-compute[72150]: DEBUG nova.objects.instance [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'flavor' on Instance uuid 0d54f465-6427-4fad-921c-adf51c57a7d4 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:57:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d92e994a-43b8-45e0-be4b-a13683fd5598 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.795s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:57:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "0d54f465-6427-4fad-921c-adf51c57a7d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:57:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:57:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "0d54f465-6427-4fad-921c-adf51c57a7d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:57:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:57:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:57:12 user nova-compute[72150]: INFO nova.compute.manager [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Terminating instance
Aug 01 18:57:12 user nova-compute[72150]: DEBUG nova.compute.manager [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:57:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:12 user nova-compute[72150]: DEBUG nova.compute.manager [req-5249d325-bae8-4f60-a518-53629bc4006e req-ba948324-dd45-4973-ba18-1aed82e5a008 service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Received event network-vif-unplugged-c8bdd057-cfae-4e74-912c-427d5b9f8500 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:57:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5249d325-bae8-4f60-a518-53629bc4006e req-ba948324-dd45-4973-ba18-1aed82e5a008 service nova] Acquiring lock "0d54f465-6427-4fad-921c-adf51c57a7d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:57:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5249d325-bae8-4f60-a518-53629bc4006e req-ba948324-dd45-4973-ba18-1aed82e5a008 service nova] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:57:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-5249d325-bae8-4f60-a518-53629bc4006e req-ba948324-dd45-4973-ba18-1aed82e5a008 service nova] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:57:12 user nova-compute[72150]: DEBUG nova.compute.manager [req-5249d325-bae8-4f60-a518-53629bc4006e req-ba948324-dd45-4973-ba18-1aed82e5a008 service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] No waiting events found dispatching network-vif-unplugged-c8bdd057-cfae-4e74-912c-427d5b9f8500 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:57:12 user nova-compute[72150]: DEBUG nova.compute.manager [req-5249d325-bae8-4f60-a518-53629bc4006e req-ba948324-dd45-4973-ba18-1aed82e5a008 service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Received event network-vif-unplugged-c8bdd057-cfae-4e74-912c-427d5b9f8500 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:57:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:13 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Instance destroyed successfully.
Aug 01 18:57:13 user nova-compute[72150]: DEBUG nova.objects.instance [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lazy-loading 'resources' on Instance uuid 0d54f465-6427-4fad-921c-adf51c57a7d4 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:57:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-705744707',display_name='tempest-AttachVolumeTestJSON-server-705744707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-705744707',id=50,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdBc6je6mHCm0hJe+fO3964m4BW411fBODwSJ2g+Letg20Px78nEvRWTm9ItNRHG0FmdxuHRIpWQmFEJiJ4OFmpMqVOeMsoRYmVZTmglZvVOY3v1mIBGZt5Eu9D0W8DLw==',key_name='tempest-keypair-1648075596',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:54:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac704a033c8b46328eeda139cd57a3aa',ramdisk_id='',reservation_id='r-8rxq74um',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-961178577',owner_user_name='tempest-AttachVolumeTestJSON-961178577-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:54:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='237fb5b4bd184868a610aaea2766fa0d',uuid=0d54f465-6427-4fad-921c-adf51c57a7d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "address": "fa:16:3e:49:d1:c8", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8bdd057-cf", "ovs_interfaceid": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:57:13 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converting VIF {"id": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "address": "fa:16:3e:49:d1:c8", "network": {"id": "aa68ef85-033c-4473-8a2d-0be84e09867e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1999948565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac704a033c8b46328eeda139cd57a3aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8bdd057-cf", "ovs_interfaceid": "c8bdd057-cfae-4e74-912c-427d5b9f8500", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:57:13 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:d1:c8,bridge_name='br-int',has_traffic_filtering=True,id=c8bdd057-cfae-4e74-912c-427d5b9f8500,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8bdd057-cf') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:57:13 user nova-compute[72150]: DEBUG os_vif [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:d1:c8,bridge_name='br-int',has_traffic_filtering=True,id=c8bdd057-cfae-4e74-912c-427d5b9f8500,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8bdd057-cf') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:57:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8bdd057-cf, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:57:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:57:13 user nova-compute[72150]: INFO os_vif [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:d1:c8,bridge_name='br-int',has_traffic_filtering=True,id=c8bdd057-cfae-4e74-912c-427d5b9f8500,network=Network(aa68ef85-033c-4473-8a2d-0be84e09867e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8bdd057-cf')
Aug 01 18:57:13 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Deleting instance files /opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4_del
Aug 01 18:57:13 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Deletion of /opt/stack/data/nova/instances/0d54f465-6427-4fad-921c-adf51c57a7d4_del complete
Aug 01 18:57:13 user nova-compute[72150]: INFO nova.compute.manager [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 18:57:13 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:57:13 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:57:13 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:57:14 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:57:14 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Took 0.99 seconds to deallocate network for instance.
Aug 01 18:57:14 user nova-compute[72150]: DEBUG nova.compute.manager [req-4c3b2b19-0d56-41b1-a606-7c413a6a846e req-8dbaea3a-53cd-4517-8223-73f78130d254 service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Received event network-vif-deleted-c8bdd057-cfae-4e74-912c-427d5b9f8500 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:57:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:57:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:57:14 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:57:14 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:57:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:57:14 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Deleted allocations for instance 0d54f465-6427-4fad-921c-adf51c57a7d4
Aug 01 18:57:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-6622579c-a364-4c11-b163-a092233a9462 tempest-AttachVolumeTestJSON-961178577 tempest-AttachVolumeTestJSON-961178577-project-member] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.236s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:57:14 user nova-compute[72150]: DEBUG nova.compute.manager [req-7f15ae70-7f8c-4b3f-8b36-af523bc1ce42 req-e71d56eb-7505-4be0-bb6c-7e9b18d2eb0d service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Received event network-vif-plugged-c8bdd057-cfae-4e74-912c-427d5b9f8500 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:57:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7f15ae70-7f8c-4b3f-8b36-af523bc1ce42 req-e71d56eb-7505-4be0-bb6c-7e9b18d2eb0d service nova] Acquiring lock "0d54f465-6427-4fad-921c-adf51c57a7d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:57:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7f15ae70-7f8c-4b3f-8b36-af523bc1ce42 req-e71d56eb-7505-4be0-bb6c-7e9b18d2eb0d service nova] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:57:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7f15ae70-7f8c-4b3f-8b36-af523bc1ce42 req-e71d56eb-7505-4be0-bb6c-7e9b18d2eb0d service nova] Lock "0d54f465-6427-4fad-921c-adf51c57a7d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:57:14 user nova-compute[72150]: DEBUG nova.compute.manager [req-7f15ae70-7f8c-4b3f-8b36-af523bc1ce42 req-e71d56eb-7505-4be0-bb6c-7e9b18d2eb0d service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] No waiting events found dispatching network-vif-plugged-c8bdd057-cfae-4e74-912c-427d5b9f8500 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:57:14 user nova-compute[72150]: WARNING nova.compute.manager [req-7f15ae70-7f8c-4b3f-8b36-af523bc1ce42 req-e71d56eb-7505-4be0-bb6c-7e9b18d2eb0d service nova] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Received unexpected event network-vif-plugged-c8bdd057-cfae-4e74-912c-427d5b9f8500 for instance with vm_state deleted and task_state None.
Aug 01 18:57:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:21 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:57:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:57:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:57:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:57:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:57:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:57:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:57:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Verify base images {{(pid=72150) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 01 18:57:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Image id dbc6b740-0555-4041-80f6-323ecd1d67db yields fingerprint 9509017e0dbd9a8276203b492c7ed023c7003d3c {{(pid=72150) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 01 18:57:21 user nova-compute[72150]: INFO nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] image dbc6b740-0555-4041-80f6-323ecd1d67db at (/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c): checking
Aug 01 18:57:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] image dbc6b740-0555-4041-80f6-323ecd1d67db at (/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c): image is in use {{(pid=72150) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 01 18:57:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72150) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 01 18:57:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] 71494aab-21cb-49b3-ae94-ae946f259994 is a valid instance name {{(pid=72150) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 01 18:57:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] 71494aab-21cb-49b3-ae94-ae946f259994 has a disk file {{(pid=72150) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 01 18:57:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 18:57:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 18:57:21 user nova-compute[72150]: DEBUG nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 71494aab-21cb-49b3-ae94-ae946f259994 is backed by 9509017e0dbd9a8276203b492c7ed023c7003d3c {{(pid=72150) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 01 18:57:21 user nova-compute[72150]: WARNING nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Unknown base file: /opt/stack/data/nova/instances/_base/09a1e306902c6d883d3e37533a2be245ab064bf6
Aug 01 18:57:21 user nova-compute[72150]: WARNING nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Unknown base file: /opt/stack/data/nova/instances/_base/49572197531b3fda7c0e699167df4e97b908aabe
Aug 01 18:57:21 user nova-compute[72150]: WARNING nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1f4244bd4e4c319d80d9307e030539d056aecc5f
Aug 01 18:57:22 user nova-compute[72150]: WARNING nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Unknown base file: /opt/stack/data/nova/instances/_base/eb53f5de263f6d28434dc20e4eb40a1e8dbb857a
Aug 01 18:57:22 user nova-compute[72150]: WARNING nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Unknown base file: /opt/stack/data/nova/instances/_base/58db76b0e1ae0f99284eea7f6d1ccd0da95d5bb1
Aug 01 18:57:22 user nova-compute[72150]: WARNING nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cf5630a205e6f5e5a33659f87211df460a806f2f
Aug 01 18:57:22 user nova-compute[72150]: WARNING nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0d606c56db554d538ad71883838d9113680faeff
Aug 01 18:57:22 user nova-compute[72150]: WARNING nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2fe7780b7a6600f31bd755b49234b12368c632ac
Aug 01 18:57:22 user nova-compute[72150]: WARNING nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ff3095af49283453dfdc33c726eb23271b1b8f04
Aug 01 18:57:22 user nova-compute[72150]: INFO nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Active base files: /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c
Aug 01 18:57:22 user nova-compute[72150]: INFO nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Removable base files: /opt/stack/data/nova/instances/_base/09a1e306902c6d883d3e37533a2be245ab064bf6 /opt/stack/data/nova/instances/_base/49572197531b3fda7c0e699167df4e97b908aabe /opt/stack/data/nova/instances/_base/1f4244bd4e4c319d80d9307e030539d056aecc5f /opt/stack/data/nova/instances/_base/eb53f5de263f6d28434dc20e4eb40a1e8dbb857a /opt/stack/data/nova/instances/_base/58db76b0e1ae0f99284eea7f6d1ccd0da95d5bb1 /opt/stack/data/nova/instances/_base/cf5630a205e6f5e5a33659f87211df460a806f2f /opt/stack/data/nova/instances/_base/0d606c56db554d538ad71883838d9113680faeff /opt/stack/data/nova/instances/_base/2fe7780b7a6600f31bd755b49234b12368c632ac /opt/stack/data/nova/instances/_base/ff3095af49283453dfdc33c726eb23271b1b8f04
Aug 01 18:57:22 user nova-compute[72150]: INFO nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/09a1e306902c6d883d3e37533a2be245ab064bf6
Aug 01 18:57:22 user nova-compute[72150]: INFO nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/49572197531b3fda7c0e699167df4e97b908aabe
Aug 01 18:57:22 user nova-compute[72150]: INFO nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1f4244bd4e4c319d80d9307e030539d056aecc5f
Aug 01 18:57:22 user nova-compute[72150]: INFO nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/eb53f5de263f6d28434dc20e4eb40a1e8dbb857a
Aug 01 18:57:22 user nova-compute[72150]: INFO nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/58db76b0e1ae0f99284eea7f6d1ccd0da95d5bb1
Aug 01 18:57:22 user nova-compute[72150]: INFO nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cf5630a205e6f5e5a33659f87211df460a806f2f
Aug 01 18:57:22 user nova-compute[72150]: INFO nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0d606c56db554d538ad71883838d9113680faeff
Aug 01 18:57:22 user nova-compute[72150]: INFO nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2fe7780b7a6600f31bd755b49234b12368c632ac
Aug 01 18:57:22 user nova-compute[72150]: INFO nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ff3095af49283453dfdc33c726eb23271b1b8f04
Aug 01 18:57:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Verification complete {{(pid=72150) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 01 18:57:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Verify swap images {{(pid=72150) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 01 18:57:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.imagecache [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Verify ephemeral images {{(pid=72150) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 01 18:57:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:57:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Acquiring lock "71494aab-21cb-49b3-ae94-ae946f259994" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:57:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "71494aab-21cb-49b3-ae94-ae946f259994" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:57:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Acquiring lock "71494aab-21cb-49b3-ae94-ae946f259994-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:57:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "71494aab-21cb-49b3-ae94-ae946f259994-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:57:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "71494aab-21cb-49b3-ae94-ae946f259994-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:57:23 user nova-compute[72150]: INFO nova.compute.manager [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Terminating instance
Aug 01 18:57:23 user nova-compute[72150]: DEBUG nova.compute.manager [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 18:57:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG nova.compute.manager [req-a5c8ed78-7d43-42ad-81ad-466ed5a4e066 req-3444472c-d7d9-4dd7-96a1-60b08b392145 service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Received event network-vif-unplugged-a41a5bac-da6d-45af-8bf7-7d24b077697f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a5c8ed78-7d43-42ad-81ad-466ed5a4e066 req-3444472c-d7d9-4dd7-96a1-60b08b392145 service nova] Acquiring lock "71494aab-21cb-49b3-ae94-ae946f259994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a5c8ed78-7d43-42ad-81ad-466ed5a4e066 req-3444472c-d7d9-4dd7-96a1-60b08b392145 service nova] Lock "71494aab-21cb-49b3-ae94-ae946f259994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a5c8ed78-7d43-42ad-81ad-466ed5a4e066 req-3444472c-d7d9-4dd7-96a1-60b08b392145 service nova] Lock "71494aab-21cb-49b3-ae94-ae946f259994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG nova.compute.manager [req-a5c8ed78-7d43-42ad-81ad-466ed5a4e066 req-3444472c-d7d9-4dd7-96a1-60b08b392145 service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] No waiting events found dispatching network-vif-unplugged-a41a5bac-da6d-45af-8bf7-7d24b077697f {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG nova.compute.manager [req-a5c8ed78-7d43-42ad-81ad-466ed5a4e066 req-3444472c-d7d9-4dd7-96a1-60b08b392145 service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Received event network-vif-unplugged-a41a5bac-da6d-45af-8bf7-7d24b077697f for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:24 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Instance destroyed successfully.
Aug 01 18:57:24 user nova-compute[72150]: DEBUG nova.objects.instance [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lazy-loading 'resources' on Instance uuid 71494aab-21cb-49b3-ae94-ae946f259994 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T18:53:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-658843907',display_name='tempest-TestServerVolumeAttachmentScenario-server-658843907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-658843907',id=49,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUfQcxHoILWQ1sEDnev01p17kX2hJtrzY1vpRTZgdXhkzfrbANrFlHPB3wukYRdm6k9dioXN+ZX6rAqZBagsANvpSjgZWIu0bJTQyLJboa5yrU7XtJwLxZzPdtFUCipBw==',key_name='tempest-keypair-1214909300',keypairs=<?>,launch_index=0,launched_at=2023-08-01T18:53:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6393ebb3a4f0431ba8f5c276872c1ed2',ramdisk_id='',reservation_id='r-8578ozbt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-534139665',owner_user_name='tempest-TestServerVolumeAttachmentScenario-534139665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T18:53:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f13ebe543cb41ca98fc6b9876940b0a',uuid=71494aab-21cb-49b3-ae94-ae946f259994,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "address": "fa:16:3e:8f:ce:21", "network": {"id": "e2bba8d2-db87-47be-8c46-a1667058901b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1639440778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6393ebb3a4f0431ba8f5c276872c1ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41a5bac-da", "ovs_interfaceid": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Converting VIF {"id": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "address": "fa:16:3e:8f:ce:21", "network": {"id": "e2bba8d2-db87-47be-8c46-a1667058901b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1639440778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6393ebb3a4f0431ba8f5c276872c1ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41a5bac-da", "ovs_interfaceid": "a41a5bac-da6d-45af-8bf7-7d24b077697f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:ce:21,bridge_name='br-int',has_traffic_filtering=True,id=a41a5bac-da6d-45af-8bf7-7d24b077697f,network=Network(e2bba8d2-db87-47be-8c46-a1667058901b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa41a5bac-da') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG os_vif [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:ce:21,bridge_name='br-int',has_traffic_filtering=True,id=a41a5bac-da6d-45af-8bf7-7d24b077697f,network=Network(e2bba8d2-db87-47be-8c46-a1667058901b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa41a5bac-da') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa41a5bac-da, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:57:24 user nova-compute[72150]: INFO os_vif [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:ce:21,bridge_name='br-int',has_traffic_filtering=True,id=a41a5bac-da6d-45af-8bf7-7d24b077697f,network=Network(e2bba8d2-db87-47be-8c46-a1667058901b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa41a5bac-da')
Aug 01 18:57:24 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Deleting instance files /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994_del
Aug 01 18:57:24 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Deletion of /opt/stack/data/nova/instances/71494aab-21cb-49b3-ae94-ae946f259994_del complete
Aug 01 18:57:24 user nova-compute[72150]: INFO nova.compute.manager [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 18:57:24 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 18:57:24 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 18:57:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:26 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 18:57:26 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Took 1.40 seconds to deallocate network for instance.
Aug 01 18:57:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:57:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:57:26 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:57:26 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:57:26 user nova-compute[72150]: DEBUG nova.compute.manager [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Received event network-vif-plugged-a41a5bac-da6d-45af-8bf7-7d24b077697f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:57:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] Acquiring lock "71494aab-21cb-49b3-ae94-ae946f259994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:57:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] Lock "71494aab-21cb-49b3-ae94-ae946f259994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:57:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] Lock "71494aab-21cb-49b3-ae94-ae946f259994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:57:26 user nova-compute[72150]: DEBUG nova.compute.manager [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] No waiting events found dispatching network-vif-plugged-a41a5bac-da6d-45af-8bf7-7d24b077697f {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:57:26 user nova-compute[72150]: WARNING nova.compute.manager [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Received unexpected event network-vif-plugged-a41a5bac-da6d-45af-8bf7-7d24b077697f for instance with vm_state deleted and task_state None.
Aug 01 18:57:26 user nova-compute[72150]: DEBUG nova.compute.manager [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Received event network-vif-plugged-a41a5bac-da6d-45af-8bf7-7d24b077697f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:57:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] Acquiring lock "71494aab-21cb-49b3-ae94-ae946f259994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:57:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] Lock "71494aab-21cb-49b3-ae94-ae946f259994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:57:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] Lock "71494aab-21cb-49b3-ae94-ae946f259994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:57:26 user nova-compute[72150]: DEBUG nova.compute.manager [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] No waiting events found dispatching network-vif-plugged-a41a5bac-da6d-45af-8bf7-7d24b077697f {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:57:26 user nova-compute[72150]: WARNING nova.compute.manager [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Received unexpected event network-vif-plugged-a41a5bac-da6d-45af-8bf7-7d24b077697f for instance with vm_state deleted and task_state None.
Aug 01 18:57:26 user nova-compute[72150]: DEBUG nova.compute.manager [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Received event network-vif-plugged-a41a5bac-da6d-45af-8bf7-7d24b077697f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:57:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] Acquiring lock "71494aab-21cb-49b3-ae94-ae946f259994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:57:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] Lock "71494aab-21cb-49b3-ae94-ae946f259994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:57:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] Lock "71494aab-21cb-49b3-ae94-ae946f259994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:57:26 user nova-compute[72150]: DEBUG nova.compute.manager [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] No waiting events found dispatching network-vif-plugged-a41a5bac-da6d-45af-8bf7-7d24b077697f {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:57:26 user nova-compute[72150]: WARNING nova.compute.manager [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Received unexpected event network-vif-plugged-a41a5bac-da6d-45af-8bf7-7d24b077697f for instance with vm_state deleted and task_state None.
Aug 01 18:57:26 user nova-compute[72150]: DEBUG nova.compute.manager [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Received event network-vif-plugged-a41a5bac-da6d-45af-8bf7-7d24b077697f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:57:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] Acquiring lock "71494aab-21cb-49b3-ae94-ae946f259994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:57:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] Lock "71494aab-21cb-49b3-ae94-ae946f259994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:57:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] Lock "71494aab-21cb-49b3-ae94-ae946f259994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:57:26 user nova-compute[72150]: DEBUG nova.compute.manager [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] No waiting events found dispatching network-vif-plugged-a41a5bac-da6d-45af-8bf7-7d24b077697f {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 18:57:26 user nova-compute[72150]: WARNING nova.compute.manager [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Received unexpected event network-vif-plugged-a41a5bac-da6d-45af-8bf7-7d24b077697f for instance with vm_state deleted and task_state None.
Aug 01 18:57:26 user nova-compute[72150]: DEBUG nova.compute.manager [req-0d80f343-9b96-4cae-a6cb-b99e399ff421 req-6e145aa8-aaac-4235-a930-19249f7eee7a service nova] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Received event network-vif-deleted-a41a5bac-da6d-45af-8bf7-7d24b077697f {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 18:57:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:57:26 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Deleted allocations for instance 71494aab-21cb-49b3-ae94-ae946f259994
Aug 01 18:57:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-0f401636-f1ce-4256-8b9d-770c1074e3b2 tempest-TestServerVolumeAttachmentScenario-534139665 tempest-TestServerVolumeAttachmentScenario-534139665-project-member] Lock "71494aab-21cb-49b3-ae94-ae946f259994" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.575s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:57:28 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690916233.046401, 0d54f465-6427-4fad-921c-adf51c57a7d4 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:57:28 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] VM Stopped (Lifecycle Event)
Aug 01 18:57:28 user nova-compute[72150]: DEBUG nova.compute.manager [None req-6db8ec78-413e-404e-9a8f-67cd22ad6231 None None] [instance: 0d54f465-6427-4fad-921c-adf51c57a7d4] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:57:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:57:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:57:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:57:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:57:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:39 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690916244.650949, 71494aab-21cb-49b3-ae94-ae946f259994 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 18:57:39 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] VM Stopped (Lifecycle Event)
Aug 01 18:57:39 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ab42134a-5df7-40b3-8494-5bdf971c6550 None None] [instance: 71494aab-21cb-49b3-ae94-ae946f259994] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 18:57:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:57:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:57:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:57:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:57:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:57:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:49 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:57:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:52 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:57:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:57:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:57:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:57:52 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:57:53 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:57:53 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:57:53 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8906MB free_disk=25.385372161865234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:57:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:57:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:57:53 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:57:53 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:57:53 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:57:53 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:57:53 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:57:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:57:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:57:58 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:57:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:57:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:57:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:57:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:57:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:57:59 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:58:02 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:58:02 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:58:02 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:58:02 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:58:03 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:58:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:58:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:58:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:58:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:58:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:58:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:58:04 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:58:04 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72150) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 18:58:06 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:58:08 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:58:08 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:58:08 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 18:58:08 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Didn't find any instances for network info cache update. {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 18:58:08 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:58:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:58:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:58:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:58:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:58:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:58:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:58:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:58:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:58:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:58:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:58:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:58:24 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:58:24 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Cleaning up deleted instances {{(pid=72150) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 18:58:24 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] There are 0 instances to clean {{(pid=72150) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 18:58:26 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:58:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:58:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:58:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:58:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:58:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:58:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:58:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:58:50 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:58:53 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:58:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:58:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:58:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:58:53 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:58:54 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:58:54 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:58:54 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8998MB free_disk=25.382774353027344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:58:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:58:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:58:54 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:58:54 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:58:54 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Refreshing inventories for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 18:58:54 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Updating ProviderTree inventory for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 18:58:54 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Updating inventory in ProviderTree for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 18:58:54 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Refreshing aggregate associations for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479, aggregates: None {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 18:58:54 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Refreshing trait associations for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 18:58:54 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:58:54 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:58:54 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:58:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:58:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:58:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:58:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:58:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:58:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:58:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:58:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:58:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:58:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:58:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:58:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:58:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:59:00 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:59:01 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:59:02 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:59:03 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:59:03 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 18:59:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:59:04 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:59:04 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:59:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:59:10 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:59:10 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 18:59:10 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 18:59:10 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Didn't find any instances for network info cache update. {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 18:59:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:59:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:59:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:59:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:59:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:59:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:59:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:59:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:59:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:59:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:59:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:59:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:59:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:59:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:59:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 18:59:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:59:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 18:59:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:59:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:59:52 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:59:53 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 18:59:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:59:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:59:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:59:53 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 18:59:54 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:59:54 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 18:59:54 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8983MB free_disk=25.380687713623047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 18:59:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 18:59:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 18:59:54 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 18:59:54 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 18:59:54 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 18:59:54 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 18:59:54 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 18:59:54 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 18:59:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 18:59:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:59:57 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 18:59:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:00 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:00:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:02 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:00:02 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:00:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:05 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:00:05 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:00:05 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:00:06 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:00:06 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:00:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:00:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:00:08 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:00:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:00:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:00:08 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:00:08 user nova-compute[72150]: INFO nova.compute.claims [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Claim successful on node user
Aug 01 19:00:08 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:00:08 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:00:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.183s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:00:08 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:00:08 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:00:08 user nova-compute[72150]: DEBUG nova.network.neutron [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:00:09 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:00:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG nova.policy [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d0d10a9a129418298a1d651126d8b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67731fef3cd244f49db891b2b7943527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:00:09 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Creating image(s)
Aug 01 19:00:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "/opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "/opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "/opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.132s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk 1073741824" returned: 0 in 0.063s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG nova.network.neutron [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Successfully created port: 592aca55-ee83-458e-be09-3a7c1020e98c {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Cannot resize image /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG nova.objects.instance [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lazy-loading 'migration_context' on Instance uuid 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Ensure instance console log exists: /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:00:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.network.neutron [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Successfully updated port: 592aca55-ee83-458e-be09-3a7c1020e98c {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquired lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.network.neutron [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.network.neutron [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-a1ecc201-ea63-4999-aa73-09179ad6dd79 req-2830485c-bd3b-4591-a6f6-124aaf259750 service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Received event network-changed-592aca55-ee83-458e-be09-3a7c1020e98c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.compute.manager [req-a1ecc201-ea63-4999-aa73-09179ad6dd79 req-2830485c-bd3b-4591-a6f6-124aaf259750 service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Refreshing instance network info cache due to event network-changed-592aca55-ee83-458e-be09-3a7c1020e98c. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a1ecc201-ea63-4999-aa73-09179ad6dd79 req-2830485c-bd3b-4591-a6f6-124aaf259750 service nova] Acquiring lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.network.neutron [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Updating instance_info_cache with network_info: [{"id": "592aca55-ee83-458e-be09-3a7c1020e98c", "address": "fa:16:3e:4f:64:97", "network": {"id": "60ef765c-367f-47f4-86cf-89862b70db21", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-243785190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67731fef3cd244f49db891b2b7943527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592aca55-ee", "ovs_interfaceid": "592aca55-ee83-458e-be09-3a7c1020e98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Releasing lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Instance network_info: |[{"id": "592aca55-ee83-458e-be09-3a7c1020e98c", "address": "fa:16:3e:4f:64:97", "network": {"id": "60ef765c-367f-47f4-86cf-89862b70db21", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-243785190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67731fef3cd244f49db891b2b7943527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592aca55-ee", "ovs_interfaceid": "592aca55-ee83-458e-be09-3a7c1020e98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a1ecc201-ea63-4999-aa73-09179ad6dd79 req-2830485c-bd3b-4591-a6f6-124aaf259750 service nova] Acquired lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.network.neutron [req-a1ecc201-ea63-4999-aa73-09179ad6dd79 req-2830485c-bd3b-4591-a6f6-124aaf259750 service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Refreshing network info cache for port 592aca55-ee83-458e-be09-3a7c1020e98c {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Start _get_guest_xml network_info=[{"id": "592aca55-ee83-458e-be09-3a7c1020e98c", "address": "fa:16:3e:4f:64:97", "network": {"id": "60ef765c-367f-47f4-86cf-89862b70db21", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-243785190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67731fef3cd244f49db891b2b7943527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592aca55-ee", "ovs_interfaceid": "592aca55-ee83-458e-be09-3a7c1020e98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:00:10 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:00:10 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:00:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2080551018',display_name='tempest-SnapshotDataIntegrityTests-server-2080551018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2080551018',id=51,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBHo1UdNh9E3cfGsQvIpk3U/+DVZ/EwJ3JuSUW9RkPJyXnzifJjIUnpIEDU5WWremxY3+k9rZsYovun/o8iVW9dO2WecN/z8ivM13c7h5mkuYxSIl1lRbTp04RLWoW+SA==',key_name='tempest-keypair-2117792201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67731fef3cd244f49db891b2b7943527',ramdisk_id='',reservation_id='r-5q6h3owx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-555465620',owner_user_name='tempest-SnapshotDataIntegrityTests-555465620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:00:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0d10a9a129418298a1d651126d8b20',uuid=2049a6fc-d724-4ff5-9922-9ddcd00b4ac5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "592aca55-ee83-458e-be09-3a7c1020e98c", "address": "fa:16:3e:4f:64:97", "network": {"id": "60ef765c-367f-47f4-86cf-89862b70db21", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-243785190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67731fef3cd244f49db891b2b7943527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592aca55-ee", "ovs_interfaceid": "592aca55-ee83-458e-be09-3a7c1020e98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Converting VIF {"id": "592aca55-ee83-458e-be09-3a7c1020e98c", "address": "fa:16:3e:4f:64:97", "network": {"id": "60ef765c-367f-47f4-86cf-89862b70db21", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-243785190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67731fef3cd244f49db891b2b7943527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592aca55-ee", "ovs_interfaceid": "592aca55-ee83-458e-be09-3a7c1020e98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:64:97,bridge_name='br-int',has_traffic_filtering=True,id=592aca55-ee83-458e-be09-3a7c1020e98c,network=Network(60ef765c-367f-47f4-86cf-89862b70db21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592aca55-ee') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.objects.instance [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lazy-loading 'pci_devices' on Instance uuid 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:00:10 user nova-compute[72150]:   <uuid>2049a6fc-d724-4ff5-9922-9ddcd00b4ac5</uuid>
Aug 01 19:00:10 user nova-compute[72150]:   <name>instance-00000033</name>
Aug 01 19:00:10 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 19:00:10 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 19:00:10 user nova-compute[72150]:   <metadata>
Aug 01 19:00:10 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:00:10 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 19:00:10 user nova-compute[72150]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2080551018</nova:name>
Aug 01 19:00:10 user nova-compute[72150]:       <nova:creationTime>2023-08-01 19:00:10</nova:creationTime>
Aug 01 19:00:10 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 19:00:10 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 19:00:10 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 19:00:10 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 19:00:10 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:00:10 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:00:10 user nova-compute[72150]:       </nova:flavor>
Aug 01 19:00:10 user nova-compute[72150]:       <nova:owner>
Aug 01 19:00:10 user nova-compute[72150]:         <nova:user uuid="8d0d10a9a129418298a1d651126d8b20">tempest-SnapshotDataIntegrityTests-555465620-project-member</nova:user>
Aug 01 19:00:10 user nova-compute[72150]:         <nova:project uuid="67731fef3cd244f49db891b2b7943527">tempest-SnapshotDataIntegrityTests-555465620</nova:project>
Aug 01 19:00:10 user nova-compute[72150]:       </nova:owner>
Aug 01 19:00:10 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 19:00:10 user nova-compute[72150]:       <nova:ports>
Aug 01 19:00:10 user nova-compute[72150]:         <nova:port uuid="592aca55-ee83-458e-be09-3a7c1020e98c">
Aug 01 19:00:10 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 19:00:10 user nova-compute[72150]:         </nova:port>
Aug 01 19:00:10 user nova-compute[72150]:       </nova:ports>
Aug 01 19:00:10 user nova-compute[72150]:     </nova:instance>
Aug 01 19:00:10 user nova-compute[72150]:   </metadata>
Aug 01 19:00:10 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 19:00:10 user nova-compute[72150]:     <system>
Aug 01 19:00:10 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:00:10 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:00:10 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 19:00:10 user nova-compute[72150]:       <entry name="serial">2049a6fc-d724-4ff5-9922-9ddcd00b4ac5</entry>
Aug 01 19:00:10 user nova-compute[72150]:       <entry name="uuid">2049a6fc-d724-4ff5-9922-9ddcd00b4ac5</entry>
Aug 01 19:00:10 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:00:10 user nova-compute[72150]:     </system>
Aug 01 19:00:10 user nova-compute[72150]:   </sysinfo>
Aug 01 19:00:10 user nova-compute[72150]:   <os>
Aug 01 19:00:10 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:00:10 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 19:00:10 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 19:00:10 user nova-compute[72150]:   </os>
Aug 01 19:00:10 user nova-compute[72150]:   <features>
Aug 01 19:00:10 user nova-compute[72150]:     <acpi/>
Aug 01 19:00:10 user nova-compute[72150]:     <apic/>
Aug 01 19:00:10 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 19:00:10 user nova-compute[72150]:   </features>
Aug 01 19:00:10 user nova-compute[72150]:   <clock offset="utc">
Aug 01 19:00:10 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:00:10 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:00:10 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 19:00:10 user nova-compute[72150]:   </clock>
Aug 01 19:00:10 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 19:00:10 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 19:00:10 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:00:10 user nova-compute[72150]:   </cpu>
Aug 01 19:00:10 user nova-compute[72150]:   <devices>
Aug 01 19:00:10 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 19:00:10 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:00:10 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk"/>
Aug 01 19:00:10 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 19:00:10 user nova-compute[72150]:     </disk>
Aug 01 19:00:10 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 19:00:10 user nova-compute[72150]:       <mac address="fa:16:3e:4f:64:97"/>
Aug 01 19:00:10 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 19:00:10 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 19:00:10 user nova-compute[72150]:       <target dev="tap592aca55-ee"/>
Aug 01 19:00:10 user nova-compute[72150]:     </interface>
Aug 01 19:00:10 user nova-compute[72150]:     <serial type="pty">
Aug 01 19:00:10 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/console.log" append="off"/>
Aug 01 19:00:10 user nova-compute[72150]:     </serial>
Aug 01 19:00:10 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:00:10 user nova-compute[72150]:     <video>
Aug 01 19:00:10 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 19:00:10 user nova-compute[72150]:     </video>
Aug 01 19:00:10 user nova-compute[72150]:     <rng model="virtio">
Aug 01 19:00:10 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:00:10 user nova-compute[72150]:     </rng>
Aug 01 19:00:10 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:00:10 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 19:00:10 user nova-compute[72150]:       <stats period="10"/>
Aug 01 19:00:10 user nova-compute[72150]:     </memballoon>
Aug 01 19:00:10 user nova-compute[72150]:   </devices>
Aug 01 19:00:10 user nova-compute[72150]: </domain>
Aug 01 19:00:10 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:00:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2080551018',display_name='tempest-SnapshotDataIntegrityTests-server-2080551018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2080551018',id=51,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBHo1UdNh9E3cfGsQvIpk3U/+DVZ/EwJ3JuSUW9RkPJyXnzifJjIUnpIEDU5WWremxY3+k9rZsYovun/o8iVW9dO2WecN/z8ivM13c7h5mkuYxSIl1lRbTp04RLWoW+SA==',key_name='tempest-keypair-2117792201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67731fef3cd244f49db891b2b7943527',ramdisk_id='',reservation_id='r-5q6h3owx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-555465620',owner_user_name='tempest-SnapshotDataIntegrityTests-555465620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:00:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0d10a9a129418298a1d651126d8b20',uuid=2049a6fc-d724-4ff5-9922-9ddcd00b4ac5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "592aca55-ee83-458e-be09-3a7c1020e98c", "address": "fa:16:3e:4f:64:97", "network": {"id": "60ef765c-367f-47f4-86cf-89862b70db21", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-243785190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67731fef3cd244f49db891b2b7943527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592aca55-ee", "ovs_interfaceid": "592aca55-ee83-458e-be09-3a7c1020e98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Converting VIF {"id": "592aca55-ee83-458e-be09-3a7c1020e98c", "address": "fa:16:3e:4f:64:97", "network": {"id": "60ef765c-367f-47f4-86cf-89862b70db21", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-243785190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67731fef3cd244f49db891b2b7943527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592aca55-ee", "ovs_interfaceid": "592aca55-ee83-458e-be09-3a7c1020e98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:64:97,bridge_name='br-int',has_traffic_filtering=True,id=592aca55-ee83-458e-be09-3a7c1020e98c,network=Network(60ef765c-367f-47f4-86cf-89862b70db21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592aca55-ee') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG os_vif [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:64:97,bridge_name='br-int',has_traffic_filtering=True,id=592aca55-ee83-458e-be09-3a7c1020e98c,network=Network(60ef765c-367f-47f4-86cf-89862b70db21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592aca55-ee') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap592aca55-ee, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap592aca55-ee, col_values=(('external_ids', {'iface-id': '592aca55-ee83-458e-be09-3a7c1020e98c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:64:97', 'vm-uuid': '2049a6fc-d724-4ff5-9922-9ddcd00b4ac5'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:10 user nova-compute[72150]: INFO os_vif [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:64:97,bridge_name='br-int',has_traffic_filtering=True,id=592aca55-ee83-458e-be09-3a7c1020e98c,network=Network(60ef765c-367f-47f4-86cf-89862b70db21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592aca55-ee')
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:00:10 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] No VIF found with MAC fa:16:3e:4f:64:97, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:00:11 user nova-compute[72150]: DEBUG nova.network.neutron [req-a1ecc201-ea63-4999-aa73-09179ad6dd79 req-2830485c-bd3b-4591-a6f6-124aaf259750 service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Updated VIF entry in instance network info cache for port 592aca55-ee83-458e-be09-3a7c1020e98c. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:00:11 user nova-compute[72150]: DEBUG nova.network.neutron [req-a1ecc201-ea63-4999-aa73-09179ad6dd79 req-2830485c-bd3b-4591-a6f6-124aaf259750 service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Updating instance_info_cache with network_info: [{"id": "592aca55-ee83-458e-be09-3a7c1020e98c", "address": "fa:16:3e:4f:64:97", "network": {"id": "60ef765c-367f-47f4-86cf-89862b70db21", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-243785190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67731fef3cd244f49db891b2b7943527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592aca55-ee", "ovs_interfaceid": "592aca55-ee83-458e-be09-3a7c1020e98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:00:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-a1ecc201-ea63-4999-aa73-09179ad6dd79 req-2830485c-bd3b-4591-a6f6-124aaf259750 service nova] Releasing lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:00:11 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:00:11 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:00:11 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:00:11 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Skipping network cache update for instance because it is Building. {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 01 19:00:11 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Didn't find any instances for network info cache update. {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 19:00:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:12 user nova-compute[72150]: DEBUG nova.compute.manager [req-81e61091-5dfe-45dd-af5f-3eadcc827f38 req-d4e69716-33a2-4c63-8f6c-9ef19c7e4d52 service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Received event network-vif-plugged-592aca55-ee83-458e-be09-3a7c1020e98c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:00:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-81e61091-5dfe-45dd-af5f-3eadcc827f38 req-d4e69716-33a2-4c63-8f6c-9ef19c7e4d52 service nova] Acquiring lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:00:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-81e61091-5dfe-45dd-af5f-3eadcc827f38 req-d4e69716-33a2-4c63-8f6c-9ef19c7e4d52 service nova] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:00:12 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-81e61091-5dfe-45dd-af5f-3eadcc827f38 req-d4e69716-33a2-4c63-8f6c-9ef19c7e4d52 service nova] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:00:12 user nova-compute[72150]: DEBUG nova.compute.manager [req-81e61091-5dfe-45dd-af5f-3eadcc827f38 req-d4e69716-33a2-4c63-8f6c-9ef19c7e4d52 service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] No waiting events found dispatching network-vif-plugged-592aca55-ee83-458e-be09-3a7c1020e98c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:00:12 user nova-compute[72150]: WARNING nova.compute.manager [req-81e61091-5dfe-45dd-af5f-3eadcc827f38 req-d4e69716-33a2-4c63-8f6c-9ef19c7e4d52 service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Received unexpected event network-vif-plugged-592aca55-ee83-458e-be09-3a7c1020e98c for instance with vm_state building and task_state spawning.
Aug 01 19:00:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:12 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:14 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690916414.271092, 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:00:14 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] VM Resumed (Lifecycle Event)
Aug 01 19:00:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:00:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:00:14 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Instance spawned successfully.
Aug 01 19:00:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:00:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:00:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:00:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:00:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:00:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:00:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:00:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:00:14 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:00:14 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:00:14 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690916414.2723532, 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:00:14 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] VM Started (Lifecycle Event)
Aug 01 19:00:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:00:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:00:14 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:00:14 user nova-compute[72150]: INFO nova.compute.manager [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Took 5.25 seconds to spawn the instance on the hypervisor.
Aug 01 19:00:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:00:14 user nova-compute[72150]: INFO nova.compute.manager [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Took 5.73 seconds to build instance.
Aug 01 19:00:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7c9637fe-49ef-4e97-9a55-1dbfe16840da tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.837s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:00:14 user nova-compute[72150]: DEBUG nova.compute.manager [req-cf9340ea-d913-4478-93d0-cb7ebc0e8230 req-704bf667-65b9-4cc7-8cf0-ac2618caf2db service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Received event network-vif-plugged-592aca55-ee83-458e-be09-3a7c1020e98c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:00:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-cf9340ea-d913-4478-93d0-cb7ebc0e8230 req-704bf667-65b9-4cc7-8cf0-ac2618caf2db service nova] Acquiring lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:00:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-cf9340ea-d913-4478-93d0-cb7ebc0e8230 req-704bf667-65b9-4cc7-8cf0-ac2618caf2db service nova] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:00:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-cf9340ea-d913-4478-93d0-cb7ebc0e8230 req-704bf667-65b9-4cc7-8cf0-ac2618caf2db service nova] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:00:14 user nova-compute[72150]: DEBUG nova.compute.manager [req-cf9340ea-d913-4478-93d0-cb7ebc0e8230 req-704bf667-65b9-4cc7-8cf0-ac2618caf2db service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] No waiting events found dispatching network-vif-plugged-592aca55-ee83-458e-be09-3a7c1020e98c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:00:14 user nova-compute[72150]: WARNING nova.compute.manager [req-cf9340ea-d913-4478-93d0-cb7ebc0e8230 req-704bf667-65b9-4cc7-8cf0-ac2618caf2db service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Received unexpected event network-vif-plugged-592aca55-ee83-458e-be09-3a7c1020e98c for instance with vm_state active and task_state None.
Aug 01 19:00:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:00:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:00:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:00:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:00:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:00:52 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:00:55 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:00:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:00:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:00:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:00:55 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:00:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:00:55 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:00:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:00:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:00:56 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:00:56 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:00:56 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:00:56 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8823MB free_disk=25.350276947021484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:00:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:00:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:00:56 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:00:56 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:00:56 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:00:56 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:00:56 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:00:56 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:00:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:01:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:01:02 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:01:02 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:01:03 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:01:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:01:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:01:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:01:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:01:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:01:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:01:06 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:01:07 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:01:07 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:01:07 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:01:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:01:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:01:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:01:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:01:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:01:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:01:13 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:01:13 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:01:13 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:01:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:01:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:01:13 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:01:13 user nova-compute[72150]: DEBUG nova.objects.instance [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lazy-loading 'info_cache' on Instance uuid 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:01:14 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Updating instance_info_cache with network_info: [{"id": "592aca55-ee83-458e-be09-3a7c1020e98c", "address": "fa:16:3e:4f:64:97", "network": {"id": "60ef765c-367f-47f4-86cf-89862b70db21", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-243785190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67731fef3cd244f49db891b2b7943527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592aca55-ee", "ovs_interfaceid": "592aca55-ee83-458e-be09-3a7c1020e98c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:01:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:01:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:01:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:01:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:01:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:01:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:01:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:01:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:01:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:01:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:01:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:01:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:01:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:01:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:01:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:01:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:01:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:01:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:01:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:01:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:01:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:01:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:01:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:01:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:01:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:01:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:01:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:01:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:01:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:01:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:01:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:01:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:01:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:01:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:01:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:01:52 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:01:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:01:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:01:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:01:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:01:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:01:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:01:57 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:01:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:01:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:01:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:01:57 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:01:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:01:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:01:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:01:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:01:58 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:01:58 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:01:58 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8842MB free_disk=25.349658966064453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:01:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:01:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:01:58 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:01:58 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:01:58 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:01:58 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:01:58 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:01:58 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:01:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:01:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-b2938282-f6c1-4c05-8dfb-f930aedd19e7 req-2642a707-5e81-4bad-9075-d8d4ce9a8549 service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Received event network-changed-592aca55-ee83-458e-be09-3a7c1020e98c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:01:59 user nova-compute[72150]: DEBUG nova.compute.manager [req-b2938282-f6c1-4c05-8dfb-f930aedd19e7 req-2642a707-5e81-4bad-9075-d8d4ce9a8549 service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Refreshing instance network info cache due to event network-changed-592aca55-ee83-458e-be09-3a7c1020e98c. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:01:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b2938282-f6c1-4c05-8dfb-f930aedd19e7 req-2642a707-5e81-4bad-9075-d8d4ce9a8549 service nova] Acquiring lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:01:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b2938282-f6c1-4c05-8dfb-f930aedd19e7 req-2642a707-5e81-4bad-9075-d8d4ce9a8549 service nova] Acquired lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:01:59 user nova-compute[72150]: DEBUG nova.network.neutron [req-b2938282-f6c1-4c05-8dfb-f930aedd19e7 req-2642a707-5e81-4bad-9075-d8d4ce9a8549 service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Refreshing network info cache for port 592aca55-ee83-458e-be09-3a7c1020e98c {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:02:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:02:00 user nova-compute[72150]: DEBUG nova.network.neutron [req-b2938282-f6c1-4c05-8dfb-f930aedd19e7 req-2642a707-5e81-4bad-9075-d8d4ce9a8549 service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Updated VIF entry in instance network info cache for port 592aca55-ee83-458e-be09-3a7c1020e98c. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:02:00 user nova-compute[72150]: DEBUG nova.network.neutron [req-b2938282-f6c1-4c05-8dfb-f930aedd19e7 req-2642a707-5e81-4bad-9075-d8d4ce9a8549 service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Updating instance_info_cache with network_info: [{"id": "592aca55-ee83-458e-be09-3a7c1020e98c", "address": "fa:16:3e:4f:64:97", "network": {"id": "60ef765c-367f-47f4-86cf-89862b70db21", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-243785190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67731fef3cd244f49db891b2b7943527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592aca55-ee", "ovs_interfaceid": "592aca55-ee83-458e-be09-3a7c1020e98c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:02:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b2938282-f6c1-4c05-8dfb-f930aedd19e7 req-2642a707-5e81-4bad-9075-d8d4ce9a8549 service nova] Releasing lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:02:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG nova.objects.instance [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lazy-loading 'flavor' on Instance uuid 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:02:04 user nova-compute[72150]: INFO nova.compute.manager [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Attaching volume 08f70674-0095-44b5-ae79-30186aa134d0 to /dev/vdb
Aug 01 19:02:04 user nova-compute[72150]: DEBUG os_brick.utils [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[37456c7c-569d-4ffc-ba9d-197ba0546f74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0dcb45-b6be-4d3c-996c-4d76b6c7cd24]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6615bf-78ca-4eb5-9ecb-5b429ec549e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[655e9ab0-0e22-4f7c-b74b-ec5be0e0f9f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:02:04 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe3184f-9789-4fdd-985f-adacfaac9bcc]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG os_brick.utils [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Updating existing volume attachment record: 14f8ee7c-7bd1-4178-8880-a8404d87f4c4 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:02:04 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:02:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:02:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:02:08 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:02:08 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:02:09 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:02:09 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:02:09 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:02:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:02:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XefLCYWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:02:11 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:02:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:02:11 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:02:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:02:11 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f426be-9624-4a62-bc5f-48b6205dc2fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:02:11 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c45ba2-d8a3-4d8a-be96-72f24de157ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0] added
Aug 01 19:02:11 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1958ac9-3403-41b5-9497-79146f8befdb]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c93847d-2735-403e-ad50-9d1e173f48d5]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XefLCYWq {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XefLCYWq" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[995e0ff0-55ff-4e9d-ab67-d45ac6147c03]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XefLCYWq'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3142d6a6-cd13-493a-87c8-80b9dbae8eb8]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4b386e-699c-4dbd-813f-37bb175d923a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 19:02:11 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 19:02:11 user nova-compute[72150]:  {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:02:11 user nova-compute[72150]: WARNING os_brick.initiator.connectors.iscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 19:02:11 user nova-compute[72150]: 
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7032e8be-f4a6-4692-a42c-e0145def019c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0, portal: 172.16.0.220,3260]
Aug 01 19:02:11 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0, portal: 172.16.0.220,3260] successful.
Aug 01 19:02:11 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[691f5cb5-dd8c-4217-bd07-e75e1514e3ea]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:02:11 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b9c905-0524-4ca3-85ce-24c497472388]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 (non-flash)
Aug 01 19:02:12 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:02:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 (non-flash)
Aug 01 19:02:12 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:02:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:02:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:02:12 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:02:12 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:02:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:12 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:12 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cf312b-db9e-491a-b513-0e9bdade851e]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:12 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:02:12 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XefLCYWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:02:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:02:13 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26436363439653334', 'path': '/dev/sdb'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:02:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436363439653334', 'path': '/dev/sdb'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:02:13 user nova-compute[72150]: DEBUG nova.objects.instance [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lazy-loading 'flavor' on Instance uuid 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:02:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 19:02:13 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:02:13 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:02:13 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:02:13 user nova-compute[72150]:   <serial>08f70674-0095-44b5-ae79-30186aa134d0</serial>
Aug 01 19:02:13 user nova-compute[72150]: </disk>
Aug 01 19:02:13 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 19:02:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:02:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:02:13 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] No VIF found with MAC fa:16:3e:4f:64:97, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:02:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d38771b7-9b59-4825-bea3-8e4f3569223d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.236s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:02:13 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:02:13 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:02:13 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:02:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:02:13 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:02:13 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:02:13 user nova-compute[72150]: DEBUG nova.objects.instance [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lazy-loading 'info_cache' on Instance uuid 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:02:14 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Updating instance_info_cache with network_info: [{"id": "592aca55-ee83-458e-be09-3a7c1020e98c", "address": "fa:16:3e:4f:64:97", "network": {"id": "60ef765c-367f-47f4-86cf-89862b70db21", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-243785190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67731fef3cd244f49db891b2b7943527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592aca55-ee", "ovs_interfaceid": "592aca55-ee83-458e-be09-3a7c1020e98c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:02:14 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:02:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:02:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:02:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:02:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:02:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:02:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:02:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:02:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:02:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:02:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:02:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:02:32 user nova-compute[72150]: INFO nova.compute.manager [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Detaching volume 08f70674-0095-44b5-ae79-30186aa134d0
Aug 01 19:02:32 user nova-compute[72150]: INFO nova.virt.block_device [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Attempting to driver detach volume 08f70674-0095-44b5-ae79-30186aa134d0 from mountpoint /dev/vdb
Aug 01 19:02:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Attempting to detach device vdb from instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 19:02:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:02:32 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:02:32 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:02:32 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:02:32 user nova-compute[72150]:   <serial>08f70674-0095-44b5-ae79-30186aa134d0</serial>
Aug 01 19:02:32 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:02:32 user nova-compute[72150]: </disk>
Aug 01 19:02:32 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:02:32 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Successfully detached device vdb from instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 from the persistent domain config.
Aug 01 19:02:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 19:02:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:02:32 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:02:32 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:02:32 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:02:32 user nova-compute[72150]:   <serial>08f70674-0095-44b5-ae79-30186aa134d0</serial>
Aug 01 19:02:32 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:02:32 user nova-compute[72150]: </disk>
Aug 01 19:02:32 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690916553.105149, 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 19:02:33 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Successfully detached device vdb from instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 from the live domain config.
Aug 01 19:02:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XefLCYWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:02:33 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:02:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3a3681-2635-4fa6-a0d4-b5568626b5de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd66ffdc-e952-439c-832b-f4eee7c56b52]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 (non-flash)
Aug 01 19:02:33 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 (non-flash)
Aug 01 19:02:33 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c521e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0'): ({'sdb'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Removing single pathed devices sdb {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bea8d4-7211-4be8-95a0-9929e0f602cd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae22aec-30a3-4993-8fb9-34dfd2509259]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Flushing IO for device /dev/sdb {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68cddf0-e908-4388-9693-72e8673dbef1]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79d1de1-147b-4e40-8a03-0d59af7a4ff0]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19aff25-da6f-4284-a75d-58b3712a3968]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfb3b59-5b59-4db6-94bf-62440d723ac0]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0, portal: 172.16.0.220,3260]
Aug 01 19:02:33 user nova-compute[72150]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0, portal: 172.16.0.220,3260] successful.
Aug 01 19:02:33 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08f70674-0095-44b5-ae79-30186aa134d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[617b5585-6859-40d6-85c2-e2e4d7d17b41]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] <== disconnect_volume: return (293ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:02:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:02:34 user nova-compute[72150]: DEBUG nova.objects.instance [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lazy-loading 'flavor' on Instance uuid 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:02:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-baf1632f-4f34-43ae-bd29-bca55a655eef tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.561s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:02:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:02:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:02:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:02:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:02:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:02:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:02:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:02:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:02:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:02:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:02:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:02:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:02:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:02:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:02:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:02:53 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:02:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:02:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:02:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:02:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:02:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:02:57 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:02:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:02:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:02:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:02:57 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:02:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:02:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:02:58 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:02:58 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:02:58 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8827MB free_disk=25.340431213378906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:02:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:02:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:02:58 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:02:58 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:02:58 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:02:58 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:02:58 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:02:58 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:02:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:03:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:03:05 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:03:05 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:03:05 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:03:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:03:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:03:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:03:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:03:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:03:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:03:08 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:03:10 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:03:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:03:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:03:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:03:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:03:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:03:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:03:11 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:03:11 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:03:11 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:03:14 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:03:14 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72150) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 19:03:15 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:03:15 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:03:15 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:03:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:03:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:03:15 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:03:15 user nova-compute[72150]: DEBUG nova.objects.instance [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lazy-loading 'info_cache' on Instance uuid 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:03:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:03:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:03:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:03:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:03:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:03:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:03:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:03:16 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Updating instance_info_cache with network_info: [{"id": "592aca55-ee83-458e-be09-3a7c1020e98c", "address": "fa:16:3e:4f:64:97", "network": {"id": "60ef765c-367f-47f4-86cf-89862b70db21", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-243785190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67731fef3cd244f49db891b2b7943527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592aca55-ee", "ovs_interfaceid": "592aca55-ee83-458e-be09-3a7c1020e98c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:03:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:03:16 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:03:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:03:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:03:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:03:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:03:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:03:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:03:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:03:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:03:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:03:26 user nova-compute[72150]: DEBUG nova.objects.instance [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lazy-loading 'flavor' on Instance uuid 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:03:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:03:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:03:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:03:27 user nova-compute[72150]: INFO nova.compute.manager [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Attaching volume 1e5a0664-90de-4d96-b6ad-4ca860cb0750 to /dev/vdb
Aug 01 19:03:27 user nova-compute[72150]: DEBUG os_brick.utils [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:03:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:27 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bdf3ca-20ec-4262-a6e9-c68b8206fc9c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:27 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df52a66-3ecf-44af-9a6d-82adf73bdb91]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:27 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2877ee55-1869-40c7-8a8e-939a95398979]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:27 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4c1d07-e17a-405b-afef-fb74cf184047]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:03:27 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:03:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:03:27 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:03:27 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[854e205f-1887-42c3-8a28-ba8032b50610]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:27 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:03:27 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:03:27 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:03:27 user nova-compute[72150]: DEBUG os_brick.utils [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:03:27 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Updating existing volume attachment record: ecea2f06-e860-475e-8006-115c81971bd6 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:03:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:03:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVqaxojb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:03:35 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:03:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:03:35 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:03:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:03:35 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e16f7d-b47d-44e0-b316-328a16c3ebf3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:03:35 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6578cf5-c9d9-4b5e-bdd0-6e1be01361ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750] added
Aug 01 19:03:35 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fdee6f-6c43-4bb3-ad62-2409bd8556c2]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d8e21f-c60d-4c8e-ba9a-7a0954b58953]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MVqaxojb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MVqaxojb" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ac6a11-b9b6-4407-a2bd-d0cb58d54586]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MVqaxojb'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7440e286-4af0-4633-86f7-a83ba9a0892c]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af77e12-6b64-4501-b158-5414027835c6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 19:03:35 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 19:03:35 user nova-compute[72150]:  {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:03:35 user nova-compute[72150]: WARNING os_brick.initiator.connectors.iscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 19:03:35 user nova-compute[72150]: 
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1186c89-7ac5-4ba2-81c7-cde814334ee9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750, portal: 172.16.0.220,3260]
Aug 01 19:03:35 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750, portal: 172.16.0.220,3260] successful.
Aug 01 19:03:35 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c0ec13-6096-4000-b61d-c51a294ccb96]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bf51d1-3c0c-4f84-9420-24fa3ae7fcf8]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 (non-flash)
Aug 01 19:03:35 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 (non-flash)
Aug 01 19:03:35 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd43db2-8b1d-4abf-bfc6-f567823f3e27]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Cleaning up deleted instances {{(pid=72150) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 19:03:35 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] There are 0 instances to clean {{(pid=72150) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 19:03:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:03:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:03:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:03:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:03:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:03:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:03:36 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:03:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVqaxojb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:03:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:03:36 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23934353637663836', 'path': '/dev/sdb'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:03:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934353637663836', 'path': '/dev/sdb'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:03:36 user nova-compute[72150]: DEBUG nova.objects.instance [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lazy-loading 'flavor' on Instance uuid 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:03:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 19:03:36 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:03:36 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:03:36 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:03:36 user nova-compute[72150]:   <serial>1e5a0664-90de-4d96-b6ad-4ca860cb0750</serial>
Aug 01 19:03:36 user nova-compute[72150]: </disk>
Aug 01 19:03:36 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 19:03:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:03:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:03:36 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] No VIF found with MAC fa:16:3e:4f:64:97, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:03:36 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-182d1384-565e-4c39-9584-6b1007764df5 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.177s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:03:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:03:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:03:38 user nova-compute[72150]: INFO nova.compute.manager [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Detaching volume 1e5a0664-90de-4d96-b6ad-4ca860cb0750
Aug 01 19:03:38 user nova-compute[72150]: INFO nova.virt.block_device [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Attempting to driver detach volume 1e5a0664-90de-4d96-b6ad-4ca860cb0750 from mountpoint /dev/vdb
Aug 01 19:03:38 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Attempting to detach device vdb from instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 19:03:38 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:03:38 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:03:38 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:03:38 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:03:38 user nova-compute[72150]:   <serial>1e5a0664-90de-4d96-b6ad-4ca860cb0750</serial>
Aug 01 19:03:38 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:03:38 user nova-compute[72150]: </disk>
Aug 01 19:03:38 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:03:38 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Successfully detached device vdb from instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 from the persistent domain config.
Aug 01 19:03:38 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 19:03:38 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:03:38 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:03:38 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:03:38 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:03:38 user nova-compute[72150]:   <serial>1e5a0664-90de-4d96-b6ad-4ca860cb0750</serial>
Aug 01 19:03:38 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:03:38 user nova-compute[72150]: </disk>
Aug 01 19:03:38 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690916619.3721616, 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 19:03:39 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Successfully detached device vdb from instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 from the live domain config.
Aug 01 19:03:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVqaxojb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:03:39 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:03:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fb2ffa-9424-41b9-a34b-6a34623302b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1497d88c-5a6a-4a63-a57e-fd6964ae9ec0]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 (non-flash)
Aug 01 19:03:39 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 (non-flash)
Aug 01 19:03:39 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec2c8a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750'): ({'sdb'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Removing single pathed devices sdb {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ad529e-ed26-4e9c-a22f-a8e3541df7db]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bf8cd8-3785-4876-b8a5-f68b81e0e668]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Flushing IO for device /dev/sdb {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79c0149-1f26-484e-9465-3a9b1aad037f]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f302193b-b997-4a5a-b4b4-8c32cf70cc69]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3754ca-2285-464e-a889-5241756081eb]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9aeba4e-b0b0-475f-911f-c6a12750c187]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750, portal: 172.16.0.220,3260]
Aug 01 19:03:39 user nova-compute[72150]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750, portal: 172.16.0.220,3260] successful.
Aug 01 19:03:39 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e5a0664-90de-4d96-b6ad-4ca860cb0750 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff9a554-1543-4ae6-b915-b0e5ea51684e]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] <== disconnect_volume: return (287ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:03:39 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:03:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:03:40 user nova-compute[72150]: DEBUG nova.objects.instance [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lazy-loading 'flavor' on Instance uuid 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:03:40 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d580ae2b-a849-4126-ab8d-61c32f044379 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.586s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:03:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:03:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:03:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:03:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:03:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:03:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:03:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:03:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:03:55 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:03:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:03:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:03:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:03:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:03:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:03:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:03:57 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:03:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:03:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:03:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:03:57 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:03:57 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:03:58 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:03:58 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:03:58 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:03:58 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8807MB free_disk=25.339462280273438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:03:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:03:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:03:58 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:03:58 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:03:58 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:03:58 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Refreshing inventories for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 19:03:58 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Updating ProviderTree inventory for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 19:03:58 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Updating inventory in ProviderTree for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 19:03:58 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Refreshing aggregate associations for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479, aggregates: None {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 19:03:58 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Refreshing trait associations for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 19:03:58 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:03:58 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:03:58 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:03:58 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:04:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:04:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:04:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:04:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:04:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:04:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:04:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:04:06 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:04:06 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:04:07 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:04:09 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:04:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:04:11 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:04:11 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:04:11 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:04:12 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:04:15 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:04:15 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:04:15 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:04:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:04:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:04:15 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:04:15 user nova-compute[72150]: DEBUG nova.objects.instance [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lazy-loading 'info_cache' on Instance uuid 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:04:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:04:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:04:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:04:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:04:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:04:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:04:16 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Updating instance_info_cache with network_info: [{"id": "592aca55-ee83-458e-be09-3a7c1020e98c", "address": "fa:16:3e:4f:64:97", "network": {"id": "60ef765c-367f-47f4-86cf-89862b70db21", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-243785190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67731fef3cd244f49db891b2b7943527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592aca55-ee", "ovs_interfaceid": "592aca55-ee83-458e-be09-3a7c1020e98c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:04:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:04:16 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:04:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:04:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:04:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:04:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:04:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:04:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:04:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:04:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:04:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:04:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:04:32 user nova-compute[72150]: DEBUG nova.objects.instance [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lazy-loading 'flavor' on Instance uuid 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:04:33 user nova-compute[72150]: INFO nova.compute.manager [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Attaching volume ea639a9c-683b-4973-9c9f-097f2705e7aa to /dev/vdb
Aug 01 19:04:33 user nova-compute[72150]: DEBUG os_brick.utils [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a22de7-de54-4ea7-8289-7a193128221c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c77909-3862-4a99-b540-9dcee5ab3c83]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e78075-958b-4055-a50d-398ac3072e80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf78388-b7bb-41cd-b1e0-7132090e991f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:04:33 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:04:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6921b112-d091-4e65-9bf7-8cbecf828deb]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG os_brick.utils [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:04:33 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Updating existing volume attachment record: 06503456-5d55-49eb-8d37-15a40f2259c7 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:04:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:04:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SThCHamx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:04:40 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:04:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:04:40 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:04:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:04:40 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5363a12-38cb-4850-a335-c2e0ef69e3d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:04:40 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf1dc97-963b-4725-ad17-f1f3216a972e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa] added
Aug 01 19:04:40 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6e9233-d69c-4348-bf2f-f4cccb46aa41]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4016c66-9749-41dd-a693-d8422d8526ca]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SThCHamx {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SThCHamx" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c46c9a0-4fe0-4cac-afc9-bc49d192e399]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SThCHamx'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[54643404-7158-4f96-9159-bd5bfb9e6a56]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a41e7d-c38d-4a29-928c-157d57fafe1e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 19:04:40 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 19:04:40 user nova-compute[72150]:  {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:04:40 user nova-compute[72150]: WARNING os_brick.initiator.connectors.iscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 19:04:40 user nova-compute[72150]: 
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2145e3-c2da-45ee-aceb-4fc4714b1232]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa, portal: 172.16.0.220,3260]
Aug 01 19:04:40 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa, portal: 172.16.0.220,3260] successful.
Aug 01 19:04:40 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7f13b4-3d43-4e43-86dc-a6f1a159f910]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c43730-b7ca-49b4-b361-5e9d86fe63d2]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa (non-flash)
Aug 01 19:04:40 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa (non-flash)
Aug 01 19:04:40 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9841a9e4-69d7-45e1-908e-27760d018a5a]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:40 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:04:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:04:41 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:04:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SThCHamx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:04:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:04:41 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23963343230326634', 'path': '/dev/sdb'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:04:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963343230326634', 'path': '/dev/sdb'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:04:41 user nova-compute[72150]: DEBUG nova.objects.instance [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lazy-loading 'flavor' on Instance uuid 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:04:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 19:04:41 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:04:41 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:04:41 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:04:41 user nova-compute[72150]:   <serial>ea639a9c-683b-4973-9c9f-097f2705e7aa</serial>
Aug 01 19:04:41 user nova-compute[72150]: </disk>
Aug 01 19:04:41 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 19:04:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:04:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:04:41 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] No VIF found with MAC fa:16:3e:4f:64:97, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:04:42 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-befebc32-421c-4893-ab33-6a2d4b880ca2 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.307s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:04:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:04:44 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:04:44 user nova-compute[72150]: INFO nova.compute.manager [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Detaching volume ea639a9c-683b-4973-9c9f-097f2705e7aa
Aug 01 19:04:44 user nova-compute[72150]: INFO nova.virt.block_device [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Attempting to driver detach volume ea639a9c-683b-4973-9c9f-097f2705e7aa from mountpoint /dev/vdb
Aug 01 19:04:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Attempting to detach device vdb from instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 19:04:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:04:44 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:04:44 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:04:44 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:04:44 user nova-compute[72150]:   <serial>ea639a9c-683b-4973-9c9f-097f2705e7aa</serial>
Aug 01 19:04:44 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:04:44 user nova-compute[72150]: </disk>
Aug 01 19:04:44 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:04:44 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Successfully detached device vdb from instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 from the persistent domain config.
Aug 01 19:04:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 19:04:44 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:04:44 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:04:44 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:04:44 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:04:44 user nova-compute[72150]:   <serial>ea639a9c-683b-4973-9c9f-097f2705e7aa</serial>
Aug 01 19:04:44 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:04:44 user nova-compute[72150]: </disk>
Aug 01 19:04:44 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690916685.0949361, 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 19:04:45 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Successfully detached device vdb from instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 from the live domain config.
Aug 01 19:04:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SThCHamx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:04:45 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:04:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3c9350-6322-48b0-960d-9d8af2cfdf72]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44ccdb7-bea0-42ce-9a85-f4c822769657]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa (non-flash)
Aug 01 19:04:45 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa (non-flash)
Aug 01 19:04:45 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c2b4310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa'): ({'sdb'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Removing single pathed devices sdb {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b0e65a-7aa9-457a-9171-9f5a24de49ce]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7132df5-0b43-4d7f-aa23-dda4da15b634]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Flushing IO for device /dev/sdb {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba028de-368f-41ef-b2aa-36ee12e6f7c8]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f990e9e2-cca1-4348-b9c9-1bfcbfcedbb2]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c8bea6-5c2b-4bcc-86bd-8ab764f016a1]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[451ca243-a44c-4620-ae0e-5c81ea9badf6]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa, portal: 172.16.0.220,3260]
Aug 01 19:04:45 user nova-compute[72150]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa, portal: 172.16.0.220,3260] successful.
Aug 01 19:04:45 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea639a9c-683b-4973-9c9f-097f2705e7aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9652342d-7047-48e9-a1b4-9aee1fe9f3da]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] <== disconnect_volume: return (283ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:04:45 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:04:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:04:46 user nova-compute[72150]: DEBUG nova.objects.instance [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lazy-loading 'flavor' on Instance uuid 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:04:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-73aa46e8-2933-403a-b82f-0e6326e467bb tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.589s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:04:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:04:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:04:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:04:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:04:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:04:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:04:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:04:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:04:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:04:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:04:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:04:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:04:57 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:04:59 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:04:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:04:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:04:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:04:59 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:04:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:00 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:05:00 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:05:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8821MB free_disk=25.338394165039062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:05:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:05:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:05:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:05:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:05:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:05:00 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:05:00 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:05:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:05:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:05:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:05:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:05:08 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:05:08 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:05:08 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:05:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:05:11 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:05:13 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:05:13 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:05:13 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:05:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:05:16 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:05:16 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:05:16 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:05:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:05:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:05:16 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:05:16 user nova-compute[72150]: DEBUG nova.objects.instance [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lazy-loading 'info_cache' on Instance uuid 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:05:17 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Updating instance_info_cache with network_info: [{"id": "592aca55-ee83-458e-be09-3a7c1020e98c", "address": "fa:16:3e:4f:64:97", "network": {"id": "60ef765c-367f-47f4-86cf-89862b70db21", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-243785190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67731fef3cd244f49db891b2b7943527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592aca55-ee", "ovs_interfaceid": "592aca55-ee83-458e-be09-3a7c1020e98c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:05:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:05:17 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:05:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:05:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:05:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:05:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:05:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:05:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:05:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:05:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:05:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:05:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:05:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:05:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:05:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:05:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:05:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:05:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:05:38 user nova-compute[72150]: DEBUG nova.objects.instance [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lazy-loading 'flavor' on Instance uuid 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:05:38 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:05:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:05:39 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:05:39 user nova-compute[72150]: INFO nova.compute.manager [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Attaching volume 2baf6d60-f585-43d0-92c4-9cdb478a4cb5 to /dev/vdb
Aug 01 19:05:39 user nova-compute[72150]: DEBUG os_brick.utils [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:05:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[664e3492-82cd-4030-a89f-fa0fa0ad6cf0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f57299-dc16-4f52-9ca3-896a83060e63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19d6c42-df4f-463d-8ed9-e32def4d7191]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53f1df5-2756-44a0-be34-9baac3ba6fd7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:05:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:05:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:39 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:05:39 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:05:39 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2faa10a5-71bc-481b-bbe5-e4302c8307f5]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:05:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:05:39 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:05:39 user nova-compute[72150]: DEBUG os_brick.utils [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:05:39 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Updating existing volume attachment record: 2592c6bb-fc3b-40cc-806e-4d619e83642a {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:05:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:05:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nToKjfyB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:05:46 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:05:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:05:46 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:05:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:05:46 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[51865e9f-af24-4a19-bd4b-1d2e2e03645a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:05:46 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1252d32b-6c25-4267-99ee-165d4d599635]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5] added
Aug 01 19:05:46 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[968fe9d9-05cc-4cfa-943a-8a670936a567]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9778b87-7738-4e7f-b890-ef25061fa9f8]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nToKjfyB {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nToKjfyB" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8feea89-a859-44fe-b7b8-fdf40311eedc]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nToKjfyB'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14c2cbb-5e07-4174-b6f3-932aba184a13]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5baae9-3fcd-41d8-9c4c-06d9fc298dd1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 19:05:46 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 19:05:46 user nova-compute[72150]:  {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:05:46 user nova-compute[72150]: WARNING os_brick.initiator.connectors.iscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 19:05:46 user nova-compute[72150]: 
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6554c50b-21c7-4ac7-b46c-63682582f63b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5, portal: 172.16.0.220,3260]
Aug 01 19:05:46 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5, portal: 172.16.0.220,3260] successful.
Aug 01 19:05:46 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e53235a-da01-4a02-8013-c1fcfc1db042]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[688309f2-38b1-4932-96f3-8f1202aaf381]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 (non-flash)
Aug 01 19:05:46 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 (non-flash)
Aug 01 19:05:46 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c479481-c9c3-4b91-8f7f-a1f4ee8334b0]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:46 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:05:47 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:05:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nToKjfyB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:05:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:05:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23238656561353564', 'path': '/dev/sdb'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:05:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238656561353564', 'path': '/dev/sdb'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:05:47 user nova-compute[72150]: DEBUG nova.objects.instance [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lazy-loading 'flavor' on Instance uuid 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:05:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 19:05:47 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:05:47 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:05:47 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:05:47 user nova-compute[72150]:   <serial>2baf6d60-f585-43d0-92c4-9cdb478a4cb5</serial>
Aug 01 19:05:47 user nova-compute[72150]: </disk>
Aug 01 19:05:47 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 19:05:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:05:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:05:47 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] No VIF found with MAC fa:16:3e:4f:64:97, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:05:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-dd46acde-847c-4b18-b174-d7816348a130 tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.904s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:05:50 user nova-compute[72150]: INFO nova.compute.manager [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Detaching volume 2baf6d60-f585-43d0-92c4-9cdb478a4cb5
Aug 01 19:05:50 user nova-compute[72150]: INFO nova.virt.block_device [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Attempting to driver detach volume 2baf6d60-f585-43d0-92c4-9cdb478a4cb5 from mountpoint /dev/vdb
Aug 01 19:05:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Attempting to detach device vdb from instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:05:50 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:05:50 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:05:50 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:05:50 user nova-compute[72150]:   <serial>2baf6d60-f585-43d0-92c4-9cdb478a4cb5</serial>
Aug 01 19:05:50 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:05:50 user nova-compute[72150]: </disk>
Aug 01 19:05:50 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:05:50 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Successfully detached device vdb from instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 from the persistent domain config.
Aug 01 19:05:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:05:50 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:05:50 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:05:50 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:05:50 user nova-compute[72150]:   <serial>2baf6d60-f585-43d0-92c4-9cdb478a4cb5</serial>
Aug 01 19:05:50 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:05:50 user nova-compute[72150]: </disk>
Aug 01 19:05:50 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690916750.7966459, 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 19:05:50 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Successfully detached device vdb from instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 from the live domain config.
Aug 01 19:05:50 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nToKjfyB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:05:50 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:05:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a31d676-bdbd-4bae-a7b8-3b58b96dfd82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[933f0a84-8519-4a72-babb-52cd16f9adca]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 (non-flash)
Aug 01 19:05:50 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 (non-flash)
Aug 01 19:05:50 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c523c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5'): ({'sdb'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Removing single pathed devices sdb {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c7d9a9-095f-4074-b8f2-23b8932bcc7f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb300889-4559-4e38-9e37-8c8a97187c10]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Flushing IO for device /dev/sdb {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2741c444-6333-49a1-adfd-b38283b4eba2]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4949df6e-7a61-4de6-9090-6a35cf9887a3]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbcb206-2530-48b2-9525-b0ace8bcf18a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:50 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:05:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:51 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2a1701-ea37-4073-b75c-89b3db9ff25a]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5, portal: 172.16.0.220,3260]
Aug 01 19:05:51 user nova-compute[72150]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5, portal: 172.16.0.220,3260] successful.
Aug 01 19:05:51 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:05:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:05:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2baf6d60-f585-43d0-92c4-9cdb478a4cb5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:05:51 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9827a6-0947-4f26-9ac2-5f62609f80a2]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:05:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:05:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:05:51 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] <== disconnect_volume: return (260ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:05:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:05:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:05:51 user nova-compute[72150]: DEBUG nova.objects.instance [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lazy-loading 'flavor' on Instance uuid 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:05:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-d1f015e3-9537-47c5-9369-d5072271787f tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.543s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:05:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:05:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:05:58 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:05:59 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:05:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:05:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:05:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:05:59 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:05:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:06:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:06:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:06:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:06:00 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:06:00 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:06:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8815MB free_disk=25.337371826171875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:06:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:06:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:06:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:06:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:06:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:06:00 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:06:00 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:06:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:06:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:06:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:06:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:06:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:06:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:06:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:06:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:06:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:06:09 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:06:09 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:06:09 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:06:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:06:11 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:06:14 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:06:15 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:06:15 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:06:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:06:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:06:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:06:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:06:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:06:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:06:16 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:06:16 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:06:16 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:06:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:06:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:06:16 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:06:16 user nova-compute[72150]: DEBUG nova.objects.instance [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lazy-loading 'info_cache' on Instance uuid 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:06:17 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Updating instance_info_cache with network_info: [{"id": "592aca55-ee83-458e-be09-3a7c1020e98c", "address": "fa:16:3e:4f:64:97", "network": {"id": "60ef765c-367f-47f4-86cf-89862b70db21", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-243785190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67731fef3cd244f49db891b2b7943527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592aca55-ee", "ovs_interfaceid": "592aca55-ee83-458e-be09-3a7c1020e98c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:06:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:06:17 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:06:18 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:06:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:06:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:06:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:06:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:06:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:06:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:06:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:06:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:06:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:06:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:06:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:06:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:06:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:06:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:06:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:06:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:06:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:06:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:06:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:06:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:06:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:06:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:06:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:06:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:06:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:06:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:06:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:06:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:06:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:06:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:06:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:06:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:06:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:06:59 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:06:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:06:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:06:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:06:59 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:06:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:07:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:07:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:07:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:07:00 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:07:00 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:07:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8835MB free_disk=25.33654022216797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:07:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:07:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:07:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:07:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:07:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:07:00 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:07:00 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:07:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:07:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:07:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:07:01 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:07:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:07:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:07:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:07:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:07:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:07:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:07:08 user nova-compute[72150]: INFO nova.compute.manager [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Terminating instance
Aug 01 19:07:08 user nova-compute[72150]: DEBUG nova.compute.manager [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 19:07:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:07:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:07:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:07:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:07:09 user nova-compute[72150]: DEBUG nova.compute.manager [req-640db062-e8d0-48bc-a9b1-92647a83550c req-dc2ee886-c70c-4a83-9979-751cddaa06e1 service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Received event network-vif-unplugged-592aca55-ee83-458e-be09-3a7c1020e98c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:07:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-640db062-e8d0-48bc-a9b1-92647a83550c req-dc2ee886-c70c-4a83-9979-751cddaa06e1 service nova] Acquiring lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:07:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-640db062-e8d0-48bc-a9b1-92647a83550c req-dc2ee886-c70c-4a83-9979-751cddaa06e1 service nova] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:07:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-640db062-e8d0-48bc-a9b1-92647a83550c req-dc2ee886-c70c-4a83-9979-751cddaa06e1 service nova] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:07:09 user nova-compute[72150]: DEBUG nova.compute.manager [req-640db062-e8d0-48bc-a9b1-92647a83550c req-dc2ee886-c70c-4a83-9979-751cddaa06e1 service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] No waiting events found dispatching network-vif-unplugged-592aca55-ee83-458e-be09-3a7c1020e98c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:07:09 user nova-compute[72150]: DEBUG nova.compute.manager [req-640db062-e8d0-48bc-a9b1-92647a83550c req-dc2ee886-c70c-4a83-9979-751cddaa06e1 service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Received event network-vif-unplugged-592aca55-ee83-458e-be09-3a7c1020e98c for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:07:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:07:09 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Instance destroyed successfully.
Aug 01 19:07:09 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lazy-loading 'resources' on Instance uuid 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:07:09 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:00:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2080551018',display_name='tempest-SnapshotDataIntegrityTests-server-2080551018',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2080551018',id=51,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBHo1UdNh9E3cfGsQvIpk3U/+DVZ/EwJ3JuSUW9RkPJyXnzifJjIUnpIEDU5WWremxY3+k9rZsYovun/o8iVW9dO2WecN/z8ivM13c7h5mkuYxSIl1lRbTp04RLWoW+SA==',key_name='tempest-keypair-2117792201',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:00:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67731fef3cd244f49db891b2b7943527',ramdisk_id='',reservation_id='r-5q6h3owx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-555465620',owner_user_name='tempest-SnapshotDataIntegrityTests-555465620-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:00:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0d10a9a129418298a1d651126d8b20',uuid=2049a6fc-d724-4ff5-9922-9ddcd00b4ac5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "592aca55-ee83-458e-be09-3a7c1020e98c", "address": "fa:16:3e:4f:64:97", "network": {"id": "60ef765c-367f-47f4-86cf-89862b70db21", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-243785190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67731fef3cd244f49db891b2b7943527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592aca55-ee", "ovs_interfaceid": "592aca55-ee83-458e-be09-3a7c1020e98c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:07:09 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Converting VIF {"id": "592aca55-ee83-458e-be09-3a7c1020e98c", "address": "fa:16:3e:4f:64:97", "network": {"id": "60ef765c-367f-47f4-86cf-89862b70db21", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-243785190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67731fef3cd244f49db891b2b7943527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592aca55-ee", "ovs_interfaceid": "592aca55-ee83-458e-be09-3a7c1020e98c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:07:09 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:64:97,bridge_name='br-int',has_traffic_filtering=True,id=592aca55-ee83-458e-be09-3a7c1020e98c,network=Network(60ef765c-367f-47f4-86cf-89862b70db21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592aca55-ee') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:07:09 user nova-compute[72150]: DEBUG os_vif [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:64:97,bridge_name='br-int',has_traffic_filtering=True,id=592aca55-ee83-458e-be09-3a7c1020e98c,network=Network(60ef765c-367f-47f4-86cf-89862b70db21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592aca55-ee') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:07:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:07:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap592aca55-ee, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:07:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:07:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:07:09 user nova-compute[72150]: INFO os_vif [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:64:97,bridge_name='br-int',has_traffic_filtering=True,id=592aca55-ee83-458e-be09-3a7c1020e98c,network=Network(60ef765c-367f-47f4-86cf-89862b70db21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592aca55-ee')
Aug 01 19:07:09 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Deleting instance files /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5_del
Aug 01 19:07:09 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Deletion of /opt/stack/data/nova/instances/2049a6fc-d724-4ff5-9922-9ddcd00b4ac5_del complete
Aug 01 19:07:09 user nova-compute[72150]: INFO nova.compute.manager [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 01 19:07:09 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 19:07:09 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 19:07:09 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 19:07:09 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:07:11 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:07:11 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Took 1.41 seconds to deallocate network for instance.
Aug 01 19:07:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:07:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:07:11 user nova-compute[72150]: DEBUG nova.compute.manager [req-25b23130-855c-4301-b1db-27dd75b828b9 req-d0461ed8-fe1f-4927-aca6-89f2dc072adc service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Received event network-vif-deleted-592aca55-ee83-458e-be09-3a7c1020e98c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:07:11 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:07:11 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:07:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.112s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:07:11 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Deleted allocations for instance 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5
Aug 01 19:07:11 user nova-compute[72150]: DEBUG nova.compute.manager [req-4cb25229-718b-4743-a1b0-ac687573042e req-a026e1af-4cee-4f18-8c22-4a22558c6099 service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Received event network-vif-plugged-592aca55-ee83-458e-be09-3a7c1020e98c {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:07:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4cb25229-718b-4743-a1b0-ac687573042e req-a026e1af-4cee-4f18-8c22-4a22558c6099 service nova] Acquiring lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:07:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4cb25229-718b-4743-a1b0-ac687573042e req-a026e1af-4cee-4f18-8c22-4a22558c6099 service nova] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:07:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-4cb25229-718b-4743-a1b0-ac687573042e req-a026e1af-4cee-4f18-8c22-4a22558c6099 service nova] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:07:11 user nova-compute[72150]: DEBUG nova.compute.manager [req-4cb25229-718b-4743-a1b0-ac687573042e req-a026e1af-4cee-4f18-8c22-4a22558c6099 service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] No waiting events found dispatching network-vif-plugged-592aca55-ee83-458e-be09-3a7c1020e98c {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:07:11 user nova-compute[72150]: WARNING nova.compute.manager [req-4cb25229-718b-4743-a1b0-ac687573042e req-a026e1af-4cee-4f18-8c22-4a22558c6099 service nova] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Received unexpected event network-vif-plugged-592aca55-ee83-458e-be09-3a7c1020e98c for instance with vm_state deleted and task_state None.
Aug 01 19:07:11 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9fe6e5f1-c95b-4967-9fb8-6ff6c307a79d tempest-SnapshotDataIntegrityTests-555465620 tempest-SnapshotDataIntegrityTests-555465620-project-member] Lock "2049a6fc-d724-4ff5-9922-9ddcd00b4ac5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.634s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:07:11 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:07:11 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:07:13 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:07:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:07:15 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:07:15 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:07:15 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:07:17 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:07:17 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:07:17 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:07:17 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Didn't find any instances for network info cache update. {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 19:07:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:07:24 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690916829.5998592, 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5 => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:07:24 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] VM Stopped (Lifecycle Event)
Aug 01 19:07:24 user nova-compute[72150]: DEBUG nova.compute.manager [None req-a0b528b6-a068-489e-9174-dc53a51ddfe4 None None] [instance: 2049a6fc-d724-4ff5-9922-9ddcd00b4ac5] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:07:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:07:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:07:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:07:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:07:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:07:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:07:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:07:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:07:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:07:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:07:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:07:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:07:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:07:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:07:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:07:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:07:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:07:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:07:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:07:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:07:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:07:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:07:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:07:59 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:07:59 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:07:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:07:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:07:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:07:59 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:08:00 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:08:00 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:08:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8982MB free_disk=25.363853454589844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:08:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:08:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:08:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:08:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:08:00 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:08:00 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:08:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:08:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:08:01 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:08:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:04 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:09 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:10 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:08:12 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:08:12 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:08:13 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:08:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:08:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:08:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:08:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:08:14 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:15 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:08:15 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:08:15 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:08:15 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:08:16 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:08:16 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72150) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 19:08:18 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:08:18 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:08:18 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:08:18 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:08:18 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Didn't find any instances for network info cache update. {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 19:08:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:08:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:08:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:08:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:08:19 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:24 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:08:29 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:34 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:37 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:08:37 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Cleaning up deleted instances {{(pid=72150) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 19:08:37 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] There are 0 instances to clean {{(pid=72150) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 19:08:39 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:40 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:40 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:08:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:44 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:08:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:08:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Starting instance... {{(pid=72150) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:08:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:08:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:08:50 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72150) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:08:50 user nova-compute[72150]: INFO nova.compute.claims [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Claim successful on node user
Aug 01 19:08:50 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:08:50 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:08:50 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.245s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:08:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Start building networks asynchronously for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:08:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Allocating IP information in the background. {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:08:50 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] allocate_for_instance() {{(pid=72150) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:08:50 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:08:50 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Start building block device mappings for instance. {{(pid=72150) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:08:50 user nova-compute[72150]: DEBUG nova.policy [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df42f154c3094d45ac81a63bbd0b3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b533d6e10caa4f1b94b1cfad43558180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72150) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Start spawning the instance on the hypervisor. {{(pid=72150) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Creating instance directory {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:08:51 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Creating image(s)
Aug 01 19:08:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "/opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "/opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "/opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.141s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.169s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk 1073741824 {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c,backing_fmt=raw /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk 1073741824" returned: 0 in 0.053s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "9509017e0dbd9a8276203b492c7ed023c7003d3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Successfully created port: b9b7b8ff-3f6b-41de-825d-25fe027e5cd3 {{(pid=72150) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9509017e0dbd9a8276203b492c7ed023c7003d3c --force-share --output=json" returned: 0 in 0.181s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Checking if we can resize image /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk. size=1073741824 {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG nova.virt.disk.api [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Cannot resize image /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk to a smaller size. {{(pid=72150) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG nova.objects.instance [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lazy-loading 'migration_context' on Instance uuid 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Created local disks {{(pid=72150) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Ensure instance console log exists: /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/console.log {{(pid=72150) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:08:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:08:52 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Successfully updated port: b9b7b8ff-3f6b-41de-825d-25fe027e5cd3 {{(pid=72150) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:08:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:08:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquired lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:08:52 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Building network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:08:52 user nova-compute[72150]: DEBUG nova.compute.manager [req-810ec69f-88a2-475f-9735-3495af93605e req-bf3e9865-d330-461b-87aa-108ab5e0e6fa service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Received event network-changed-b9b7b8ff-3f6b-41de-825d-25fe027e5cd3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:08:52 user nova-compute[72150]: DEBUG nova.compute.manager [req-810ec69f-88a2-475f-9735-3495af93605e req-bf3e9865-d330-461b-87aa-108ab5e0e6fa service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Refreshing instance network info cache due to event network-changed-b9b7b8ff-3f6b-41de-825d-25fe027e5cd3. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:08:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-810ec69f-88a2-475f-9735-3495af93605e req-bf3e9865-d330-461b-87aa-108ab5e0e6fa service nova] Acquiring lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:08:52 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Instance cache missing network info. {{(pid=72150) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.network.neutron [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updating instance_info_cache with network_info: [{"id": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "address": "fa:16:3e:1a:97:73", "network": {"id": "12107337-8a71-4fd9-a156-06c0edae1d5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2119935962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b533d6e10caa4f1b94b1cfad43558180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b7b8ff-3f", "ovs_interfaceid": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Releasing lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Instance network_info: |[{"id": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "address": "fa:16:3e:1a:97:73", "network": {"id": "12107337-8a71-4fd9-a156-06c0edae1d5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2119935962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b533d6e10caa4f1b94b1cfad43558180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b7b8ff-3f", "ovs_interfaceid": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72150) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-810ec69f-88a2-475f-9735-3495af93605e req-bf3e9865-d330-461b-87aa-108ab5e0e6fa service nova] Acquired lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.network.neutron [req-810ec69f-88a2-475f-9735-3495af93605e req-bf3e9865-d330-461b-87aa-108ab5e0e6fa service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Refreshing network info cache for port b9b7b8ff-3f6b-41de-825d-25fe027e5cd3 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Start _get_guest_xml network_info=[{"id": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "address": "fa:16:3e:1a:97:73", "network": {"id": "12107337-8a71-4fd9-a156-06c0edae1d5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2119935962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b533d6e10caa4f1b94b1cfad43558180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b7b8ff-3f", "ovs_interfaceid": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'dbc6b740-0555-4041-80f6-323ecd1d67db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:08:53 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:08:53 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] CPU controller missing on host. {{(pid=72150) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.host [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] CPU controller found on host. {{(pid=72150) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72150) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T18:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T18:17:49Z,direct_url=<?>,disk_format='qcow2',id=dbc6b740-0555-4041-80f6-323ecd1d67db,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='efb71aa93c5d4aa2b46478912805009b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T18:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Flavor limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Image limits 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Flavor pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Image pref 0:0:0 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Got 1 possible topologies {{(pid=72150) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.virt.hardware [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72150) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1630682906',display_name='tempest-SnapshotDataIntegrityTests-server-1630682906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1630682906',id=52,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+gaBEon/HiqDrZlF8rwh64s8am4wRqK9HPYdJLOyWg0bZFhIyOLFoA4WM4tkFQbtC6vBCh8jAaSqGdElSe8Y7snvWFdOluancJtAgAGKqFO7oBIEznXr2eLmZkrLR/3g==',key_name='tempest-keypair-239562411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b533d6e10caa4f1b94b1cfad43558180',ramdisk_id='',reservation_id='r-u4ifej6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-937413752',owner_user_name='tempest-SnapshotDataIntegrityTests-937413752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df42f154c3094d45ac81a63bbd0b3608',uuid=683d3b67-042a-4d95-baff-8657e3e0f7ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "address": "fa:16:3e:1a:97:73", "network": {"id": "12107337-8a71-4fd9-a156-06c0edae1d5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2119935962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b533d6e10caa4f1b94b1cfad43558180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b7b8ff-3f", "ovs_interfaceid": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72150) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Converting VIF {"id": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "address": "fa:16:3e:1a:97:73", "network": {"id": "12107337-8a71-4fd9-a156-06c0edae1d5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2119935962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b533d6e10caa4f1b94b1cfad43558180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b7b8ff-3f", "ovs_interfaceid": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:97:73,bridge_name='br-int',has_traffic_filtering=True,id=b9b7b8ff-3f6b-41de-825d-25fe027e5cd3,network=Network(12107337-8a71-4fd9-a156-06c0edae1d5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9b7b8ff-3f') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.objects.instance [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lazy-loading 'pci_devices' on Instance uuid 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:08:53 user nova-compute[72150]:   <uuid>683d3b67-042a-4d95-baff-8657e3e0f7ad</uuid>
Aug 01 19:08:53 user nova-compute[72150]:   <name>instance-00000034</name>
Aug 01 19:08:53 user nova-compute[72150]:   <memory>524288</memory>
Aug 01 19:08:53 user nova-compute[72150]:   <vcpu>1</vcpu>
Aug 01 19:08:53 user nova-compute[72150]:   <metadata>
Aug 01 19:08:53 user nova-compute[72150]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:08:53 user nova-compute[72150]:       <nova:package version="0.0.0"/>
Aug 01 19:08:53 user nova-compute[72150]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1630682906</nova:name>
Aug 01 19:08:53 user nova-compute[72150]:       <nova:creationTime>2023-08-01 19:08:53</nova:creationTime>
Aug 01 19:08:53 user nova-compute[72150]:       <nova:flavor name="m1.tiny">
Aug 01 19:08:53 user nova-compute[72150]:         <nova:memory>512</nova:memory>
Aug 01 19:08:53 user nova-compute[72150]:         <nova:disk>1</nova:disk>
Aug 01 19:08:53 user nova-compute[72150]:         <nova:swap>0</nova:swap>
Aug 01 19:08:53 user nova-compute[72150]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:08:53 user nova-compute[72150]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:08:53 user nova-compute[72150]:       </nova:flavor>
Aug 01 19:08:53 user nova-compute[72150]:       <nova:owner>
Aug 01 19:08:53 user nova-compute[72150]:         <nova:user uuid="df42f154c3094d45ac81a63bbd0b3608">tempest-SnapshotDataIntegrityTests-937413752-project-member</nova:user>
Aug 01 19:08:53 user nova-compute[72150]:         <nova:project uuid="b533d6e10caa4f1b94b1cfad43558180">tempest-SnapshotDataIntegrityTests-937413752</nova:project>
Aug 01 19:08:53 user nova-compute[72150]:       </nova:owner>
Aug 01 19:08:53 user nova-compute[72150]:       <nova:root type="image" uuid="dbc6b740-0555-4041-80f6-323ecd1d67db"/>
Aug 01 19:08:53 user nova-compute[72150]:       <nova:ports>
Aug 01 19:08:53 user nova-compute[72150]:         <nova:port uuid="b9b7b8ff-3f6b-41de-825d-25fe027e5cd3">
Aug 01 19:08:53 user nova-compute[72150]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 19:08:53 user nova-compute[72150]:         </nova:port>
Aug 01 19:08:53 user nova-compute[72150]:       </nova:ports>
Aug 01 19:08:53 user nova-compute[72150]:     </nova:instance>
Aug 01 19:08:53 user nova-compute[72150]:   </metadata>
Aug 01 19:08:53 user nova-compute[72150]:   <sysinfo type="smbios">
Aug 01 19:08:53 user nova-compute[72150]:     <system>
Aug 01 19:08:53 user nova-compute[72150]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:08:53 user nova-compute[72150]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:08:53 user nova-compute[72150]:       <entry name="version">0.0.0</entry>
Aug 01 19:08:53 user nova-compute[72150]:       <entry name="serial">683d3b67-042a-4d95-baff-8657e3e0f7ad</entry>
Aug 01 19:08:53 user nova-compute[72150]:       <entry name="uuid">683d3b67-042a-4d95-baff-8657e3e0f7ad</entry>
Aug 01 19:08:53 user nova-compute[72150]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:08:53 user nova-compute[72150]:     </system>
Aug 01 19:08:53 user nova-compute[72150]:   </sysinfo>
Aug 01 19:08:53 user nova-compute[72150]:   <os>
Aug 01 19:08:53 user nova-compute[72150]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:08:53 user nova-compute[72150]:     <boot dev="hd"/>
Aug 01 19:08:53 user nova-compute[72150]:     <smbios mode="sysinfo"/>
Aug 01 19:08:53 user nova-compute[72150]:   </os>
Aug 01 19:08:53 user nova-compute[72150]:   <features>
Aug 01 19:08:53 user nova-compute[72150]:     <acpi/>
Aug 01 19:08:53 user nova-compute[72150]:     <apic/>
Aug 01 19:08:53 user nova-compute[72150]:     <vmcoreinfo/>
Aug 01 19:08:53 user nova-compute[72150]:   </features>
Aug 01 19:08:53 user nova-compute[72150]:   <clock offset="utc">
Aug 01 19:08:53 user nova-compute[72150]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:08:53 user nova-compute[72150]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:08:53 user nova-compute[72150]:     <timer name="hpet" present="no"/>
Aug 01 19:08:53 user nova-compute[72150]:   </clock>
Aug 01 19:08:53 user nova-compute[72150]:   <cpu mode="custom" match="exact">
Aug 01 19:08:53 user nova-compute[72150]:     <model>Nehalem</model>
Aug 01 19:08:53 user nova-compute[72150]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:08:53 user nova-compute[72150]:   </cpu>
Aug 01 19:08:53 user nova-compute[72150]:   <devices>
Aug 01 19:08:53 user nova-compute[72150]:     <disk type="file" device="disk">
Aug 01 19:08:53 user nova-compute[72150]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:08:53 user nova-compute[72150]:       <source file="/opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk"/>
Aug 01 19:08:53 user nova-compute[72150]:       <target dev="vda" bus="virtio"/>
Aug 01 19:08:53 user nova-compute[72150]:     </disk>
Aug 01 19:08:53 user nova-compute[72150]:     <interface type="ethernet">
Aug 01 19:08:53 user nova-compute[72150]:       <mac address="fa:16:3e:1a:97:73"/>
Aug 01 19:08:53 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 19:08:53 user nova-compute[72150]:       <mtu size="1442"/>
Aug 01 19:08:53 user nova-compute[72150]:       <target dev="tapb9b7b8ff-3f"/>
Aug 01 19:08:53 user nova-compute[72150]:     </interface>
Aug 01 19:08:53 user nova-compute[72150]:     <serial type="pty">
Aug 01 19:08:53 user nova-compute[72150]:       <log file="/opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/console.log" append="off"/>
Aug 01 19:08:53 user nova-compute[72150]:     </serial>
Aug 01 19:08:53 user nova-compute[72150]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:08:53 user nova-compute[72150]:     <video>
Aug 01 19:08:53 user nova-compute[72150]:       <model type="virtio"/>
Aug 01 19:08:53 user nova-compute[72150]:     </video>
Aug 01 19:08:53 user nova-compute[72150]:     <rng model="virtio">
Aug 01 19:08:53 user nova-compute[72150]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:08:53 user nova-compute[72150]:     </rng>
Aug 01 19:08:53 user nova-compute[72150]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:08:53 user nova-compute[72150]:     <memballoon model="virtio">
Aug 01 19:08:53 user nova-compute[72150]:       <stats period="10"/>
Aug 01 19:08:53 user nova-compute[72150]:     </memballoon>
Aug 01 19:08:53 user nova-compute[72150]:   </devices>
Aug 01 19:08:53 user nova-compute[72150]: </domain>
Aug 01 19:08:53 user nova-compute[72150]:  {{(pid=72150) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1630682906',display_name='tempest-SnapshotDataIntegrityTests-server-1630682906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1630682906',id=52,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+gaBEon/HiqDrZlF8rwh64s8am4wRqK9HPYdJLOyWg0bZFhIyOLFoA4WM4tkFQbtC6vBCh8jAaSqGdElSe8Y7snvWFdOluancJtAgAGKqFO7oBIEznXr2eLmZkrLR/3g==',key_name='tempest-keypair-239562411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b533d6e10caa4f1b94b1cfad43558180',ramdisk_id='',reservation_id='r-u4ifej6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-937413752',owner_user_name='tempest-SnapshotDataIntegrityTests-937413752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df42f154c3094d45ac81a63bbd0b3608',uuid=683d3b67-042a-4d95-baff-8657e3e0f7ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "address": "fa:16:3e:1a:97:73", "network": {"id": "12107337-8a71-4fd9-a156-06c0edae1d5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2119935962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b533d6e10caa4f1b94b1cfad43558180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b7b8ff-3f", "ovs_interfaceid": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Converting VIF {"id": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "address": "fa:16:3e:1a:97:73", "network": {"id": "12107337-8a71-4fd9-a156-06c0edae1d5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2119935962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b533d6e10caa4f1b94b1cfad43558180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b7b8ff-3f", "ovs_interfaceid": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:97:73,bridge_name='br-int',has_traffic_filtering=True,id=b9b7b8ff-3f6b-41de-825d-25fe027e5cd3,network=Network(12107337-8a71-4fd9-a156-06c0edae1d5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9b7b8ff-3f') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG os_vif [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:97:73,bridge_name='br-int',has_traffic_filtering=True,id=b9b7b8ff-3f6b-41de-825d-25fe027e5cd3,network=Network(12107337-8a71-4fd9-a156-06c0edae1d5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9b7b8ff-3f') {{(pid=72150) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9b7b8ff-3f, may_exist=True, interface_attrs={}) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb9b7b8ff-3f, col_values=(('external_ids', {'iface-id': 'b9b7b8ff-3f6b-41de-825d-25fe027e5cd3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:97:73', 'vm-uuid': '683d3b67-042a-4d95-baff-8657e3e0f7ad'}),), if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:53 user nova-compute[72150]: INFO os_vif [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:97:73,bridge_name='br-int',has_traffic_filtering=True,id=b9b7b8ff-3f6b-41de-825d-25fe027e5cd3,network=Network(12107337-8a71-4fd9-a156-06c0edae1d5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9b7b8ff-3f')
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] No VIF found with MAC fa:16:3e:1a:97:73, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.network.neutron [req-810ec69f-88a2-475f-9735-3495af93605e req-bf3e9865-d330-461b-87aa-108ab5e0e6fa service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updated VIF entry in instance network info cache for port b9b7b8ff-3f6b-41de-825d-25fe027e5cd3. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG nova.network.neutron [req-810ec69f-88a2-475f-9735-3495af93605e req-bf3e9865-d330-461b-87aa-108ab5e0e6fa service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updating instance_info_cache with network_info: [{"id": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "address": "fa:16:3e:1a:97:73", "network": {"id": "12107337-8a71-4fd9-a156-06c0edae1d5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2119935962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b533d6e10caa4f1b94b1cfad43558180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b7b8ff-3f", "ovs_interfaceid": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:08:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-810ec69f-88a2-475f-9735-3495af93605e req-bf3e9865-d330-461b-87aa-108ab5e0e6fa service nova] Releasing lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:08:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:54 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:55 user nova-compute[72150]: DEBUG nova.compute.manager [req-7beb8662-e67c-4744-b01e-ff780eaa6aa3 req-5befa937-89f3-405c-b43d-4a00cc0494f1 service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Received event network-vif-plugged-b9b7b8ff-3f6b-41de-825d-25fe027e5cd3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:08:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7beb8662-e67c-4744-b01e-ff780eaa6aa3 req-5befa937-89f3-405c-b43d-4a00cc0494f1 service nova] Acquiring lock "683d3b67-042a-4d95-baff-8657e3e0f7ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:08:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7beb8662-e67c-4744-b01e-ff780eaa6aa3 req-5befa937-89f3-405c-b43d-4a00cc0494f1 service nova] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:08:55 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-7beb8662-e67c-4744-b01e-ff780eaa6aa3 req-5befa937-89f3-405c-b43d-4a00cc0494f1 service nova] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:08:55 user nova-compute[72150]: DEBUG nova.compute.manager [req-7beb8662-e67c-4744-b01e-ff780eaa6aa3 req-5befa937-89f3-405c-b43d-4a00cc0494f1 service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] No waiting events found dispatching network-vif-plugged-b9b7b8ff-3f6b-41de-825d-25fe027e5cd3 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:08:55 user nova-compute[72150]: WARNING nova.compute.manager [req-7beb8662-e67c-4744-b01e-ff780eaa6aa3 req-5befa937-89f3-405c-b43d-4a00cc0494f1 service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Received unexpected event network-vif-plugged-b9b7b8ff-3f6b-41de-825d-25fe027e5cd3 for instance with vm_state building and task_state spawning.
Aug 01 19:08:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:55 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-0da7421f-0975-47ed-be27-f33bd4656867 req-d97d7cab-40e8-473a-878b-942e16b7417d service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Received event network-vif-plugged-b9b7b8ff-3f6b-41de-825d-25fe027e5cd3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:08:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0da7421f-0975-47ed-be27-f33bd4656867 req-d97d7cab-40e8-473a-878b-942e16b7417d service nova] Acquiring lock "683d3b67-042a-4d95-baff-8657e3e0f7ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:08:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0da7421f-0975-47ed-be27-f33bd4656867 req-d97d7cab-40e8-473a-878b-942e16b7417d service nova] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:08:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-0da7421f-0975-47ed-be27-f33bd4656867 req-d97d7cab-40e8-473a-878b-942e16b7417d service nova] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:08:57 user nova-compute[72150]: DEBUG nova.compute.manager [req-0da7421f-0975-47ed-be27-f33bd4656867 req-d97d7cab-40e8-473a-878b-942e16b7417d service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] No waiting events found dispatching network-vif-plugged-b9b7b8ff-3f6b-41de-825d-25fe027e5cd3 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:08:57 user nova-compute[72150]: WARNING nova.compute.manager [req-0da7421f-0975-47ed-be27-f33bd4656867 req-d97d7cab-40e8-473a-878b-942e16b7417d service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Received unexpected event network-vif-plugged-b9b7b8ff-3f6b-41de-825d-25fe027e5cd3 for instance with vm_state building and task_state spawning.
Aug 01 19:08:57 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690916937.3562586, 683d3b67-042a-4d95-baff-8657e3e0f7ad => Resumed> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:08:57 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] VM Resumed (Lifecycle Event)
Aug 01 19:08:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Instance event wait completed in 0 seconds for  {{(pid=72150) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:08:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Guest created on hypervisor {{(pid=72150) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:08:57 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Instance spawned successfully.
Aug 01 19:08:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:08:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:08:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:08:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Found default for hw_cdrom_bus of ide {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:08:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Found default for hw_disk_bus of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:08:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Found default for hw_input_bus of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:08:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Found default for hw_pointer_model of None {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:08:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Found default for hw_video_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:08:57 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Found default for hw_vif_model of virtio {{(pid=72150) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:08:57 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:08:57 user nova-compute[72150]: DEBUG nova.virt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Emitting event <LifecycleEvent: 1690916937.3573782, 683d3b67-042a-4d95-baff-8657e3e0f7ad => Started> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:08:57 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] VM Started (Lifecycle Event)
Aug 01 19:08:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:08:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72150) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:08:57 user nova-compute[72150]: INFO nova.compute.manager [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:08:57 user nova-compute[72150]: INFO nova.compute.manager [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Took 6.36 seconds to spawn the instance on the hypervisor.
Aug 01 19:08:57 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:08:57 user nova-compute[72150]: INFO nova.compute.manager [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Took 7.20 seconds to build instance.
Aug 01 19:08:57 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ef1b2044-6ecb-4371-8909-7ab87390a8c3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.302s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:08:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:08:59 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:08:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:08:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:08:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:08:59 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:08:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:09:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:09:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:09:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:09:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:09:00 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:09:00 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:09:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8570MB free_disk=25.348278045654297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:09:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:09:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:09:01 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 683d3b67-042a-4d95-baff-8657e3e0f7ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:09:01 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:09:01 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:09:01 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Refreshing inventories for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 19:09:01 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Updating ProviderTree inventory for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 19:09:01 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Updating inventory in ProviderTree for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 19:09:01 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Refreshing aggregate associations for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479, aggregates: None {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 19:09:01 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Refreshing trait associations for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 19:09:01 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:09:01 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:09:01 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:09:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:09:03 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:09:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:09:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:09:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:09:11 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:09:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:09:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:09:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:09:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:09:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:09:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:09:13 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:09:14 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:09:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:09:15 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:09:15 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:09:15 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:09:16 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:09:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:09:19 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:09:19 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:09:19 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:09:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:09:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:09:19 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:09:19 user nova-compute[72150]: DEBUG nova.objects.instance [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lazy-loading 'info_cache' on Instance uuid 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:09:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:09:20 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updating instance_info_cache with network_info: [{"id": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "address": "fa:16:3e:1a:97:73", "network": {"id": "12107337-8a71-4fd9-a156-06c0edae1d5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2119935962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b533d6e10caa4f1b94b1cfad43558180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b7b8ff-3f", "ovs_interfaceid": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:09:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:09:20 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:09:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:09:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:09:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:09:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:09:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:09:37 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:09:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:09:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:09:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:09:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:09:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:09:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:09:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:09:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:09:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:09:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:09:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:09:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:09:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:09:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:09:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:09:59 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:09:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:09:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:09:59 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:09:59 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:09:59 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:10:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:10:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:10:00 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:10:00 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:10:00 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:10:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8779MB free_disk=25.31713104248047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:10:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:10:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:10:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 683d3b67-042a-4d95-baff-8657e3e0f7ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:10:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:10:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:10:00 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:10:00 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:10:00 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:10:00 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:10:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:10:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:10:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:10:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:10:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:10:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:10:03 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:10:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:10:11 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:10:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:10:15 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:10:16 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:10:16 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:10:16 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:10:17 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:10:17 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:10:17 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:10:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:10:21 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:10:21 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:10:21 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:10:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:10:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:10:21 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:10:21 user nova-compute[72150]: DEBUG nova.objects.instance [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lazy-loading 'info_cache' on Instance uuid 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:10:22 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updating instance_info_cache with network_info: [{"id": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "address": "fa:16:3e:1a:97:73", "network": {"id": "12107337-8a71-4fd9-a156-06c0edae1d5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2119935962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b533d6e10caa4f1b94b1cfad43558180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b7b8ff-3f", "ovs_interfaceid": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:10:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:10:22 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:10:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:10:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:10:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:10:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:10:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:10:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:10:23 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:10:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:10:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:10:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:10:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:10:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:10:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:10:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:10:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:10:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:10:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:10:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:10:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:10:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:10:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:10:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:10:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:10:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:10:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:10:41 user nova-compute[72150]: DEBUG nova.compute.manager [req-b44b0822-d264-4c99-808d-3a88004fb619 req-f70eeeb8-3fa6-4c4c-81a1-2f0e25da5793 service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Received event network-changed-b9b7b8ff-3f6b-41de-825d-25fe027e5cd3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:10:41 user nova-compute[72150]: DEBUG nova.compute.manager [req-b44b0822-d264-4c99-808d-3a88004fb619 req-f70eeeb8-3fa6-4c4c-81a1-2f0e25da5793 service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Refreshing instance network info cache due to event network-changed-b9b7b8ff-3f6b-41de-825d-25fe027e5cd3. {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:10:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b44b0822-d264-4c99-808d-3a88004fb619 req-f70eeeb8-3fa6-4c4c-81a1-2f0e25da5793 service nova] Acquiring lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:10:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b44b0822-d264-4c99-808d-3a88004fb619 req-f70eeeb8-3fa6-4c4c-81a1-2f0e25da5793 service nova] Acquired lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:10:41 user nova-compute[72150]: DEBUG nova.network.neutron [req-b44b0822-d264-4c99-808d-3a88004fb619 req-f70eeeb8-3fa6-4c4c-81a1-2f0e25da5793 service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Refreshing network info cache for port b9b7b8ff-3f6b-41de-825d-25fe027e5cd3 {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:10:41 user nova-compute[72150]: DEBUG nova.network.neutron [req-b44b0822-d264-4c99-808d-3a88004fb619 req-f70eeeb8-3fa6-4c4c-81a1-2f0e25da5793 service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updated VIF entry in instance network info cache for port b9b7b8ff-3f6b-41de-825d-25fe027e5cd3. {{(pid=72150) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:10:41 user nova-compute[72150]: DEBUG nova.network.neutron [req-b44b0822-d264-4c99-808d-3a88004fb619 req-f70eeeb8-3fa6-4c4c-81a1-2f0e25da5793 service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updating instance_info_cache with network_info: [{"id": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "address": "fa:16:3e:1a:97:73", "network": {"id": "12107337-8a71-4fd9-a156-06c0edae1d5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2119935962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b533d6e10caa4f1b94b1cfad43558180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b7b8ff-3f", "ovs_interfaceid": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:10:41 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-b44b0822-d264-4c99-808d-3a88004fb619 req-f70eeeb8-3fa6-4c4c-81a1-2f0e25da5793 service nova] Releasing lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:10:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:10:45 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:10:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:10:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:10:46 user nova-compute[72150]: DEBUG nova.objects.instance [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lazy-loading 'flavor' on Instance uuid 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:10:46 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:10:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:10:47 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:10:47 user nova-compute[72150]: INFO nova.compute.manager [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Attaching volume af988c95-9cf5-4bc8-a7b2-73d50c3667d8 to /dev/vdb
Aug 01 19:10:47 user nova-compute[72150]: DEBUG os_brick.utils [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:10:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:10:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:10:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c612e6d3-9a43-4052-895b-4140bc0541d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:10:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:10:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:10:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b148562e-ac1a-4108-b30a-f985a4a5d698]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:10:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:10:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:10:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6134c7d2-8eec-47fa-86d7-4856aa2a4556]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:10:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[88648c30-e9eb-4ad9-851f-07b1d31c2f12]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:10:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:10:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:10:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:10:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:10:47 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:10:47 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:10:47 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa40309f-d429-4b3a-877d-7be62525095e]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:10:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:10:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:10:47 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:10:47 user nova-compute[72150]: DEBUG os_brick.utils [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:10:47 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updating existing volume attachment record: 43f69de4-47e3-4cde-947b-f52d10657376 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:10:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:10:50 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:10:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJZNjHim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:10:54 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:10:54 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:10:54 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[587f9f62-146c-456e-82e7-d66fb723b4c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:10:54 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e275af58-231c-4d71-aba7-18842a90f0a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8] added
Aug 01 19:10:54 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[89841380-d894-40c4-8b73-1f94c18d6656]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc5032f-82bb-42c5-882a-c452054c3f14]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FJZNjHim {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FJZNjHim" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccd918f-1362-40b2-b806-187bf5a42d15]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FJZNjHim'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5719da-301f-457e-977a-5b0a58ce51fe]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b04799-0969-4a6a-881b-08976f958cd6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 19:10:54 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 19:10:54 user nova-compute[72150]:  {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:10:54 user nova-compute[72150]: WARNING os_brick.initiator.connectors.iscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 19:10:54 user nova-compute[72150]: 
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7431b3fb-30d2-4061-9a2b-fa6ce04848f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8, portal: 172.16.0.220,3260]
Aug 01 19:10:54 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8, portal: 172.16.0.220,3260] successful.
Aug 01 19:10:54 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e569f922-f31e-46c7-9184-b341bdde0b3f]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2bbcbe-59f8-45ed-88c7-422e97f98e85]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 (non-flash)
Aug 01 19:10:54 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 (non-flash)
Aug 01 19:10:54 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] HCTL ('33', '-', '-', 0) found on session 66 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2021206b-4375-4daa-8e22-9ecf02e57002]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Searching for a device in session 66 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:10:54 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJZNjHim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:10:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:10:55 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23035326438633564', 'path': '/dev/sdb'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:10:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035326438633564', 'path': '/dev/sdb'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:10:55 user nova-compute[72150]: DEBUG nova.objects.instance [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lazy-loading 'flavor' on Instance uuid 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:10:55 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 19:10:55 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:10:55 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:10:55 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:10:55 user nova-compute[72150]:   <serial>af988c95-9cf5-4bc8-a7b2-73d50c3667d8</serial>
Aug 01 19:10:55 user nova-compute[72150]: </disk>
Aug 01 19:10:55 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 19:10:56 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:10:56 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:10:56 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] No VIF found with MAC fa:16:3e:1a:97:73, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:10:56 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-332dc877-cfe1-4b56-a4df-f5a9210861f7 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.221s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:10:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:10:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:10:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:10:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:10:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:10:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:11:00 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:11:01 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:11:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:11:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:11:01 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:11:01 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:11:02 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:11:02 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:11:02 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:11:02 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:11:02 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72150) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:11:02 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:11:02 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:11:02 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8834MB free_disk=25.315662384033203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:11:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:11:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:11:02 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 683d3b67-042a-4d95-baff-8657e3e0f7ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:11:02 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:11:02 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:11:03 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:11:03 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:11:03 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:11:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:11:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:11:05 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:11:05 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:11:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:11:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:11:11 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:11:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:11:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:11:15 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:11:16 user nova-compute[72150]: INFO nova.compute.manager [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Detaching volume af988c95-9cf5-4bc8-a7b2-73d50c3667d8
Aug 01 19:11:16 user nova-compute[72150]: INFO nova.virt.block_device [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Attempting to driver detach volume af988c95-9cf5-4bc8-a7b2-73d50c3667d8 from mountpoint /dev/vdb
Aug 01 19:11:16 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Attempting to detach device vdb from instance 683d3b67-042a-4d95-baff-8657e3e0f7ad from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:11:16 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:11:16 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:11:16 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:11:16 user nova-compute[72150]:   <serial>af988c95-9cf5-4bc8-a7b2-73d50c3667d8</serial>
Aug 01 19:11:16 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:11:16 user nova-compute[72150]: </disk>
Aug 01 19:11:16 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:11:16 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Successfully detached device vdb from instance 683d3b67-042a-4d95-baff-8657e3e0f7ad from the persistent domain config.
Aug 01 19:11:16 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 683d3b67-042a-4d95-baff-8657e3e0f7ad from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:11:16 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:11:16 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:11:16 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:11:16 user nova-compute[72150]:   <serial>af988c95-9cf5-4bc8-a7b2-73d50c3667d8</serial>
Aug 01 19:11:16 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:11:16 user nova-compute[72150]: </disk>
Aug 01 19:11:16 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690917076.9052966, 683d3b67-042a-4d95-baff-8657e3e0f7ad => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 19:11:16 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Successfully detached device vdb from instance 683d3b67-042a-4d95-baff-8657e3e0f7ad from the live domain config.
Aug 01 19:11:16 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJZNjHim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:11:16 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:11:16 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b85f78-614f-4acc-b8ff-248f42351223]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3fab8e-9c67-40a6-90b3-eeaeb2970134]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 (non-flash)
Aug 01 19:11:16 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 (non-flash)
Aug 01 19:11:16 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c5205e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8'): ({'sdb'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Removing single pathed devices sdb {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[156b581b-862e-4193-b67a-3dd868f4a457]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:11:16 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[928a298d-0d46-4e42-8ed5-d4cf15511016]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Flushing IO for device /dev/sdb {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fdf1c8-f3a8-4e6d-ae65-55b5a9a57a76]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08b7508-549f-4400-afe6-b5b63d6b1cf4]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9c19b4-e6b6-4a58-8154-b4bb4fa68339]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6477f04a-c70d-40d5-b16a-3fb2e7bbc1e3]: (4, ('Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8, portal: 172.16.0.220,3260]\nLogout of [sid: 66, target: iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8, portal: 172.16.0.220,3260]
Aug 01 19:11:17 user nova-compute[72150]: Logout of [sid: 66, target: iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8, portal: 172.16.0.220,3260] successful.
Aug 01 19:11:17 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af988c95-9cf5-4bc8-a7b2-73d50c3667d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37a39d6-a08f-4e80-8bd7-8f0065d44a21]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.252s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] <== disconnect_volume: return (253ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG nova.objects.instance [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lazy-loading 'flavor' on Instance uuid 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:11:17 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-9d670200-85f3-4636-b982-2bd095e9ea90 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.600s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:11:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:11:18 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:11:18 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:11:18 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:11:21 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:11:21 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:11:21 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:11:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:11:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:11:21 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:11:21 user nova-compute[72150]: DEBUG nova.objects.instance [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lazy-loading 'info_cache' on Instance uuid 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:11:22 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updating instance_info_cache with network_info: [{"id": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "address": "fa:16:3e:1a:97:73", "network": {"id": "12107337-8a71-4fd9-a156-06c0edae1d5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2119935962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b533d6e10caa4f1b94b1cfad43558180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b7b8ff-3f", "ovs_interfaceid": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:11:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:11:22 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:11:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:11:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:11:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:11:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:11:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:11:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:11:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:11:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:11:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:11:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:11:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:11:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:11:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:11:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:11:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:11:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:11:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:11:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:11:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:11:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:11:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:11:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:11:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:11:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:11:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:11:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:11:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:11:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:11:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:11:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:11:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:11:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:11:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:12:02 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:12:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:12:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:12:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:12:02 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:12:02 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:12:03 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:12:03 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:12:03 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8844MB free_disk=25.314762115478516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:12:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:12:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:12:03 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 683d3b67-042a-4d95-baff-8657e3e0f7ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:12:03 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:12:03 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:12:03 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:12:03 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:12:03 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:12:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:12:05 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:12:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:12:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:12:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:12:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:12:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:12:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG nova.objects.instance [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lazy-loading 'flavor' on Instance uuid 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:12:10 user nova-compute[72150]: INFO nova.compute.manager [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Attaching volume ebdddf8d-5ec4-4c52-b67a-203ee162d25b to /dev/vdb
Aug 01 19:12:10 user nova-compute[72150]: DEBUG os_brick.utils [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aebd673-339b-444a-b49c-e5a44a06b4c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6340ed-01be-4ec1-80c8-7d0a02f1caaf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50767cd-933f-4dfc-acad-8c7e2791106d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0b48f3-e0de-423a-a2ca-df83d1b626f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:12:10 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:12:10 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[315a984e-f367-4d68-8fc6-9eec64526ac2]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG os_brick.utils [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:12:10 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updating existing volume attachment record: 98ec86e0-b6fb-4c55-85bd-cac899c9ac09 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:12:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:12:13 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:12:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:12:16 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:12:16 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfxUDeHJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:12:17 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:12:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:12:17 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:12:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:12:17 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[649557c1-ab3c-4fff-b6af-1eca462773df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:12:17 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7460823b-3510-4cd8-9aa9-a2dc6b1cc3b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b] added
Aug 01 19:12:17 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5579f0b-967b-455d-92c5-dd1fcba9397f]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e49abec-3de0-4f4e-9ebd-c7f75fd1c8b3]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CfxUDeHJ {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CfxUDeHJ" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2beba8d-8918-45b9-b2cf-9ab61f76f782]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CfxUDeHJ'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31aa1f3-27c3-4639-8481-b3fbff6cf942]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5cbb00-a5b5-4e64-8a6c-03eed958bfb7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 19:12:17 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 19:12:17 user nova-compute[72150]:  {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:12:17 user nova-compute[72150]: WARNING os_brick.initiator.connectors.iscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 19:12:17 user nova-compute[72150]: 
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[821d3c91-a310-42d9-97b6-9a7bc3132181]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b, portal: 172.16.0.220,3260]
Aug 01 19:12:17 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b, portal: 172.16.0.220,3260] successful.
Aug 01 19:12:17 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[809e1a1b-9b20-4a86-8a8b-0fadcb94796c]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:12:17 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:18 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:18 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eb002d-0f68-4248-8876-ef0fdd34b099]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:18 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b (non-flash)
Aug 01 19:12:18 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:12:18 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b (non-flash)
Aug 01 19:12:18 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:12:18 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:12:18 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:12:18 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:12:18 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:12:18 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:18 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:18 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c952c19-de57-4735-98ac-430fa0ce322e]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:18 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:12:18 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfxUDeHJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:12:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:12:18 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:12:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:12:19 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23038666462363166', 'path': '/dev/sdb'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:12:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038666462363166', 'path': '/dev/sdb'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:12:19 user nova-compute[72150]: DEBUG nova.objects.instance [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lazy-loading 'flavor' on Instance uuid 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:12:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 19:12:19 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:12:19 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:12:19 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:12:19 user nova-compute[72150]:   <serial>ebdddf8d-5ec4-4c52-b67a-203ee162d25b</serial>
Aug 01 19:12:19 user nova-compute[72150]: </disk>
Aug 01 19:12:19 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 19:12:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:12:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:12:19 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] No VIF found with MAC fa:16:3e:1a:97:73, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:12:19 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-be7b1414-eb93-4cab-8f4d-e245e81e604c tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.868s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:12:19 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:12:19 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:12:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:12:22 user nova-compute[72150]: INFO nova.compute.manager [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Detaching volume ebdddf8d-5ec4-4c52-b67a-203ee162d25b
Aug 01 19:12:22 user nova-compute[72150]: INFO nova.virt.block_device [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Attempting to driver detach volume ebdddf8d-5ec4-4c52-b67a-203ee162d25b from mountpoint /dev/vdb
Aug 01 19:12:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Attempting to detach device vdb from instance 683d3b67-042a-4d95-baff-8657e3e0f7ad from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:12:22 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:12:22 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:12:22 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:12:22 user nova-compute[72150]:   <serial>ebdddf8d-5ec4-4c52-b67a-203ee162d25b</serial>
Aug 01 19:12:22 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:12:22 user nova-compute[72150]: </disk>
Aug 01 19:12:22 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:12:22 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Successfully detached device vdb from instance 683d3b67-042a-4d95-baff-8657e3e0f7ad from the persistent domain config.
Aug 01 19:12:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 683d3b67-042a-4d95-baff-8657e3e0f7ad from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:12:22 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:12:22 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:12:22 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:12:22 user nova-compute[72150]:   <serial>ebdddf8d-5ec4-4c52-b67a-203ee162d25b</serial>
Aug 01 19:12:22 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:12:22 user nova-compute[72150]: </disk>
Aug 01 19:12:22 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690917142.5514464, 683d3b67-042a-4d95-baff-8657e3e0f7ad => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 19:12:22 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Successfully detached device vdb from instance 683d3b67-042a-4d95-baff-8657e3e0f7ad from the live domain config.
Aug 01 19:12:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfxUDeHJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:12:22 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:12:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6159df4e-728b-45e0-96ea-2e4264b9872e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2221234d-0269-4680-81a1-66320ea09335]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b (non-flash)
Aug 01 19:12:22 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b (non-flash)
Aug 01 19:12:22 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec554b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b'): ({'sdb'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Removing single pathed devices sdb {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd76327-574a-432a-8188-14090c70f0c6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c740931-bbb0-430b-8a73-d716fd007449]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Flushing IO for device /dev/sdb {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[965b4287-e31c-4a82-902d-b1db8cfbf218]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[46915a3a-bdc8-4a57-a6f4-aed2bd9ba0a7]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f029eb53-3d94-4fbb-9ec7-9170af27aea2]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa290756-0d9c-485b-84e9-cd1a88e9ca7a]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b, portal: 172.16.0.220,3260]
Aug 01 19:12:22 user nova-compute[72150]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b, portal: 172.16.0.220,3260] successful.
Aug 01 19:12:22 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdddf8d-5ec4-4c52-b67a-203ee162d25b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8691c5c-88d2-4c4b-961d-e43e5e446ff9]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] <== disconnect_volume: return (256ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:12:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:12:23 user nova-compute[72150]: DEBUG nova.objects.instance [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lazy-loading 'flavor' on Instance uuid 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:12:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-b249f602-05e4-4d7f-99cf-c187ccfdba2e tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.515s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:12:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:12:23 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:12:23 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:12:23 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:12:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:12:23 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:12:23 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:12:23 user nova-compute[72150]: DEBUG nova.objects.instance [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lazy-loading 'info_cache' on Instance uuid 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:12:24 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updating instance_info_cache with network_info: [{"id": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "address": "fa:16:3e:1a:97:73", "network": {"id": "12107337-8a71-4fd9-a156-06c0edae1d5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2119935962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b533d6e10caa4f1b94b1cfad43558180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b7b8ff-3f", "ovs_interfaceid": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:12:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:12:24 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:12:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:12:26 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:12:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:12:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:12:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:12:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:12:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:12:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:12:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:12:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:12:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:12:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:12:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:12:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:12:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:12:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:12:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:12:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:12:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:12:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:12:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:12:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:12:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:12:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:12:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:12:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:12:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:12:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:12:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:13:02 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:13:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:13:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:13:02 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:13:02 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:13:02 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:03 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:13:03 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:13:03 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8839MB free_disk=25.31378173828125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:13:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:13:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:13:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:13:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:13:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:13:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:13:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:13:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:13:03 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 683d3b67-042a-4d95-baff-8657e3e0f7ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:13:03 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:13:03 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:13:03 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:13:03 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:13:03 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:13:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:13:05 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:13:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:13:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG nova.objects.instance [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lazy-loading 'flavor' on Instance uuid 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:13:15 user nova-compute[72150]: INFO nova.compute.manager [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Attaching volume d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af to /dev/vdb
Aug 01 19:13:15 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG os_brick.utils [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1c142c-ad97-4fcf-8210-211613cc6e83]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[94001f57-a27c-4225-af5f-6b3b0779614f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa21947e-48d1-4ca8-b913-2ae79f23a521]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a44482-f9dc-43f3-bbad-56cfa5a2c899]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:13:15 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:13:15 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ec42d3-59d7-419a-9d11-04efad56f905]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG os_brick.utils [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updating existing volume attachment record: be977755-aee0-4bb7-8a21-40976e196f28 {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:13:15 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:13:16 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:13:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:13:18 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:13:19 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:13:19 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:13:20 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:13:20 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:13:20 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBuOVzeS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:13:22 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:13:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:13:22 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:13:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:13:22 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b619b5f2-e238-408b-8e71-57aa271c26ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:13:22 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da9a918-de29-41f0-a25d-27a02c4240ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af] added
Aug 01 19:13:22 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[534da6a2-35c7-4845-bb13-10f84c01c9ad]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7733f517-217f-4fa0-b003-543ed0d63514]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HBuOVzeS {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HBuOVzeS" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbdae5e-28d3-4a88-85ba-267bdaca9f8a]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HBuOVzeS'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cff5c26-1cb1-4cff-b6c8-6fc144b706b0]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[add606fd-777f-4f12-a68e-b199b3c61fbd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 19:13:22 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 19:13:22 user nova-compute[72150]:  {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:13:22 user nova-compute[72150]: WARNING os_brick.initiator.connectors.iscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 19:13:22 user nova-compute[72150]: 
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df4fe93-a40c-4b3d-b3bc-3ad6d026d6e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af, portal: 172.16.0.220,3260]
Aug 01 19:13:22 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af, portal: 172.16.0.220,3260] successful.
Aug 01 19:13:22 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a874391-bc84-409c-80f4-1a13ff92f1f7]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf0561f-dac1-4d5c-b642-d71bf4506d4c]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af (non-flash)
Aug 01 19:13:22 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af (non-flash)
Aug 01 19:13:22 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2992f3b6-1a24-40a2-b076-22c8bc653e6d]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:22 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:13:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:13:23 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:13:23 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBuOVzeS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:13:23 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:13:23 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23034636664316662', 'path': '/dev/sdb'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:13:23 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034636664316662', 'path': '/dev/sdb'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:13:23 user nova-compute[72150]: DEBUG nova.objects.instance [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lazy-loading 'flavor' on Instance uuid 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:13:23 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 19:13:23 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:13:23 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:13:23 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:13:23 user nova-compute[72150]:   <serial>d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af</serial>
Aug 01 19:13:23 user nova-compute[72150]: </disk>
Aug 01 19:13:23 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 19:13:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:13:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:13:24 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] No VIF found with MAC fa:16:3e:1a:97:73, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:13:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-f5e3bed6-247a-4fe9-8f89-8ecf92808ea3 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.991s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:13:24 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:13:24 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:13:24 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:13:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:13:24 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:13:24 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:13:24 user nova-compute[72150]: DEBUG nova.objects.instance [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lazy-loading 'info_cache' on Instance uuid 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:13:25 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updating instance_info_cache with network_info: [{"id": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "address": "fa:16:3e:1a:97:73", "network": {"id": "12107337-8a71-4fd9-a156-06c0edae1d5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2119935962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b533d6e10caa4f1b94b1cfad43558180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b7b8ff-3f", "ovs_interfaceid": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:13:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:13:25 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:13:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:13:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:13:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:13:26 user nova-compute[72150]: INFO nova.compute.manager [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Detaching volume d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af
Aug 01 19:13:26 user nova-compute[72150]: INFO nova.virt.block_device [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Attempting to driver detach volume d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af from mountpoint /dev/vdb
Aug 01 19:13:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Attempting to detach device vdb from instance 683d3b67-042a-4d95-baff-8657e3e0f7ad from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 19:13:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:13:26 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:13:26 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:13:26 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:13:26 user nova-compute[72150]:   <serial>d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af</serial>
Aug 01 19:13:26 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:13:26 user nova-compute[72150]: </disk>
Aug 01 19:13:26 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:13:26 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Successfully detached device vdb from instance 683d3b67-042a-4d95-baff-8657e3e0f7ad from the persistent domain config.
Aug 01 19:13:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 683d3b67-042a-4d95-baff-8657e3e0f7ad from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 19:13:26 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:13:26 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:13:26 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:13:26 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:13:26 user nova-compute[72150]:   <serial>d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af</serial>
Aug 01 19:13:26 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:13:26 user nova-compute[72150]: </disk>
Aug 01 19:13:26 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690917207.1324947, 683d3b67-042a-4d95-baff-8657e3e0f7ad => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 19:13:27 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Successfully detached device vdb from instance 683d3b67-042a-4d95-baff-8657e3e0f7ad from the live domain config.
Aug 01 19:13:27 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBuOVzeS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:13:27 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:13:27 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b0128b-4d40-4b6a-885e-9a02f9e198ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b411850c-a6cb-4f27-a9b4-f6a42041578c]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af (non-flash)
Aug 01 19:13:27 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af (non-flash)
Aug 01 19:13:27 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f470c520b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af'): ({'sdb'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Removing single pathed devices sdb {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7e45c3-a922-4109-bc0a-74844384719d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0bd46a-ca82-4f33-80b2-e1be08f8fc92]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Flushing IO for device /dev/sdb {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f269981-2af6-48e0-8ba1-09a71dd90870]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1e50d5-e72f-46df-9b6a-ea05cca4a212]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dd6429-a5ea-41e6-a2f1-3b9e8155ebfa]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6318542e-2675-4f32-87f4-c0552f792ce5]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af, portal: 172.16.0.220,3260]
Aug 01 19:13:27 user nova-compute[72150]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af, portal: 172.16.0.220,3260] successful.
Aug 01 19:13:27 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f703e3-f53a-4c48-a0e8-b3cb0dc8e8af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7961285d-3e32-4fb7-a406-c9963f965990]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] <== disconnect_volume: return (259ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:13:27 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:13:28 user nova-compute[72150]: DEBUG nova.objects.instance [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lazy-loading 'flavor' on Instance uuid 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:13:28 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-c776dd57-513a-409a-855a-ac935415de10 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.564s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:13:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:13:29 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:13:29 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72150) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 19:13:30 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:13:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:13:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:13:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:13:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:13:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:13:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:13:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:13:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:13:44 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:13:44 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Cleaning up deleted instances {{(pid=72150) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 19:13:44 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] There are 0 instances to clean {{(pid=72150) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 19:13:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:13:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:13:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:13:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:13:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:13:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:13:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:13:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:13:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:13:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:13:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:13:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:13:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:13:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:13:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:13:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:13:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:13:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:13:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:14:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:14:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:14:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:14:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:14:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:14:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:14:03 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:14:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:14:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:14:03 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:14:03 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:14:03 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:04 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:14:04 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:14:04 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8832MB free_disk=25.304969787597656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:14:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:14:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:14:04 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 683d3b67-042a-4d95-baff-8657e3e0f7ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:14:04 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:14:04 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:14:04 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Refreshing inventories for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 19:14:04 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Updating ProviderTree inventory for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 19:14:04 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Updating inventory in ProviderTree for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 19:14:04 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Refreshing aggregate associations for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479, aggregates: None {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 19:14:05 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Refreshing trait associations for resource provider f205788b-0048-4b9c-8d9d-b0437c5c3479, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI {{(pid=72150) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 19:14:05 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:14:05 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:14:05 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:14:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:14:06 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:14:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:14:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:14:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:14:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:14:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:14:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:14:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:14:17 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:14:17 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:14:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:14:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:14:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:14:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:14:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:14:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:14:19 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:14:19 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:14:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:14:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:14:20 user nova-compute[72150]: DEBUG nova.objects.instance [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lazy-loading 'flavor' on Instance uuid 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:14:20 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:14:21 user nova-compute[72150]: INFO nova.compute.manager [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Attaching volume b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 to /dev/vdb
Aug 01 19:14:21 user nova-compute[72150]: DEBUG os_brick.utils [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b4c049-0407-46d4-bf3b-02d465ef062c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8c5da75ff1\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de4f109-2bcc-4f75-85ed-253053746889]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec673338-a275-49ab-a263-fbffeae24015]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe164f3-990f-4eae-91db-4b96651b14f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Running cmd (subprocess): nvme version {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] 'nvme version' failed. Not Retrying. {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] nvme not present on system {{(pid=72150) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:14:21 user nova-compute[72150]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:14:21 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd4961e-5eb2-4a5f-9497-224252fd723e]: (4, '') {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72150) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.lightos [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] LIGHTOS: no hostnqn found. {{(pid=72150) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG os_brick.utils [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8c5da75ff1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG nova.virt.block_device [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updating existing volume attachment record: f37b9073-c13e-4cc1-b155-5cf0dfccee9e {{(pid=72150) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:14:21 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:14:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:14:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:14:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:14:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:14:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:14:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:14:25 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:14:25 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:14:25 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:14:25 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:14:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:14:25 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:14:25 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:14:25 user nova-compute[72150]: DEBUG nova.objects.instance [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lazy-loading 'info_cache' on Instance uuid 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:14:26 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updating instance_info_cache with network_info: [{"id": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "address": "fa:16:3e:1a:97:73", "network": {"id": "12107337-8a71-4fd9-a156-06c0edae1d5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2119935962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b533d6e10caa4f1b94b1cfad43558180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b7b8ff-3f", "ovs_interfaceid": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:14:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:14:26 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Calling os-brick to attach iSCSI Volume {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnPrhCJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:14:28 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:14:28 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:14:28 user nova-compute[72150]: INFO os_brick.initiator.connectors.iscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 -p 172.16.0.220:3260 {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e49db9f-8818-4ab2-831d-c6979c7c6a2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:14:28 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d00375b-8730-4d83-a5aa-4ce776924939]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5] added\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5] added
Aug 01 19:14:28 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[936b2f94-5022-4e77-a99a-4da0205964ba]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc32ae25-9456-408e-b087-cf6e60960882]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LnPrhCJx {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LnPrhCJx" returned: 0 in 0.023s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9480e5-82ed-48c1-8a9d-8fa417a1c590]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LnPrhCJx'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc139117-44a5-4190-a3ca-9ea556016536]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4485c9-4735-4a04-9f02-6d33d7c2e7fb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 19:14:28 user nova-compute[72150]:  {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 19:14:28 user nova-compute[72150]:  {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:14:28 user nova-compute[72150]: WARNING os_brick.initiator.connectors.iscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 19:14:28 user nova-compute[72150]: 
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 -p 172.16.0.220:3260 --login {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21b8015-e0db-4dca-8ff2-dd50b6f444b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5, portal: 172.16.0.220,3260]
Aug 01 19:14:28 user nova-compute[72150]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5, portal: 172.16.0.220,3260] successful.
Aug 01 19:14:28 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c30511-8777-4af4-ba01-d8e82c852302]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[60092c70-6618-4305-a45f-dda083eb2225]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 (non-flash)
Aug 01 19:14:28 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 (non-flash)
Aug 01 19:14:28 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Connected to 172.16.0.220:3260 {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=72150) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72150) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fa5ad0-8c43-4f5f-b286-024ddedecc43]: (4, ('- - 0', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72150) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:14:28 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnPrhCJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72150) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:14:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:14:29 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23337383935396562', 'path': '/dev/sdb'} {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:14:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337383935396562', 'path': '/dev/sdb'} {{(pid=72150) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:14:29 user nova-compute[72150]: DEBUG nova.objects.instance [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lazy-loading 'flavor' on Instance uuid 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:14:29 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 19:14:29 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:14:29 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:14:29 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:14:29 user nova-compute[72150]:   <serial>b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5</serial>
Aug 01 19:14:29 user nova-compute[72150]: </disk>
Aug 01 19:14:29 user nova-compute[72150]:  {{(pid=72150) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 19:14:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] No BDM found with device name vda, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:14:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72150) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:14:30 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] No VIF found with MAC fa:16:3e:1a:97:73, not building metadata {{(pid=72150) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:14:30 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-7aa9d889-21d8-4db8-b477-b7a40faccc05 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.248s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:14:31 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:14:32 user nova-compute[72150]: INFO nova.compute.manager [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Detaching volume b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5
Aug 01 19:14:32 user nova-compute[72150]: INFO nova.virt.block_device [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Attempting to driver detach volume b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 from mountpoint /dev/vdb
Aug 01 19:14:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Attempting to detach device vdb from instance 683d3b67-042a-4d95-baff-8657e3e0f7ad from the persistent domain config. {{(pid=72150) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:14:32 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:14:32 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:14:32 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:14:32 user nova-compute[72150]:   <serial>b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5</serial>
Aug 01 19:14:32 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:14:32 user nova-compute[72150]: </disk>
Aug 01 19:14:32 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:14:32 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Successfully detached device vdb from instance 683d3b67-042a-4d95-baff-8657e3e0f7ad from the persistent domain config.
Aug 01 19:14:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 683d3b67-042a-4d95-baff-8657e3e0f7ad from the live domain config. {{(pid=72150) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.guest [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:14:32 user nova-compute[72150]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:14:32 user nova-compute[72150]:   <source dev="/dev/sdb"/>
Aug 01 19:14:32 user nova-compute[72150]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:14:32 user nova-compute[72150]:   <serial>b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5</serial>
Aug 01 19:14:32 user nova-compute[72150]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:14:32 user nova-compute[72150]: </disk>
Aug 01 19:14:32 user nova-compute[72150]:  {{(pid=72150) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-cb3ae525-4755-412f-bb29-c431aced939c None None] Received event <DeviceRemovedEvent: 1690917272.8605685, 683d3b67-042a-4d95-baff-8657e3e0f7ad => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72150) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.driver [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 19:14:32 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Successfully detached device vdb from instance 683d3b67-042a-4d95-baff-8657e3e0f7ad from the live domain config.
Aug 01 19:14:32 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] calling os-brick to detach iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f470c0dd360>, {'target_iqns': ['iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnPrhCJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:14:32 user nova-compute[72150]: WARNING os_brick.initiator.connectors.base [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:14:32 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5', 0)] {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e7dd02-7b4b-45da-a79c-09da50fd224e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0728cfd6-d649-4699-8bc9-b61530050aa8]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 (non-flash)\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 (non-flash)
Aug 01 19:14:32 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 (non-flash)
Aug 01 19:14:32 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46ec5553f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5'): ({'sdb'}, set())}) {{(pid=72150) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Removing single pathed devices sdb {{(pid=72150) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed571b0-7f87-43ee-bb25-3e70e0121b59]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8a4287-c073-4248-9145-47ae828f627f]: (4, ('ok\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Flushing IO for device /dev/sdb {{(pid=72150) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cfbfc5-c69f-4a07-9fcd-6c8b1b384de9]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72150) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:14:32 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.185s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70241d9-ed8c-476c-90dd-1a225ba8e809]: (4, ('1', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG os_brick.initiator.linuxscsi [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] SCSI volumes sdb have been removed. {{(pid=72150) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5')] {{(pid=72150) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4ca361-a90f-486f-bc62-6c9b4566cf14]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 -p 172.16.0.220:3260 --logout {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[718fac74-1f05-421b-b36b-2702b235148d]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5, portal: 172.16.0.220,3260]
Aug 01 19:14:33 user nova-compute[72150]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5, portal: 172.16.0.220,3260] successful.
Aug 01 19:14:33 user nova-compute[72150]:  stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 -p 172.16.0.220:3260 --op delete {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5b83cdf-ef4b-4ec9-83b4-9cef8c8228c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82940) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff039a2-964b-43b5-b5d1-dcff04f9976b]: (4, ('', '')) {{(pid=82940) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72150) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.base [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG os_brick.initiator.connectors.iscsi [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] <== disconnect_volume: return (410ms) None {{(pid=72150) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Disconnected iSCSI Volume {{(pid=72150) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:14:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:14:34 user nova-compute[72150]: DEBUG nova.objects.instance [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lazy-loading 'flavor' on Instance uuid 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:14:34 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-86251319-c117-464b-93e6-69b570ba57b0 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.891s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:14:35 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:14:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:14:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:14:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:14:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:14:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:14:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:14:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:14:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:14:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:14:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:14:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:14:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:14:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:14:53 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:14:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:14:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:14:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:14:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:14:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:14:58 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:15:03 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:15:04 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:15:04 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:15:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:15:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:15:04 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:15:04 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:15:04 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:15:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:15:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:15:05 user nova-compute[72150]: DEBUG oslo_concurrency.processutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72150) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:15:05 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:15:05 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:15:05 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8822MB free_disk=25.303997039794922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:15:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:15:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:15:05 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Instance 683d3b67-042a-4d95-baff-8657e3e0f7ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72150) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:15:05 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:15:05 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:15:05 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:15:05 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:15:05 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:15:05 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:15:08 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:15:13 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:15:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:15:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:15:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:15:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:15:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:15:18 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:15:18 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:15:18 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:15:19 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:15:20 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:15:21 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:15:22 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:15:22 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:15:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:15:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:15:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:15:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:15:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:15:23 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:15:26 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:15:26 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:15:26 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:15:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:15:26 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquired lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:15:26 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Forcefully refreshing network info cache for instance {{(pid=72150) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:15:26 user nova-compute[72150]: DEBUG nova.objects.instance [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lazy-loading 'info_cache' on Instance uuid 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:15:27 user nova-compute[72150]: DEBUG nova.network.neutron [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updating instance_info_cache with network_info: [{"id": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "address": "fa:16:3e:1a:97:73", "network": {"id": "12107337-8a71-4fd9-a156-06c0edae1d5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2119935962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b533d6e10caa4f1b94b1cfad43558180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b7b8ff-3f", "ovs_interfaceid": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:15:27 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Releasing lock "refresh_cache-683d3b67-042a-4d95-baff-8657e3e0f7ad" {{(pid=72150) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:15:27 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updated the network info_cache for instance {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:15:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:15:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:15:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:15:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:15:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:15:28 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:15:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:15:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:15:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:15:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:15:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:15:33 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:15:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:15:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:15:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:15:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:15:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:15:38 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:15:43 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:15:48 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "683d3b67-042a-4d95-baff-8657e3e0f7ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:15:51 user nova-compute[72150]: INFO nova.compute.manager [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Terminating instance
Aug 01 19:15:51 user nova-compute[72150]: DEBUG nova.compute.manager [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Start destroying the instance on the hypervisor. {{(pid=72150) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-2bbd7866-40e1-4858-807e-2e20c7ddc899 req-7d59d89a-3af2-4a0f-89ed-68c2f140b31d service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Received event network-vif-unplugged-b9b7b8ff-3f6b-41de-825d-25fe027e5cd3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2bbd7866-40e1-4858-807e-2e20c7ddc899 req-7d59d89a-3af2-4a0f-89ed-68c2f140b31d service nova] Acquiring lock "683d3b67-042a-4d95-baff-8657e3e0f7ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2bbd7866-40e1-4858-807e-2e20c7ddc899 req-7d59d89a-3af2-4a0f-89ed-68c2f140b31d service nova] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-2bbd7866-40e1-4858-807e-2e20c7ddc899 req-7d59d89a-3af2-4a0f-89ed-68c2f140b31d service nova] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-2bbd7866-40e1-4858-807e-2e20c7ddc899 req-7d59d89a-3af2-4a0f-89ed-68c2f140b31d service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] No waiting events found dispatching network-vif-unplugged-b9b7b8ff-3f6b-41de-825d-25fe027e5cd3 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG nova.compute.manager [req-2bbd7866-40e1-4858-807e-2e20c7ddc899 req-7d59d89a-3af2-4a0f-89ed-68c2f140b31d service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Received event network-vif-unplugged-b9b7b8ff-3f6b-41de-825d-25fe027e5cd3 for instance with task_state deleting. {{(pid=72150) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:15:51 user nova-compute[72150]: INFO nova.virt.libvirt.driver [-] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Instance destroyed successfully.
Aug 01 19:15:51 user nova-compute[72150]: DEBUG nova.objects.instance [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lazy-loading 'resources' on Instance uuid 683d3b67-042a-4d95-baff-8657e3e0f7ad {{(pid=72150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG nova.virt.libvirt.vif [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1630682906',display_name='tempest-SnapshotDataIntegrityTests-server-1630682906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1630682906',id=52,image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+gaBEon/HiqDrZlF8rwh64s8am4wRqK9HPYdJLOyWg0bZFhIyOLFoA4WM4tkFQbtC6vBCh8jAaSqGdElSe8Y7snvWFdOluancJtAgAGKqFO7oBIEznXr2eLmZkrLR/3g==',key_name='tempest-keypair-239562411',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:08:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b533d6e10caa4f1b94b1cfad43558180',ramdisk_id='',reservation_id='r-u4ifej6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dbc6b740-0555-4041-80f6-323ecd1d67db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-937413752',owner_user_name='tempest-SnapshotDataIntegrityTests-937413752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:08:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df42f154c3094d45ac81a63bbd0b3608',uuid=683d3b67-042a-4d95-baff-8657e3e0f7ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "address": "fa:16:3e:1a:97:73", "network": {"id": "12107337-8a71-4fd9-a156-06c0edae1d5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2119935962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b533d6e10caa4f1b94b1cfad43558180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b7b8ff-3f", "ovs_interfaceid": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Converting VIF {"id": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "address": "fa:16:3e:1a:97:73", "network": {"id": "12107337-8a71-4fd9-a156-06c0edae1d5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2119935962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b533d6e10caa4f1b94b1cfad43558180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b7b8ff-3f", "ovs_interfaceid": "b9b7b8ff-3f6b-41de-825d-25fe027e5cd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG nova.network.os_vif_util [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:97:73,bridge_name='br-int',has_traffic_filtering=True,id=b9b7b8ff-3f6b-41de-825d-25fe027e5cd3,network=Network(12107337-8a71-4fd9-a156-06c0edae1d5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9b7b8ff-3f') {{(pid=72150) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG os_vif [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:97:73,bridge_name='br-int',has_traffic_filtering=True,id=b9b7b8ff-3f6b-41de-825d-25fe027e5cd3,network=Network(12107337-8a71-4fd9-a156-06c0edae1d5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9b7b8ff-3f') {{(pid=72150) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9b7b8ff-3f, bridge=br-int, if_exists=True) {{(pid=72150) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:15:51 user nova-compute[72150]: INFO os_vif [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:97:73,bridge_name='br-int',has_traffic_filtering=True,id=b9b7b8ff-3f6b-41de-825d-25fe027e5cd3,network=Network(12107337-8a71-4fd9-a156-06c0edae1d5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9b7b8ff-3f')
Aug 01 19:15:51 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Deleting instance files /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad_del
Aug 01 19:15:51 user nova-compute[72150]: INFO nova.virt.libvirt.driver [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Deletion of /opt/stack/data/nova/instances/683d3b67-042a-4d95-baff-8657e3e0f7ad_del complete
Aug 01 19:15:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:15:51 user nova-compute[72150]: INFO nova.compute.manager [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 01 19:15:51 user nova-compute[72150]: DEBUG oslo.service.loopingcall [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72150) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG nova.compute.manager [-] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Deallocating network for instance {{(pid=72150) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 19:15:51 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] deallocate_for_instance() {{(pid=72150) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 19:15:52 user nova-compute[72150]: DEBUG nova.network.neutron [-] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Updating instance_info_cache with network_info: [] {{(pid=72150) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:15:52 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Took 0.95 seconds to deallocate network for instance.
Aug 01 19:15:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:15:52 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:15:53 user nova-compute[72150]: DEBUG nova.compute.manager [req-5cde4ae2-93fb-4a65-a01b-a4f4ffa92704 req-ab9b1b91-79b3-4eb3-b894-7acb90cd82dc service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Received event network-vif-deleted-b9b7b8ff-3f6b-41de-825d-25fe027e5cd3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:15:53 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:15:53 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:15:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:15:53 user nova-compute[72150]: INFO nova.scheduler.client.report [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Deleted allocations for instance 683d3b67-042a-4d95-baff-8657e3e0f7ad
Aug 01 19:15:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-ba3b781e-3275-447a-b570-fdd66a856190 tempest-SnapshotDataIntegrityTests-937413752 tempest-SnapshotDataIntegrityTests-937413752-project-member] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.297s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:15:53 user nova-compute[72150]: DEBUG nova.compute.manager [req-1ede359d-d331-426a-a4d7-883a198ddedd req-8f4269b8-bd0e-4409-8cac-0b2b9a99eb48 service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Received event network-vif-plugged-b9b7b8ff-3f6b-41de-825d-25fe027e5cd3 {{(pid=72150) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:15:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1ede359d-d331-426a-a4d7-883a198ddedd req-8f4269b8-bd0e-4409-8cac-0b2b9a99eb48 service nova] Acquiring lock "683d3b67-042a-4d95-baff-8657e3e0f7ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:15:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1ede359d-d331-426a-a4d7-883a198ddedd req-8f4269b8-bd0e-4409-8cac-0b2b9a99eb48 service nova] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:15:53 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [req-1ede359d-d331-426a-a4d7-883a198ddedd req-8f4269b8-bd0e-4409-8cac-0b2b9a99eb48 service nova] Lock "683d3b67-042a-4d95-baff-8657e3e0f7ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:15:53 user nova-compute[72150]: DEBUG nova.compute.manager [req-1ede359d-d331-426a-a4d7-883a198ddedd req-8f4269b8-bd0e-4409-8cac-0b2b9a99eb48 service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] No waiting events found dispatching network-vif-plugged-b9b7b8ff-3f6b-41de-825d-25fe027e5cd3 {{(pid=72150) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:15:53 user nova-compute[72150]: WARNING nova.compute.manager [req-1ede359d-d331-426a-a4d7-883a198ddedd req-8f4269b8-bd0e-4409-8cac-0b2b9a99eb48 service nova] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Received unexpected event network-vif-plugged-b9b7b8ff-3f6b-41de-825d-25fe027e5cd3 for instance with vm_state deleted and task_state None.
Aug 01 19:15:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:16:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:16:04 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:16:06 user nova-compute[72150]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690917351.7713795, 683d3b67-042a-4d95-baff-8657e3e0f7ad => Stopped> {{(pid=72150) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:16:06 user nova-compute[72150]: INFO nova.compute.manager [-] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] VM Stopped (Lifecycle Event)
Aug 01 19:16:06 user nova-compute[72150]: DEBUG nova.compute.manager [None req-31633118-9767-4b8c-b77b-7f180555889c None None] [instance: 683d3b67-042a-4d95-baff-8657e3e0f7ad] Checking state {{(pid=72150) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:16:06 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:16:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:16:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:16:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:16:06 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:16:06 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:16:07 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:16:07 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:16:07 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=8967MB free_disk=25.33099365234375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:16:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:16:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:16:07 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:16:07 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:16:07 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:16:07 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:16:07 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:16:07 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:16:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:16:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:16:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:16:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72150) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:16:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:16:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72150) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:16:16 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:16:18 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:16:19 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:16:20 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:16:21 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:16:21 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:16:22 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:16:22 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72150) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:16:23 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:16:26 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:16:27 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:16:27 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Starting heal instance info cache {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:16:27 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Rebuilding the list of instances to heal {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:16:27 user nova-compute[72150]: DEBUG nova.compute.manager [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Didn't find any instances for network info cache update. {{(pid=72150) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 19:16:31 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:16:31 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:16:36 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:16:41 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:16:42 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:16:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:16:46 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:16:49 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:16:51 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:16:56 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:17:01 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:17:05 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:17:06 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:17:08 user nova-compute[72150]: DEBUG oslo_service.periodic_task [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72150) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:17:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:17:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:17:08 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:17:08 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Auditing locally available compute resources for user (node: user) {{(pid=72150) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:17:09 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:17:09 user nova-compute[72150]: WARNING nova.virt.libvirt.driver [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:17:09 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Hypervisor/Node resource view: name=user free_ram=9081MB free_disk=25.31208038330078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=72150) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:17:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:17:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:17:09 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:17:09 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72150) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:17:09 user nova-compute[72150]: DEBUG nova.compute.provider_tree [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed in ProviderTree for provider: f205788b-0048-4b9c-8d9d-b0437c5c3479 {{(pid=72150) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:17:09 user nova-compute[72150]: DEBUG nova.scheduler.client.report [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Inventory has not changed for provider f205788b-0048-4b9c-8d9d-b0437c5c3479 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72150) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:17:09 user nova-compute[72150]: DEBUG nova.compute.resource_tracker [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Compute_service record updated for user:user {{(pid=72150) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:17:09 user nova-compute[72150]: DEBUG oslo_concurrency.lockutils [None req-711af57a-c5e4-40fd-9382-9d1e43aa7379 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=72150) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:17:11 user nova-compute[72150]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72150) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}